planningalerts-scrapers / bankstown

Bankstown Development Applications

README.md

Bankstown City Council Scraper

Bankstown City Council site is very easy to scrape, only need to scape a single page to get the entire month of DAs. No pagination, yay... Three cheers to Bankstown City Council !!!

However, the lack of HTML class, id, etc to identify the data, it requires a few 'explode' in PHP to get the right information.

By default: it will look for 'thisweek' of DAs, for data recovery you can set the MORPHPERIOD=thismonth or MORPHPERIOD=lastmonth

Still, not bad...Thanks and Enjoy

Contributors

Last run completed successfully 2024-11-14.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Saving record CD-1424/2024 Saving record CD-1423/2024 Saving record CD-1422/2024 Saving record CD-1421/2024 Saving record CC-536/2024 Saving record CC-535/2024 Saving record CC-534/2024 Saving record CC-131/2024/A Saving record CD-1420/2024 Saving record CD-1419/2024 Saving record CD-1418/2024 Saving record CC-533/2024 Saving record CC-532/2024 Saving record CC-531/2024 Saving record CC-530/2024 Saving record CC-529/2024 Saving record CC-528/2024 Saving record CC-527/2024 Saving record CC-526/2024 Saving record CC-525/2024 Saving record CC-524/2024 Saving record CC-504/2024/A Saving record CD-1417/2024 Saving record CD-1416/2024 Saving record CD-1415/2024 Saving record DA-1329/2024 Saving record CC-519/2024 Saving record CC-510/2024 Saving record CC-509/2024 Saving record CC-504/2024 Saving record CC-499/2024 Saving record CC-472/2024 Saving record CD-1414/2024 Saving record CD-1413/2024 Saving record CD-1412/2024 Saving record CD-1411/2024 Saving record CD-1410/2024 Saving record CD-1409/2024 Saving record CD-1408/2024 Saving record DA-1339/2024 Saving record DA-1336/2024 Saving record DA-1335/2024 Saving record DA-1334/2024 Saving record DA-846/2024/A Saving record CC-498/2024 Saving record CC-497/2024 Saving record CC-496/2024 Saving record CC-491/2024 Saving record CC-471/2024 Saving record DA-505/2023/A Saving record DA-50/2023/A Saving record DA-667/2017/B Saving record DA-6317/1992/C

Data

Downloaded 9381 times by

data

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (14.1 MB) Use the API

rows 10 / 27814

date_scraped	description	info_url	date_received	council_reference	address	comment_url
2012-08-22	Torrens Title Subdivision	http://online.bankstown.nsw.gov.au/Planning/pages/xc.track/SearchApplication.aspx?id=341606	2012-08-01	DA-579/2012	2 Kawana Street, BASS HILL NSW 2197	http://online.bankstown.nsw.gov.au/Planning/pages/xc.track/SearchApplication.aspx?id=341606
2012-08-22	Demolition of existing structures and construction of an attached dual occupancy with torrens title subdivision	http://online.bankstown.nsw.gov.au/Planning/pages/xc.track/SearchApplication.aspx?id=341622	2012-08-01	DA-580/2012	42 Mc Girr Street, PADSTOW NSW 2211	http://online.bankstown.nsw.gov.au/Planning/pages/xc.track/SearchApplication.aspx?id=341622
2012-08-22	Alterations and additions to existing warehouse including new driveway, mezzanine, storage area in roof space and updated facade	http://online.bankstown.nsw.gov.au/Planning/pages/xc.track/SearchApplication.aspx?id=341637	2012-08-01	DA-581/2012	127 Eldridge Road, CONDELL PARK NSW 2200	http://online.bankstown.nsw.gov.au/Planning/pages/xc.track/SearchApplication.aspx?id=341637
2012-08-22	Awning to Rear of Premises	http://online.bankstown.nsw.gov.au/Planning/pages/xc.track/SearchApplication.aspx?id=341642	2012-08-01	DA-582/2012	91 Dutton Street, YAGOONA NSW 2199	http://online.bankstown.nsw.gov.au/Planning/pages/xc.track/SearchApplication.aspx?id=341642
2012-08-22	Use of Premises as a Laser Hair Removal Clinic	http://online.bankstown.nsw.gov.au/Planning/pages/xc.track/SearchApplication.aspx?id=341668	2012-08-02	DA-583/2012	184 Tower Street, PANANIA NSW 2213	http://online.bankstown.nsw.gov.au/Planning/pages/xc.track/SearchApplication.aspx?id=341668
2012-08-22	Demolition of Existing Dwelling and Construction of an Attached Dual Occupancy with Torrens Title Subdivision	http://online.bankstown.nsw.gov.au/Planning/pages/xc.track/SearchApplication.aspx?id=341677	2012-08-02	DA-584/2012	34 Wilberforce Road, REVESBY NSW 2212	http://online.bankstown.nsw.gov.au/Planning/pages/xc.track/SearchApplication.aspx?id=341677
2012-08-22	Demolition of existing structures and construction of an attached dual occupancy with torrens title subdivision	http://online.bankstown.nsw.gov.au/Planning/pages/xc.track/SearchApplication.aspx?id=341699	2012-08-03	DA-585/2012	13 Greendale Crescent, CHESTER HILL NSW 2162	http://online.bankstown.nsw.gov.au/Planning/pages/xc.track/SearchApplication.aspx?id=341699
2012-08-22	Alterations and additions to existing dwelling including first floor addition	http://online.bankstown.nsw.gov.au/Planning/pages/xc.track/SearchApplication.aspx?id=341703	2012-08-03	DA-586/2012	10 Mactier Avenue, MILPERRA NSW 2214	http://online.bankstown.nsw.gov.au/Planning/pages/xc.track/SearchApplication.aspx?id=341703
2012-08-22	Carport and Two (2) Awnings	http://online.bankstown.nsw.gov.au/Planning/pages/xc.track/SearchApplication.aspx?id=341727	2012-08-03	DA-587/2012	32 Mae Crescent, PANANIA NSW 2213	http://online.bankstown.nsw.gov.au/Planning/pages/xc.track/SearchApplication.aspx?id=341727
2012-08-22	To extend the existing use as an educational establishment at 89 - 97 Greenacre Road and 80 - 84 Mimosa Road to include the following lots (addressed as 83 - 87 Greenacre Road) - Lot 3 DP 553862, Lot 21 DP 579408, Lot 22 DP 579408.	http://online.bankstown.nsw.gov.au/Planning/pages/xc.track/SearchApplication.aspx?id=341729	2012-08-03	DA-588/2012	89 Greenacre Road, GREENACRE NSW 2190	http://online.bankstown.nsw.gov.au/Planning/pages/xc.track/SearchApplication.aspx?id=341729

Statistics

Average successful run time: less than a minute

Total run time: 2 months

Total cpu time used: about 1 hour

Total disk space used: 14.5 MB

History

Auto ran revision 0bf35f6b and completed successfully 2024-11-14.

run time 2 minutes

53 records added, 44 records removed in the database
Auto ran revision 0bf35f6b and completed successfully 2024-11-13.

run time 47 s

44 records added, 27 records removed in the database
Auto ran revision 0bf35f6b and completed successfully 2024-11-12.

run time 23 s

26 records added, 13 records removed in the database
Auto ran revision 0bf35f6b and completed successfully 2024-11-11.

run time 21 s

11 records added in the database
Auto ran revision 0bf35f6b and completed successfully 2024-11-10.

run time 5 s

nothing changed in the database
...
Created on morph.io 2014-01-22

Show complete history

Scraper code

PHP

bankstown / scraper.php

git clone URL