planningalerts-scrapers / wollondilly

Wollondilly Shire Council Development Applications

README.md

Wollondilly now has a custom web application which has an API. So, we're using that.

Contributors

Last run completed successfully 2024-05-09.

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.5.1 [1G-----> Installing dependencies using bundler version 1.15.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G Fetching gem metadata from https://rubygems.org/...... [1G Fetching version metadata from https://rubygems.org/. [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Using bundler 1.15.2 [1G Fetching connection_pool 2.2.2 [1G Fetching unf_ext 0.0.7.6 [1G Fetching httpclient 2.8.3 [1G Installing connection_pool 2.2.2 [1G Installing httpclient 2.8.3 [1G Installing unf_ext 0.0.7.6 with native extensions [1G Fetching mime-types-data 3.2019.0331 [1G Installing mime-types-data 3.2019.0331 [1G Fetching net-http-digest_auth 1.4.1 [1G Fetching mini_portile2 2.4.0 [1G Installing net-http-digest_auth 1.4.1 [1G Installing mini_portile2 2.4.0 [1G Fetching ntlm-http 0.1.1 [1G Installing ntlm-http 0.1.1 [1G Fetching webrobots 0.1.2 [1G Fetching sqlite3 1.3.13 [1G Installing webrobots 0.1.2 [1G Installing sqlite3 1.3.13 with native extensions [1G Fetching net-http-persistent 3.0.1 [1G Installing net-http-persistent 3.0.1 [1G Fetching mime-types 3.2.2 [1G Installing mime-types 3.2.2 [1G Fetching nokogiri 1.10.3 [1G Installing nokogiri 1.10.3 with native extensions [1G Fetching unf 0.1.4 [1G Installing unf 0.1.4 [1G Fetching domain_name 0.5.20180417 [1G Installing domain_name 0.5.20180417 [1G Fetching http-cookie 1.0.3 [1G Installing http-cookie 1.0.3 [1G Fetching sqlite_magic 0.0.6 [1G Installing sqlite_magic 0.0.6 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Fetching mechanize 2.7.6 [1G Installing mechanize 2.7.6 [1G Bundle complete! 2 Gemfile dependencies, 19 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Bundle completed (12.54s) [1G Cleaning up the bundler cache. [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G-----> Detecting rake tasks [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... Using Australian proxy... Storing S68/2023/135/2 - 20 Rockford Road TAHMOOR, NSW Storing S68/2023/170/2 - 135 Quirkes Lane MENANGLE, NSW Storing S68/2024/33/1 - 5-15 Hawthorne Road BARGO, NSW Storing S68/2024/34/1 - 700 Werombi Road THERESA PARK, NSW Storing S68/2024/35/1 - 40 Gibson Street SILVERDALE, NSW Storing S68/2024/36/1 - 74 Elvy Street BARGO, NSW Storing S68/2024/37/1 - 53 Hogans Drive BARGO, NSW Storing S68/2024/38/1 - 270 Farnsworth Avenue WARRAGAMBA, NSW Storing S68/2024/39/1 - 6 Carra Avenue DOUGLAS PARK, NSW Storing S68/2024/40/1 - 5 Ramsay Street PICTON, NSW Storing S68/2024/41/1 - 5 Noonamena Road TAHMOOR, NSW Storing S68/2024/43/1 - 65 Progress Street TAHMOOR, NSW Storing S68/2024/46/1 - 55 Tahmoor Road TAHMOOR, NSW Storing S68/2024/47/1 - 8 Langmead Road SILVERDALE, NSW Storing S68/2024/48/1 - 41 Hilton Park Road TAHMOOR, NSW Storing DA/1996/280/4 - 130 Estonian Road THIRLMERE, NSW Storing DA/1999/57648/2 - 1287 Werombi Road WEROMBI, NSW Storing DA/2017/619/2 - 105 Braddocks Road ORANGEVILLE, NSW Storing DA/2018/347/2 - 15 Bonds Road THIRLMERE, NSW Storing DA/2018/573/3 - 32 Alexander Way MOUNT HUNTER, NSW Storing DA/2018/784/2 - 11 Westminster Place RAZORBACK, NSW Storing DA/2019/719/7 - 20 Rockford Road TAHMOOR, NSW Storing DA/2019/719/8 - 20 Rockford Road TAHMOOR, NSW Storing DA/2020/790/3 - 125 News Road WEROMBI, NSW Storing DA/2022/36/2 - 2 Major Roberts Avenue TAHMOOR, NSW Storing DA/2022/1028/3 - 18 Bronzewing Street TAHMOOR, NSW Storing DA/2022/1092/2 - 4 Anderson Close APPIN, NSW Storing DA/2022/1274/2 - 1390 Moreton Park Road MENANGLE, NSW Storing DA/2023/201/2 - 40 Meryla Street COURIDJAH, NSW Storing DA/2023/726/2 - 20 Walter Street THIRLMERE, NSW Storing DA/2023/729/2 - 18 Walter Street THIRLMERE, NSW Storing DA/2023/735/2 - 16 Walter Street THIRLMERE, NSW Storing DA/2023/736/2 - 14 Walter Street THIRLMERE, NSW Storing DA/2023/1046/2 - 10 Burton Drive TAHMOOR, NSW Storing DA/2023/1121/2 - 4 Scar Tree Crescent WILTON, NSW Storing DA/2023/1186/2 - 2/2 Bollard Place PICTON, NSW Storing DA/2024/5/2 - 40 Merlin Street THE OAKS, NSW Storing DA/2024/266/1 - 6 Roundhill Road WILTON, NSW Storing DA/2024/267/1 - 10 Badgally Road THE OAKS, NSW Storing DA/2024/271/1 - 22 Tsavo Street SILVERDALE, NSW Storing DA/2024/277/1 - 35 Laurel Street MENANGLE, NSW Storing DA/2024/278/1 - 245 Jenkins Street DOUGLAS PARK, NSW Storing DA/2024/279/1 - 115 Ruddocks Road LAKESLAND, NSW Storing DA/2024/280/1 - 15 Dennis Street THIRLMERE, NSW Storing DA/2024/281/1 - 20 Dennis Street THIRLMERE, NSW Storing DA/2024/282/1 - 62 Heritage Drive APPIN, NSW Storing DA/2024/283/1 - 25 Toby Place RAZORBACK, NSW Storing DA/2024/284/1 - 410 Douglas Park Drive DOUGLAS PARK, NSW Storing DA/2024/285/1 - 146 Fallons Road WEROMBI, NSW Storing DA/2024/286/1 - 456A Argyle Street PICTON, NSW Storing DA/2024/287/1 - 36 Fitzroy Street WILTON, NSW Storing DA/2024/288/1 - 41 Hilton Park Road TAHMOOR, NSW Storing DA/2024/289/1 - 815 Montpelier Drive THE OAKS, NSW Storing DA/2024/290/1 - 6 Carra Avenue DOUGLAS PARK, NSW Storing DA/2024/291/1 - 40 Gibson Street SILVERDALE, NSW Storing DA/2024/292/1 - 40 Gibson Street SILVERDALE, NSW Storing DA/2024/294/1 - 53 Ingleton Circuit WILTON, NSW Storing DA/2024/295/1 - 7 Oxenbridge Avenue WILTON, NSW Storing DA/2024/296/1 - 40 Sportsground Parade APPIN, NSW Storing DA/2024/297/1 - 3 Fitzroy Street WILTON, NSW Storing DA/2024/299/1 - 5 Noonamena Road TAHMOOR, NSW Storing DA/2024/301/1 - 40 Roy Crescent THIRLMERE, NSW Storing DA/2024/304/1 - 10 Theresa View Road THERESA PARK, NSW Storing DA/2024/307/1 - 360 The Grand Circuit ORANGEVILLE, NSW Storing DA/2024/309/1 - 50 Picton Avenue PICTON, NSW Storing DA/2024/310/1 - 14 Somerset Street WILTON, NSW Storing DA/2024/313/1 - 11 Sanctuary Drive TAHMOOR, NSW Storing DA/2024/315/1 - 69 Dredge Avenue DOUGLAS PARK, NSW Storing DA/2024/316/1 - 34 Dulcimere Street TAHMOOR, NSW Storing DA/2024/317/1 - 19 Station Street MENANGLE, NSW Storing DA/2024/318/1 - 50 Tiger Street SILVERDALE, NSW Storing DA/2024/319/1 - 350 Bobs Range Road ORANGEVILLE, NSW Storing DA/2024/320/1 - 14 The Vintage PICTON, NSW Storing DA/2024/321/1 - 7 Warradale Road SILVERDALE, NSW Storing DA/2024/322/1 - 47 Serengeti Circuit SILVERDALE, NSW Storing DA/2024/323/1 - 8 Teale Circuit TAHMOOR, NSW Storing DA/2024/326/1 - 25 Radnor Road BARGO, NSW Storing DA/2024/327/1 - 13 Cuttriss Crescent WILTON, NSW Storing DA/2024/328/1 - 50 The Irons Drive WILTON, NSW Storing DA/2024/329/1 - 13 Gibney Street WILTON, NSW Storing DA/2024/330/1 - 54 Nepean Street DOUGLAS PARK, NSW Storing DA/2024/331/1 - 32 Macanene Street WILTON, NSW Storing DA/2024/332/1 - 1080 Werombi Road THERESA PARK, NSW Storing DA/2024/333/1 - 65 Progress Street TAHMOOR, NSW Storing DA/2024/334/1 - Elladale Road APPIN, NSW Storing DA/2024/335/1 - 67 Fairway Drive WILTON, NSW Storing DA/2024/336/1 - 25 Antill Street PICTON, NSW Storing DA/2024/337/1 - 25 Antill Street PICTON, NSW Storing DA/2024/338/1 - 5 Berry Avenue MENANGLE, NSW Storing DA/2024/339/1 - 6 Stanton Street THIRLMERE, NSW Storing DA/2024/340/1 - 10 Woodside Place TAHMOOR, NSW Storing DA/2024/341/1 - 170 Cedar Creek Road THIRLMERE, NSW Storing DA/2024/344/1 - 1 Tarini Place TAHMOOR, NSW Storing DA/2024/346/1 - 3240 Remembrance Driveway BARGO, NSW Storing DA/2024/347/1 - 146 Fallons Road WEROMBI, NSW Storing DA/2024/349/1 - 14 Glendiver Road THE OAKS, NSW Storing DA/2024/354/1 - 383B Thirlmere Way THIRLMERE, NSW Storing DA/2024/355/1 - 15 Middleton Place PICTON, NSW Storing DA/2024/359/1 - 13 Lone Lea Street TAHMOOR, NSW Storing DA/2024/361/1 - 9 Bly Street TAHMOOR, NSW Storing DA/2024/365/1 - 55 Burrells Road MENANGLE, NSW Storing CDC/2023/481/2 - 4 Scar Tree Crescent WILTON, NSW Storing CDC/2024/67/2 - 3 Cuttriss Crescent WILTON, NSW Storing CDC/2024/107/1 - 260 Montpelier Drive THE OAKS, NSW Storing CDC/2024/110/1 - 101 Longview Drive WILTON, NSW Storing CDC/2024/113/1 - 6 Nestlebrae Street SILVERDALE, NSW Storing CDC/2024/115/1 - 11 The Acres Way TAHMOOR, NSW Storing CDC/2024/116/1 - 2 Frew Street WILTON, NSW Storing CDC/2024/117/1 - 27 Butler Drive WILTON, NSW Storing CDC/2024/120/1 - 20 York Street TAHMOOR, NSW Storing CDC/2024/122/1 - 6 Parry Street WILTON, NSW Storing CDC/2024/123/1 - 16 Heritage Drive APPIN, NSW Storing CDC/2024/124/1 - 12 Parry Street WILTON, NSW Storing CDC/2024/125/1 - 32 Coachwood Crescent PICTON, NSW Storing CDC/2024/127/1 - 97 Menangle Road MENANGLE, NSW Storing CDC/2024/129/1 - 36 Reginald Circuit WILTON, NSW

Data

Downloaded 2650 times by

data

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.7 MB) Use the API

rows 10 / 5029

council_reference	address	description	info_url	date_scraped	date_received	on_notice_from	on_notice_to	lat	lng
DA/2015/605/2	21 Station Master Avenue THIRLMERE, NSW	Modification to condition 24(5) for purpose of installing dog-proof fencing to prevent dogs from entering the conservation area	https://tracking.wollondilly.nsw.gov.au/detail/010.2015.00000605.002	2020-07-29	2020-07-09			-34.2015815866067	150.57718975772
DA/2017/7/2	40 Burragorang Street THE OAKS, NSW	Modification - design changes	https://tracking.wollondilly.nsw.gov.au/detail/010.2017.00000007.002	2020-07-29	2020-07-09	2020-07-15	2020-07-29	-34.0785271073153	150.566013656916
DA/2018/755/3	18 Torumba Circuit SILVERDALE, NSW	Modification - Modify condition 13 (1)	https://tracking.wollondilly.nsw.gov.au/detail/010.2018.00000755.003	2020-07-29	2020-07-10			-33.9125745023159	150.604898799426
DA/2019/597/3	85 Eagles Road RAZORBACK, NSW	Modification - design changes	https://tracking.wollondilly.nsw.gov.au/detail/010.2019.00000597.003	2020-07-29	2020-07-06	2020-07-10	2020-07-24	-34.1315649588424	150.672930057128
DA/2019/658/2	2 Kalangara Road SILVERDALE, NSW	Modification - design changes	https://tracking.wollondilly.nsw.gov.au/detail/010.2019.00000658.002	2020-07-29	2020-07-03			-33.911332578772	150.604277567584
DA/2020/170/2	120 Burrells Road MENANGLE, NSW	Modification - include temporary occupation	https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000170.002	2020-07-29	2020-07-07			-34.1561082189654	150.691282209498
DA/2020/231/2	8 Hassall Road BUXTON, NSW	Modification - Design changes	https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000231.002	2020-07-29	2020-07-10			-34.2487649560524	150.540986009254
DA/2020/315/1	529 Old Razorback Road CAWDOR, NSW	Dwelling additions and s68 connect to existing	https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000315.001	2020-07-29	2020-06-29			-34.1159615115923	150.668708408434
DA/2020/316/1	5 Camellia Court PICTON, NSW	Secondary dwelling & retaining walls	https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000316.001	2020-07-29	2020-06-29			-34.1813143878095	150.614690808844
DA/2020/317/1	5 Dillies Lane TAHMOOR, NSW	Dwelling house	https://tracking.wollondilly.nsw.gov.au/detail/010.2020.00000317.001	2020-07-29	2020-06-29			-34.2187083600634	150.604580262409

Statistics

Average successful run time: 1 minute

Total run time: 1 day

Total cpu time used: 28 minutes

Total disk space used: 2.03 MB

History

Auto ran revision 95d5b551 and completed successfully 2024-05-09.

run time 55 s

116 records added, 112 records removed in the database
Auto ran revision 95d5b551 and completed successfully 2024-05-08.

run time 51 s

117 records added, 110 records removed in the database
Auto ran revision 95d5b551 and completed successfully 2024-05-07.

run time 46 s

110 records added, 102 records removed in the database
Auto ran revision 95d5b551 and completed successfully 2024-05-06.

run time 43 s

102 records added, 100 records removed in the database
Auto ran revision 95d5b551 and completed successfully 2024-05-05.

run time 48 s

108 records added, 108 records removed in the database
...
Created on morph.io 2020-07-29

Show complete history

Scraper code

Ruby

wollondilly / scraper.rb

git clone URL