planningalerts-scrapers / surf_coast

Surf Coast Shire Council Development Applications

README.md

Surf Coast Shire Council Development Applications for PlanningAlerts

Note that the system on the council side that is showing the development applications is the same as used by Stonnington. At some point it might be worthwhile to combine these two scrapers into one.

This is a scraper that runs on Morph. To get started see the documentation

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

Set MORPH_AUSTRALIAN_PROXY to an Australian proxy, preferably one that rotates its IP address

Expected Output

Requesting pageful of details ...
Storing 26/0097 - 3410 Princes Highway, WINCHELSEA VIC 3241
Storing 26/0098 - 35 ODonohue Road, ANGLESEA VIC 3230
...
Storing 26/0093 (VicSmart) - 49 Wybellenna Drive, FAIRHAVEN VIC 3231
Storing PG19/0086 - 2 - 125 Austin Street, WINCHELSEA VIC 3241 & 135 Austin Street and 50 Witcombe Street and part 235 Austin Street, WINCHELSEA VIC 3241
Requesting pageful of details ...
...
Storing 26/0073 - 2 Cottage Crescent, TORQUAY VIC 3228
Finished - processed 44 records

Expected runtime: ~ 5 seconds

To run the scraper

bundle exec ruby scraper.rb

To run style and coding checks

bundle exec rubocop

To check for security updates

gem install bundler-audit
bundle-audit

Contributors mlandauer daveslutzkin LoveMyData henare MichaelBone benrfairless ianheggie-oaf

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Requesting pageful of details ... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Storing 26/0189 - 660 Bambra-Boonah Road, BOONAH VIC 3235 Storing 26/0187 - 90 Jinda Park Lane, BAMBRA VIC 3241 Storing 26/0188 (VicSmart) - 16A Alice Road, AIREYS INLET VIC 3231 Storing 25/0329 - PC1 - 32 Cylinders Drive, TORQUAY VIC 3228 Storing 24/0368 - 1 - 41 McMillan Street, ANGLESEA VIC 3230 Storing 26/0185 - 27 Deans Marsh Road, LORNE VIC 3232 Storing 25/0169 - PC1 - 69 Noble Street, ANGLESEA VIC 3230 Storing 26/0186 - 13 Fernald Avenue, ANGLESEA VIC 3230 & 13 Fernald Avenue, ANGLESEA VIC 3230 Storing 24/0026 - PC1 - 29-37 Gosney Street, WINCHELSEA VIC 3241 Storing 22/0520 - 1 - PC1 - 4 Robyn Road, MOGGS CREEK VIC 3231 & 2 Robyn Road, MOGGS CREEK VIC 3231 Requesting pageful of details ... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Storing 25/0257 - PC1 - 45 Eagle Rock Parade, AIREYS INLET VIC 3231 Storing 26/0181 (VicSmart) - 10 Pearse Road, AIREYS INLET VIC 3231 Storing 24/0168 - PC12 - 125 Briody Drive, TORQUAY VIC 3228 & 31 Illawong Drive, TORQUAY VIC 3228 & 111 Briody Drive, TORQUAY VIC 3228 & 119 Briody Drive, TORQUAY VIC 3228 & 105 Briody Drive, TORQUAY VIC 3228 & 95 Briody Drive, TORQUAY VIC 3228 & 120 Grossmans Road, TORQUAY VIC 3228 & 96 Grossmans Road, TORQUAY VIC 3228 Storing 26/0182 - CHITTERING, 135 Armytage Road, WINCHELSEA VIC 3241 Storing 25/0326 - PC1 - 14 Butterworth Crescent, ANGLESEA VIC 3230 Storing 26/0180 (VicSmart) - 31 Aireys Street, AIREYS INLET VIC 3231 Storing 25/0164 - 1 - 79 Sunset Strip, JAN JUC VIC 3228 Storing 25/0340 - PC1 - 27 Fairway Drive, ANGLESEA VIC 3230 Storing 26/0178 (VicSmart) - 22 Beach View Crescent, TORQUAY VIC 3228 Storing 26/0179 (VicSmart) - 22 Beach View Crescent, TORQUAY VIC 3228 Requesting pageful of details ... Storing 26/0176 - 6A McRorie Street, ANGLESEA VIC 3230 /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Storing 26/0177 - 69 Fraser Avenue, ANGLESEA VIC 3230 Storing 26/0175 - 16 McMillan Street, ANGLESEA VIC 3230 Storing 24/0099 - 2 - 4/7-9 Cylinders Drive, TORQUAY VIC 3228 Storing 25/0194 - PC1 - 115 Hurst Road, BELLS BEACH VIC 3228 & 95 Hurst Road, BELLS BEACH VIC 3228 Storing 26/0174 - 4 Bells Boulevard, JAN JUC VIC 3228 Storing 26/0171 - 16 Polwarth Road, LORNE VIC 3232 Storing 23/0381 - PC1 - 93 Dorman Street, LORNE VIC 3232 Storing 26/0172 - 8 Elizabeth Street, ANGLESEA VIC 3230 Storing 26/0173 - 59 Noble Street, ANGLESEA VIC 3230 Requesting pageful of details ... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Storing 26/0168 - 24 Delview Drive, JAN JUC VIC 3228 Storing 26/0169 (VicSmart) - 1795 Hendy Main Road, PARAPARAP VIC 3240 Storing 26/0170 - 80 Jarosite Road, BELLS BEACH VIC 3228 Storing 26/0040 - PC1 (VicSmart) - 9 Mercer Street, WINCHELSEA VIC 3241 Storing 26/0165 (VicSmart) - 245 Bones Road, JAN JUC VIC 3228 Storing 26/0166 - 12 Cowan Avenue, FAIRHAVEN VIC 3231 Storing 26/0167 - 5 McCanns Road, MOUNT DUNEED VIC 3217 Storing 26/0163 (VicSmart) - 18 Carnoustie Avenue, JAN JUC VIC 3228 Storing 26/0164 - 40 Fischer Street, TORQUAY VIC 3228 Storing 24/0291 - 1 - 24 Camp Road, ANGLESEA VIC 3230 Requesting pageful of details ... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Storing 26/0161 - 27 Deans Marsh Road, LORNE VIC 3232 Storing 26/0162 (VicSmart) - 27 Banool Road, FAIRHAVEN VIC 3231 Storing 23/0077 - 1 - 200 Church Road, MODEWARRE VIC 3240 Storing 25/0364 - PC1 - 1 Hazel Street, LORNE VIC 3232 Storing 26/0157 - 45 Knights Track, GHERANG VIC 3240 Storing 24/0201 - 2 - PC5 - 111 Briody Drive, TORQUAY VIC 3228 & 105 Briody Drive, TORQUAY VIC 3228 & 120 Grossmans Road, TORQUAY VIC 3228 & 119 Briody Drive, TORQUAY VIC 3228 & 125 Briody Drive, TORQUAY VIC 3228 & 96 Grossmans Road, TORQUAY VIC 3228 Storing 26/0159 - 177 Pennyroyal Station Road, PENNYROYAL VIC 3235 Storing 26/0155 - 37 Eighth Avenue, ANGLESEA VIC 3230 Storing 21/0516 - 1 - PC2 - 24 Murray Street, ANGLESEA VIC 3230 Storing 26/0156 - 21 Eighth Avenue, ANGLESEA VIC 3230 Requesting pageful of details ... /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Finished - processed 50 records

Data

Downloaded 5929 times by openaustralia mlandauer dcalde LoveMyData jesse-a-reilly tkrikke repose-lecture DevAppProject TheZepto Manasaanand 538digital MikeRalphson GitHubMLee TornMarketing Jedwards157 MichaelBone odnagroup planometric-vic

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.73 MB) Use the API

rows 10 / 3766

date_scraped description info_url address council_reference on_notice_from on_notice_to comment_url date_received
2012-04-25
Use of the land to sell and consume liquor
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/1_Merrijig_Drive_Torquay
1 Merrijig Drive, Torquay, VIC
12/0118
2012-04-26
2012-05-10
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/1_Merrijig_Drive_Torquay
2012-04-25
Construction of a dwelling with a building site coverage greater than 150m2
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/9_Hedley_Street_Anglesea
9 Hedley Street, Anglesea, VIC
12/0099
2012-04-26
2012-05-10
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/9_Hedley_Street_Anglesea
2012-04-25
Subdivision of the land into two lots
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/1B_River_Reserve_Road_Anglesea
1B River Reserve Road, Anglesea, VIC
12/0010
2012-04-25
2012-05-09
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/1B_River_Reserve_Road_Anglesea
2012-04-25
Construction of a dwelling with a maximum building height in excess of 7.5 metres
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/14_Glengarry_Drive_Torquay
14 Glengarry Drive, Torquay, VIC
12/0112
2012-04-24
2012-05-08
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/14_Glengarry_Drive_Torquay
2012-04-25
Development of buildings and works (dwelling alterations and additions)
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/2_Dorman_Street_Lorne
2 Dorman Street, Lorne, VIC
10/0222
2012-04-24
2012-05-08
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/2_Dorman_Street_Lorne
2012-04-25
Construction of a fence
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/1_Holding_Court_Anglesea
1 Holding Court, Anglesea, VIC
12/0113
2012-04-20
2012-05-04
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/1_Holding_Court_Anglesea
2012-04-25
Subdivision of the land into three lots
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/625_Cape_Otway_Road_Moriac
625 Cape Otway Road, Moriac, VIC
11/0181
2012-04-23
2012-05-07
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/625_Cape_Otway_Road_Moriac
2012-04-25
Alterations and additions to an existing dwelling with a maximum height greater than 5m
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/110_Melba_Parade_Anglesea
110 Melba Parade, Anglesea, VIC
12/0091
2012-04-17
2012-05-01
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/110_Melba_Parade_Anglesea
2012-04-25
Subdivision of the land into four lots
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/44_Jackson_Street_Winchelsea
44 Jackson Street, Winchelsea, VIC
12/0074
2012-04-13
2012-04-27
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/44_Jackson_Street_Winchelsea
2012-04-25
Construction of a relocated dwelling
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/197_Great_Ocean_Road_Anglesea
197 Great Ocean Road, Anglesea, VIC
12/0085
2012-04-11
2012-04-25
http://www.surfcoast.vic.gov.au/My_Property/Building_Planning/Planning/Applications_On_Public_Exhibition/197_Great_Ocean_Road_Anglesea

Statistics

Average successful run time: less than a minute

Total run time: 9 days

Total cpu time used: about 1 hour

Total disk space used: 1.79 MB

History

  • Manually ran revision deb767d9 and completed successfully .
    50 records added in the database
  • Auto ran revision 95744333 and failed .
    nothing changed in the database
  • Auto ran revision 95744333 and failed .
    nothing changed in the database
  • Auto ran revision 95744333 and failed .
    nothing changed in the database
  • Auto ran revision 95744333 and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

surf_coast / scraper.rb