planningalerts-scrapers / greater_geelong

City of Greater Geelong Development Applications


This is a scraper that runs on Morph. To get started see the documentation

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

To run the scraper

bundle exec ruby scraper.rb

Set MORPH_AUSTRALIAN_PROXY to the url for an Australian proxy

Expected output

Saving 1339/2023...
Saving 872/2025...
(etc)
Saving 391/2023/A...
Saving 548/2025...

Execution time ~ 4 seconds.

To run style and coding checks

bundle exec rubocop

To check for security updates

gem install bundler-audit
bundle-audit

Contributors henare CloCkWeRX mlandauer muzza1976 benrfairless ianheggie-oaf

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Using Australian proxy... scraper.rb:33:in `block in <main>': undefined method `inner_text' for nil:NilClass (NoMethodError) on_notice_to: Date.parse(r.search("td")[4].inner_text).to_s, ^^^^^^^^^^^ from /app/vendor/bundle/ruby/3.2.0/gems/nokogiri-1.16.8-x86_64-linux/lib/nokogiri/xml/node_set.rb:235:in `block in each' from /app/vendor/bundle/ruby/3.2.0/gems/nokogiri-1.16.8-x86_64-linux/lib/nokogiri/xml/node_set.rb:234:in `upto' from /app/vendor/bundle/ruby/3.2.0/gems/nokogiri-1.16.8-x86_64-linux/lib/nokogiri/xml/node_set.rb:234:in `each' from scraper.rb:18:in `<main>'

Data

Downloaded 7642 times by openaustralia LoveMyData dcalde mlandauer jesse-a-reilly DevAppProject tkrikke repose-lecture TheZepto jbourne000 planometric-vic owaat TornMarketing Jedwards157 muzza1976 muzzie86 93399339 henare GitHubMLee Simsoi

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3.74 MB) Use the API

rows 10 / 8659

description info_url address council_reference on_notice_from on_notice_to comment_url date_scraped
Buildings and Works Associated with the Construction of a Shed
9 RIVER STREET, Batesford
1416/2011
2012-03-02
2012-03-20
2012-03-04
Nine (9) Lot Subdivision
30 AVONLEA ROAD, Bell Post Hill
1137/2011
2012-03-02
2012-03-20
2012-03-04
Removal of Covenant U362287Q which prevents the Construction of more than One Dwelling
2 VICTORIA TERRACE, Belmont
68/2012
2012-02-06
2012-03-09
2012-03-04
Construction of a Second Dwelling
26 ROSLYN ROAD, Belmont
1449/2011
2012-02-29
2012-03-18
2012-03-04
Two (2) Lot Subdivision (Amendment: Re-configuration of the Layout of the Subdivision without Common Property)
3 ARALUEN PARADE, Belmont
55/2009/A
2012-02-21
2012-03-10
2012-03-04
Two Lot Subdivision
31 WATSON AVENUE, Belmont
23/2012
2012-02-23
2012-03-12
2012-03-04
Buildings and Works Associated with a Section 2 Use
28 COX ROAD, Corio
47/2012
2012-02-24
2012-03-13
2012-03-04
Development and use of the land for a take away food premises
420 PRINCES HIGHWAY, Corio
10/2012
2012-02-22
2012-03-11
2012-03-04
Construction of Two (2) Additional Dwellings
8 DETROIT CRESCENT, Corio
101/2012
2012-03-02
2012-03-20
2012-03-04
Partial Demolition including Rear Chimney, Extension to the Existing Dwelling and Construction of a Garage
17 GRANDVIEW GROVE, Drumcondra
126/2012
2012-02-17
2012-03-06
2012-03-04

Statistics

Average successful run time: 24 minutes

Total run time: 3 months

Total cpu time used: about 2 hours

Total disk space used: 3.81 MB

History

  • Auto ran revision a0e49aff and failed .
    nothing changed in the database
  • Auto ran revision a0e49aff and failed .
    nothing changed in the database
  • Auto ran revision a0e49aff and failed .
    nothing changed in the database
  • Auto ran revision a0e49aff and failed .
    nothing changed in the database
  • Auto ran revision a0e49aff and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

greater_geelong / scraper.rb