planningalerts-scrapers / yarra

Yarra City Development Applications


Yarra City Council

  • Server - Standard HTTP
  • Cookie tracking - Yes
  • Pagnation - Yes
  • Javascript - No
  • Clearly defined data within a row - Yes

Enjoy

Contributors mlandauer daveslutzkin LoveMyData henare

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.4.1 [1G-----> Installing dependencies using bundler 1.15.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Fetching gem metadata from https://rubygems.org/...... [1G Fetching version metadata from https://rubygems.org/. [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Using bundler 1.15.2 [1G Fetching unf_ext 0.0.7.4 [1G Fetching httpclient 2.8.3 [1G Fetching mime-types-data 3.2016.0521 [1G Installing mime-types-data 3.2016.0521 [1G Fetching net-http-digest_auth 1.4.1 [1G Installing unf_ext 0.0.7.4 with native extensions [1G Installing httpclient 2.8.3 [1G Installing net-http-digest_auth 1.4.1 [1G Fetching net-http-persistent 2.9.4 [1G Installing net-http-persistent 2.9.4 [1G Fetching mini_portile2 2.2.0 [1G Fetching ntlm-http 0.1.1 [1G Installing mini_portile2 2.2.0 [1G Installing ntlm-http 0.1.1 [1G Fetching webrobots 0.1.2 [1G Fetching sqlite3 1.3.13 [1G Installing webrobots 0.1.2 [1G Installing sqlite3 1.3.13 with native extensions [1G Fetching mime-types 3.1 [1G Installing mime-types 3.1 [1G Fetching nokogiri 1.8.0 [1G Installing nokogiri 1.8.0 with native extensions [1G Fetching unf 0.1.4 [1G Installing unf 0.1.4 [1G Fetching domain_name 0.5.20170404 [1G Installing domain_name 0.5.20170404 [1G Fetching http-cookie 1.0.3 [1G Installing http-cookie 1.0.3 [1G Fetching sqlite_magic 0.0.6 [1G Installing sqlite_magic 0.0.6 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Fetching mechanize 2.7.5 [1G Installing mechanize 2.7.5 [1G Bundle complete! 2 Gemfile dependencies, 18 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Bundle completed (13.36s) [1G Cleaning up the bundler cache. [1G-----> Detecting rake tasks [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... /app/vendor/bundle/ruby/2.4.0/gems/mechanize-2.7.5/lib/mechanize/http/agent.rb:323:in `fetch': 403 => Net::HTTPForbidden for https://www.yarracity.vic.gov.au/planning-application-search?suburb=(All)&street=(All)&status=Current&ward=(All) -- unhandled response (Mechanize::ResponseCodeError) from /app/vendor/bundle/ruby/2.4.0/gems/mechanize-2.7.5/lib/mechanize.rb:464:in `get' from scraper.rb:44:in `<main>'

Data

Downloaded 5147 times by openaustralia dcalde DevAppProject mlandauer LoveMyData jesse-a-reilly TheZepto Kevin3054 krynens codemonkeyau AbhinavRajagopal VirginMatador odnagroup mojoflux Simsoi HS247 TornMarketing Jedwards157 intotecho RDMonark

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (7.87 MB) Use the API

rows 10 / 14883

date_scraped description info_url date_received council_reference address comment_url on_notice_from
2012-08-24
Construction of Dwelling
2012-07-06
PL01/0776.01
56 Murphy St Richmond VIC 3121
2012-08-24
Liquor Licence for Existing Café
2012-07-30
PL02/0313.01
359-361 Napier St Fitzroy VIC 3065
2012-08-24
Section 72 amendment to Planning Permit PL02/0675, amending the permit and plans to increase patron numbers associated with the existing cafe/bar/tavern from 60 to 120, including an associated reduction in the car parking requirements
2012-06-14
PL02/0675.02
284 Smith St Collingwood VIC 3066
2012-08-24
An ancillary convenience restaurant to the existing retail premise and the reduction of 1 car space
2012-06-28
PL02/0706.01
380 Hoddle St Clifton Hill VIC 3068
2012-08-24
An ancillary convenience restaurant to the existing retail premise and the reduction of 1 car space
2012-06-28
PL02/0706.02
380 Hoddle St Clifton Hill VIC 3068
2012-08-24
To demolish the existing building and redevelop land for the construction of a building up to seven stories, plus two basement levels (comprising 35 apartments and 43 associated car parking spaces) and use the land at ground floor for the purpose of a lic
2002-11-19
PL02/1149
69-73 Victoria St Fitzroy VIC 3065
2003-03-24
2012-08-24
To erect an internally illuminated business identification advertising signage
2012-08-14
PL03/0101.01
185 Swan St Richmond VIC 3121
2012-08-24
S72 Amendment to plans for the construction of buildings and works including partial demolition for an extension to the existing storage facility and proposed caretakers residence associated with the storage facility.
2012-03-16
PL03/0170.01
200-220 Alexandra Pde Fitzroy VIC 3065
2012-08-24
Amendment to condition 6 of PL03/0224 to increase the operating hours to include Sunday 9am to 5pm.
2008-06-17
PL03/0224.01
54 Rose St Fitzroy VIC 3065
2008-08-13
2012-08-24
Multi Unit Residential Development - alterations to existing dwelling and proposal of two additional dwellings
2003-06-06
PL03/0543
184 Coppin St Richmond VIC 3121

Statistics

Average successful run time: 3 minutes

Total run time: 7 days

Total cpu time used: about 2 hours

Total disk space used: 7.9 MB

History

  • Auto ran revision f51bfd65 and failed .
    nothing changed in the database
  • Auto ran revision f51bfd65 and failed .
    nothing changed in the database
  • Auto ran revision f51bfd65 and failed .
    nothing changed in the database
  • Auto ran revision f51bfd65 and failed .
    nothing changed in the database
  • Auto ran revision f51bfd65 and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

yarra / scraper.rb