jamezpolley / waverley

Waverley Council Development Applications

README.md

Waverley Council Scraper

  • Server - XC.Track
  • Cookie tracking - Yes
  • Pagnation - No
  • Javascript - No
  • Clearly defined data within a row - No but acceptable

Setup MORPH_PERIOD for data recovery, available options are

  • thisweek (default)
  • thismonth
  • lastmonth

Enjoy

Contributors LoveMyData equivalentideas jamezpolley mlandauer

Last run failed with status code 255.

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Installing bundler 1.17.3 [1G-----> Removing BUNDLED WITH version in the Gemfile.lock [1G-----> Compiling Ruby [1G Command: 'set -o pipefail; curl -L --fail --retry 5 --retry-delay 1 --connect-timeout 30 --max-time 180 https://s3-external-1.amazonaws.com/heroku-buildpack-ruby/heroku-18/ruby-2.0.0.tgz -s -o - | tar zxf - ' failed on attempt 1 of 3. [1G Command: 'set -o pipefail; curl -L --fail --retry 5 --retry-delay 1 --connect-timeout 30 --max-time 180 https://s3-external-1.amazonaws.com/heroku-buildpack-ruby/heroku-18/ruby-2.0.0.tgz -s -o - | tar zxf - ' failed on attempt 2 of 3. [1G [1m[31m [1G ! [1G ! The Ruby version you are trying to install does not exist: ruby-2.0.0 [1G ! [1G ! Heroku recommends you use the latest supported Ruby version listed here: [1G ! https://devcenter.heroku.com/articles/ruby-support#supported-runtimes [1G ! [1G ! For more information on syntax for declaring a Ruby version see: [1G ! https://devcenter.heroku.com/articles/ruby-versions [1G ![0m

Data

Downloaded 2 times by edwardblackshaw dcalde

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (6 KB) Use the API

rows 6 / 6

council_reference address description info_url comment_url date_scraped date_received
DA-226/2018
75 St Thomas Street BRONTE NSW 2024
Alterations and additions to basement, ground and first floor.
http://eservices.waverley.nsw.gov.au/Pages/XC.Track/SearchApplication.aspx?id=341507
mailto:waver@waverley.nsw.gov.au?subject=DA-226/2018
2018-06-26
2018-06-25
DA-227/2018
7 Ebley Street BONDI JUNCTION NSW 2022
Change of use for beauty salon to indoor recreation (martial arts school). No building works or demolition.
http://eservices.waverley.nsw.gov.au/Pages/XC.Track/SearchApplication.aspx?id=341527
mailto:waver@waverley.nsw.gov.au?subject=DA-227/2018
2018-06-26
2018-06-25
DA-228/2018
183 Bondi Road BONDI NSW 2026
Change of use of first floor from residential to commercial (Thai Massage)
http://eservices.waverley.nsw.gov.au/Pages/XC.Track/SearchApplication.aspx?id=341529
mailto:waver@waverley.nsw.gov.au?subject=DA-228/2018
2018-06-26
2018-06-25
DA-101/2017/A
20 Llandaff Street BONDI JUNCTION NSW 2022
Modify condition relating to VPA.
http://eservices.waverley.nsw.gov.au/Pages/XC.Track/SearchApplication.aspx?id=341553
mailto:waver@waverley.nsw.gov.au?subject=DA-101/2017/A
2018-06-26
2018-06-26
DA-229/2018
Westfield Shopping Centre 512-548 Oxford Street BONDI JUNCTION NSW 2022
Use of terrace to shop 5050 and balustrade extension.
http://eservices.waverley.nsw.gov.au/Pages/XC.Track/SearchApplication.aspx?id=341552
mailto:waver@waverley.nsw.gov.au?subject=DA-229/2018
2018-06-26
2018-06-26
DA-230/2018
7/99 Hewlett Street BRONTE NSW 2024
Internal alterations to a sole occupancy unit within a heritage item.
http://eservices.waverley.nsw.gov.au/Pages/XC.Track/SearchApplication.aspx?id=341578
mailto:waver@waverley.nsw.gov.au?subject=DA-230/2018
2018-06-26
2018-06-26

Statistics

Average successful run time: less than 20 seconds

Total run time: about 4 hours

Total cpu time used: less than 5 seconds

Total disk space used: 39.3 KB

History

  • Auto ran revision ca90e34b and failed .
    nothing changed in the database
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

waverley / scraper.rb