planningalerts-scrapers / warrumbungle

Warrumbungle Development Applications

README.md

This is a scraper that runs on Morph. To get started see the documentation

Contributors CloCkWeRX mlandauer

Last run failed with status code 255.

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.3.4 [1G-----> Installing dependencies using bundler 1.15.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G The git source `git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git` uses the `git` protocol, which transmits data without encryption. Disable this warning with `bundle config git.allow_insecure true`, or switch to the `https` protocol to keep your data secure. [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G Fetching gem metadata from https://rubygems.org/.......... [1G Fetching version metadata from https://rubygems.org/. [1G Fetching git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git [1G fatal: unable to connect to github.com: [1G github.com[0: 192.30.255.112]: errno=Connection timed out [1G Retrying `git clone 'git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git' "/tmp/build/vendor/bundle/ruby/2.3.0/cache/bundler/git/atdisplanningalertsfeed-4458ffceb6ec7fc575e42a19a1f0070f2c7d9bce" --bare --no-hardlinks --quiet` due to error (2/4): Bundler::Source::Git::GitCommandError Git error: command `git clone 'git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git' "/tmp/build/vendor/bundle/ruby/2.3.0/cache/bundler/git/atdisplanningalertsfeed-4458ffceb6ec7fc575e42a19a1f0070f2c7d9bce" --bare --no-hardlinks --quiet` in directory /tmp/build has failed.fatal: unable to connect to github.com: [1G github.com[0: 192.30.255.112]: errno=Connection timed out [1G Retrying `git clone 'git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git' "/tmp/build/vendor/bundle/ruby/2.3.0/cache/bundler/git/atdisplanningalertsfeed-4458ffceb6ec7fc575e42a19a1f0070f2c7d9bce" --bare --no-hardlinks --quiet` due to error (3/4): Bundler::Source::Git::GitCommandError Git error: command `git clone 'git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git' "/tmp/build/vendor/bundle/ruby/2.3.0/cache/bundler/git/atdisplanningalertsfeed-4458ffceb6ec7fc575e42a19a1f0070f2c7d9bce" --bare --no-hardlinks --quiet` in directory /tmp/build has failed.fatal: unable to connect to github.com: [1G github.com[0: 192.30.255.113]: errno=Connection timed out [1G Retrying `git clone 'git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git' "/tmp/build/vendor/bundle/ruby/2.3.0/cache/bundler/git/atdisplanningalertsfeed-4458ffceb6ec7fc575e42a19a1f0070f2c7d9bce" --bare --no-hardlinks --quiet` due to error (4/4): Bundler::Source::Git::GitCommandError Git error: command `git clone 'git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git' "/tmp/build/vendor/bundle/ruby/2.3.0/cache/bundler/git/atdisplanningalertsfeed-4458ffceb6ec7fc575e42a19a1f0070f2c7d9bce" --bare --no-hardlinks --quiet` in directory /tmp/build has failed.fatal: unable to connect to github.com: [1G github.com[0: 192.30.255.112]: errno=Connection timed out [1G Git error: command `git clone [1G 'git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git' [1G "/tmp/build/vendor/bundle/ruby/2.3.0/cache/bundler/git/atdisplanningalertsfeed-4458ffceb6ec7fc575e42a19a1f0070f2c7d9bce" [1G--bare --no-hardlinks --quiet` in directory /tmp/build has failed. [1G Bundler Output: The git source `git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git` uses the `git` protocol, which transmits data without encryption. Disable this warning with `bundle config git.allow_insecure true`, or switch to the `https` protocol to keep your data secure. [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G Fetching gem metadata from https://rubygems.org/.......... [1G Fetching version metadata from https://rubygems.org/. [1G Fetching git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git [1G fatal: unable to connect to github.com: [1G github.com[0: 192.30.255.112]: errno=Connection timed out [1G [1G [1G Retrying `git clone 'git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git' "/tmp/build/vendor/bundle/ruby/2.3.0/cache/bundler/git/atdisplanningalertsfeed-4458ffceb6ec7fc575e42a19a1f0070f2c7d9bce" --bare --no-hardlinks --quiet` due to error (2/4): Bundler::Source::Git::GitCommandError Git error: command `git clone 'git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git' "/tmp/build/vendor/bundle/ruby/2.3.0/cache/bundler/git/atdisplanningalertsfeed-4458ffceb6ec7fc575e42a19a1f0070f2c7d9bce" --bare --no-hardlinks --quiet` in directory /tmp/build has failed.fatal: unable to connect to github.com: [1G github.com[0: 192.30.255.112]: errno=Connection timed out [1G [1G [1G Retrying `git clone 'git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git' "/tmp/build/vendor/bundle/ruby/2.3.0/cache/bundler/git/atdisplanningalertsfeed-4458ffceb6ec7fc575e42a19a1f0070f2c7d9bce" --bare --no-hardlinks --quiet` due to error (3/4): Bundler::Source::Git::GitCommandError Git error: command `git clone 'git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git' "/tmp/build/vendor/bundle/ruby/2.3.0/cache/bundler/git/atdisplanningalertsfeed-4458ffceb6ec7fc575e42a19a1f0070f2c7d9bce" --bare --no-hardlinks --quiet` in directory /tmp/build has failed.fatal: unable to connect to github.com: [1G github.com[0: 192.30.255.113]: errno=Connection timed out [1G [1G [1G Retrying `git clone 'git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git' "/tmp/build/vendor/bundle/ruby/2.3.0/cache/bundler/git/atdisplanningalertsfeed-4458ffceb6ec7fc575e42a19a1f0070f2c7d9bce" --bare --no-hardlinks --quiet` due to error (4/4): Bundler::Source::Git::GitCommandError Git error: command `git clone 'git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git' "/tmp/build/vendor/bundle/ruby/2.3.0/cache/bundler/git/atdisplanningalertsfeed-4458ffceb6ec7fc575e42a19a1f0070f2c7d9bce" --bare --no-hardlinks --quiet` in directory /tmp/build has failed.fatal: unable to connect to github.com: [1G github.com[0: 192.30.255.112]: errno=Connection timed out [1G [1G [1G Git error: command `git clone [1G 'git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git' [1G "/tmp/build/vendor/bundle/ruby/2.3.0/cache/bundler/git/atdisplanningalertsfeed-4458ffceb6ec7fc575e42a19a1f0070f2c7d9bce" [1G--bare --no-hardlinks --quiet` in directory /tmp/build has failed. [1G ! [1G ! Failed to install gems via Bundler. [1G !

Data

Downloaded 3606 times by openaustralia LoveMyData dcalde DevAppProject jesse-a-reilly mlandauer WilliamYun TheZepto MikeRalphson muzzie86 repose-lecture Jedwards157

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (111 KB) Use the API

rows 10 / 190

council_reference address description info_url comment_url date_scraped date_received on_notice_from on_notice_to
010.2016.00000011.001
47 Cassilis Street, COONABARABRAN, NSW 2357
New Solar Panels
https://mycouncil.warrumbungle.nsw.gov.au:6443/Horizon/logonGuest.aw?e=FxkUAB1eSSgbAR0MXx0SGBFSVh0yBwc3GV0eFxcFSUMAIQYHJARfEBMKEiNZACg9HR0CHCUfHBY1QAQsHRAVAlkcGFUPEUcrNBURWDdAAxoQAhVEHS8aNxUCUVUSGBUrWRB9REJEWAJDR09PRABEcERDRUceQ0ZITRpVAx8AEhY%3D
2016-03-21
2016-03-01
010.2016.00000014.001
56 Digilah Street, DUNEDOO, NSW 2844
New Garages/Sheds - Residential
https://mycouncil.warrumbungle.nsw.gov.au:6443/Horizon/logonGuest.aw?e=FxkUAB1eSSgbAR0MXx0SGBFSVh0yBwc3GV0eFxcFSUMAIQYHJARfEBMKEiNZACg9HR0CHCUfHBY1QAQsHRAVAlkcGFUPEUcrNBURWDdAAxoQAhVEHS8aNxUCUVUSGBUrWRB9REJEWAJDR09PRABEcERDRUIeQ0ZITRpVAx8AEhY%3D
2016-03-21
2016-03-08
010.2016.00000012.001
269 Timor Road, COONABARABRAN, NSW 2357
New Garages/Sheds - Residential
https://mycouncil.warrumbungle.nsw.gov.au:6443/Horizon/logonGuest.aw?e=FxkUAB1eSSgbAR0MXx0SGBFSVh0yBwc3GV0eFxcFSUMAIQYHJARfEBMKEiNZACg9HR0CHCUfHBY1QAQsHRAVAlkcGFUPEUcrNBURWDdAAxoQAhVEHS8aNxUCUVUSGBUrWRB9REJEWAJDR09PRABEcERDRUQeQ0ZITRpVAx8AEhY%3D
2016-03-21
2016-03-01
010.2016.00000015.001
* Golden Highway, DUNEDOO, NSW 2844
New Single Storey Dwelling
https://mycouncil.warrumbungle.nsw.gov.au:6443/Horizon/logonGuest.aw?e=FxkUAB1eSSgbAR0MXx0SGBFSVh0yBwc3GV0eFxcFSUMAIQYHJARfEBMKEiNZACg9HR0CHCUfHBY1QAQsHRAVAlkcGFUPEUcrNBURWDdAAxoQAhVEHS8aNxUCUVUSGBUrWRB9REJEWAJDR09PRABEcERDRUMeQ0ZITRpVAx8AEhY%3D
2016-03-21
2016-03-08
010.2016.00000013.001
11 Kirban Street, COONABARABRAN, NSW 2357
Alterations and Additions to Verandah/Deck - Residential
https://mycouncil.warrumbungle.nsw.gov.au:6443/Horizon/logonGuest.aw?e=FxkUAB1eSSgbAR0MXx0SGBFSVh0yBwc3GV0eFxcFSUMAIQYHJARfEBMKEiNZACg9HR0CHCUfHBY1QAQsHRAVAlkcGFUPEUcrNBURWDdAAxoQAhVEHS8aNxUCUVUSGBUrWRB9REJEWAJDR09PRABEcERDRUUeQ0ZITRpVAx8AEhY%3D
2016-03-21
2016-03-07
010.2016.00000016.001
38 Narren Street, BARADINE, NSW 2396
New Other
https://mycouncil.warrumbungle.nsw.gov.au:6443/Horizon/logonGuest.aw?e=FxkUAB1eSSgbAR0MXx0SGBFSVh0yBwc3GV0eFxcFSUMAIQYHJARfEBMKEiNZACg9HR0CHCUfHBY1QAQsHRAVAlkcGFUPEUcrNBURWDdAAxoQAhVEHS8aNxUCUVUSGBUrWRB9REJEWAJDR09PRABEcERDRUAeQ0ZITRpVAx8AEhY%3D
2016-03-21
2016-03-14
010.2016.00000017.001
37 John Street, COONABARABRAN, NSW 2357
New Awning - Commercial
https://mycouncil.warrumbungle.nsw.gov.au:6443/Horizon/logonGuest.aw?e=FxkUAB1eSSgbAR0MXx0SGBFSVh0yBwc3GV0eFxcFSUMAIQYHJARfEBMKEiNZACg9HR0CHCUfHBY1QAQsHRAVAlkcGFUPEUcrNBURWDdAAxoQAhVEHS8aNxUCUVUSGBUrWRB9REJEWAJDR09PRABEcERDRUEeQ0ZITRpVAx8AEhY%3D
2016-03-25
2016-03-24
010.2016.00000018.001
1 Martin Street, COOLAH, NSW 2843
New Garages/Sheds - Commercial
https://mycouncil.warrumbungle.nsw.gov.au:6443/Horizon/logonGuest.aw?e=FxkUAB1eSSgbAR0MXx0SGBFSVh0yBwc3GV0eFxcFSUMAIQYHJARfEBMKEiNZACg9HR0CHCUfHBY1QAQsHRAVAlkcGFUPEUcrNBURWDdAAxoQAhVEHS8aNxUCUVUSGBUrWRB9REJEWAJDR09PRABEcERDRU4eQ0ZITRpVAx8AEhY%3D
2016-03-31
2016-03-29
010.2016.00000019.001
1067 Box Ridge Road, BINNAWAY, NSW 2395
Single Storey Dwelling
https://mycouncil.warrumbungle.nsw.gov.au:6443/Horizon/logonGuest.aw?e=FxkUAB1eSSgbAR0MXx0SGBFSVh0yBwc3GV0eFxcFSUMAIQYHJARfEBMKEiNZACg9HR0CHCUfHBY1QAQsHRAVAlkcGFUPEUcrNBURWDdAAxoQAhVEHS8aNxUCUVUSGBUrWRB9REJEWAJDR09PRABEcERDRU8eQ0ZITRpVAx8AEhY%3D
2016-04-04
2016-04-04
010.2016.00000020.001
1 Martin Street, COOLAH, NSW 2843
New Storage Sheds
https://mycouncil.warrumbungle.nsw.gov.au:6443/Horizon/logonGuest.aw?e=FxkUAB1eSSgbAR0MXx0SGBFSVh0yBwc3GV0eFxcFSUMAIQYHJARfEBMKEiNZACg9HR0CHCUfHBY1QAQsHRAVAlkcGFUPEUcrNBURWDdAAxoQAhVEHS8aNxUCUVUSGBUrWRB9REJEWAJDR09PRABEcERDRkYeQ0ZITRpVAx8AEhY%3D
2016-04-05
2016-03-29

Statistics

Average successful run time: less than a minute

Total run time: 2 days

Total cpu time used: 35 minutes

Total disk space used: 138 KB

History

  • Manually ran revision 020c9dab and failed .
    nothing changed in the database
  • Manually ran revision 020c9dab and failed .
    nothing changed in the database
  • Auto ran revision 020c9dab and failed .
    nothing changed in the database
  • Auto ran revision 020c9dab and failed .
    nothing changed in the database
  • Auto ran revision 020c9dab and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

warrumbungle / scraper.rb