planningalerts-scrapers / perth

Perth Development Applications

Contributors

Last run failed about 19 hours ago with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize/http/agent.rb:304:in `fetch': 403 => Net::HTTPForbidden for https://www.perth.wa.gov.au/planning-development/planning-and-building-tools/building-and-development-applications-received -- unhandled response (Mechanize::ResponseCodeError) from /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize/http/agent.rb:949:in `response_redirect' from /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize/http/agent.rb:299:in `fetch' from /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize.rb:407:in `get' from scraper.rb:129:in `<main>'

Data

Downloaded 7013 times by

data

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.87 MB) Use the API

rows 10 / 3617

date_scraped	description	info_url	date_received	council_reference	address	comment_url
date_scraped 2012-08-30	description Additional conservation works - St Brigid's Church	info_url http://www.cityofperth.wa.gov.au/web/Business/Building-and-Development-Applications-Received/	date_received 2012-08-22	council_reference 2012/2210	address 69 Fitzgerald Street NORTHBRIDGE WA 6003	comment_url http://www.cityofperth.wa.gov.au/web/Business/Building-and-Development-Applications-Received/
date_scraped 2012-08-30	description LED Illuminated Sign - "Power Tech"	info_url http://www.cityofperth.wa.gov.au/web/Business/Building-and-Development-Applications-Received/	date_received 2012-08-22	council_reference 2012/6541	address 507 Murray Street PERTH WA 6000	comment_url http://www.cityofperth.wa.gov.au/web/Business/Building-and-Development-Applications-Received/
date_scraped 2012-08-30	description Change of Use from Office to Education	info_url http://www.cityofperth.wa.gov.au/web/Business/Building-and-Development-Applications-Received/	date_received 2012-08-23	council_reference 2012/2213	address 2A Aberdeen Street PERTH WA 6000	comment_url http://www.cityofperth.wa.gov.au/web/Business/Building-and-Development-Applications-Received/
date_scraped 2012-08-30	description Office Fitout - Level 1	info_url http://www.cityofperth.wa.gov.au/web/Business/Building-and-Development-Applications-Received/	date_received 2012-08-23	council_reference 2012/258	address 2-4 Kings Park Road WEST PERTH WA 6005	comment_url http://www.cityofperth.wa.gov.au/web/Business/Building-and-Development-Applications-Received/
date_scraped 2012-08-30	description Section 39 - "The Vessel Moonlight Express" Pier 6	info_url http://www.cityofperth.wa.gov.au/web/Business/Building-and-Development-Applications-Received/	date_received 2012-08-23	council_reference 2012/9589	address "BARRACK SQUARE" Barrack Square PERTH WA 6000	comment_url http://www.cityofperth.wa.gov.au/web/Business/Building-and-Development-Applications-Received/
date_scraped 2012-08-30	description Temporary ETP - "Connections"	info_url http://www.cityofperth.wa.gov.au/web/Business/Building-and-Development-Applications-Received/	date_received 2012-08-23	council_reference 2012/9817	address 81 James Street NORTHBRIDGE WA 6003	comment_url http://www.cityofperth.wa.gov.au/web/Business/Building-and-Development-Applications-Received/
date_scraped 2012-08-30	description Fitout - Pajeco TW18	info_url http://www.cityofperth.wa.gov.au/web/Business/Building-and-Development-Applications-Received/	date_received 2012-08-23	council_reference 2012/9818	address "RAINE SQUARE" 300 Murray Street PERTH WA 6000	comment_url http://www.cityofperth.wa.gov.au/web/Business/Building-and-Development-Applications-Received/
date_scraped 2012-08-30	description Fitout in Food Court - "Burger Edge"	info_url http://www.cityofperth.wa.gov.au/web/Business/Building-and-Development-Applications-Received/	date_received 2012-08-23	council_reference 2012/9819	address "RAINE SQUARE" 300 Murray Street PERTH WA 6000	comment_url http://www.cityofperth.wa.gov.au/web/Business/Building-and-Development-Applications-Received/
date_scraped 2012-08-30	description Unauthorised Works - Level 7	info_url http://www.cityofperth.wa.gov.au/web/Business/Building-and-Development-Applications-Received/	date_received 2012-08-24	council_reference 2012/1310	address "AMP BUILDING" 140 St Georges Terrace PERTH WA 6000	comment_url http://www.cityofperth.wa.gov.au/web/Business/Building-and-Development-Applications-Received/
date_scraped 2012-08-30	description Cafe Fitout - "Tartine Cafe"	info_url http://www.cityofperth.wa.gov.au/web/Business/Building-and-Development-Applications-Received/	date_received 2012-08-24	council_reference 2012/259	address "140William" 140 William Street PERTH WA 6000	comment_url http://www.cityofperth.wa.gov.au/web/Business/Building-and-Development-Applications-Received/

Statistics

Average successful run time: 1 minute

Total run time: 14 days

Total cpu time used: about 1 hour

Total disk space used: 1.9 MB

History

Auto ran revision 4a93e598 and failed about 19 hours ago.

run time 2 s

nothing changed in the database
Auto ran revision 4a93e598 and failed about 21 hours ago.

run time 3 s

nothing changed in the database
Auto ran revision 4a93e598 and failed 2 days ago.

run time 3 s

nothing changed in the database
Auto ran revision 4a93e598 and failed 3 days ago.

run time 2 s

nothing changed in the database
Auto ran revision 4a93e598 and failed 4 days ago.

run time 2 s

nothing changed in the database
...
Created on morph.io 11 years ago

Show complete history

Scraper code

Ruby

perth / scraper.rb

git clone URL