planningalerts-scrapers / logan

README.md

Logan City council now has a custom site that uses an API. So, we're using that.

Contributors mlandauer LoveMyData henare benrfairless

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Getting application submitted between 2025-12-01 and 2025-12-31... /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.6/lib/mechanize/http/agent.rb:329:in `fetch': 404 => Net::HTTPNotFound for https://devet-proxy.loganhub.com.au/devetapi/applications?lodgeDateFrom=2025-12-01&lodgeDateTo=2025-12-31&pageOffset=1&pageLimit=10&sortColumn=appNo&sortDesc=0 -- unhandled response (Mechanize::ResponseCodeError) from /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.6/lib/mechanize.rb:464:in `get' from scraper.rb:19:in `get_page' from scraper.rb:56:in `<main>'

Data

Downloaded 97012 times by slav123 dcalde mlandauer openaustralia jesse-a-reilly krynens repose-lecture Jizzundheit tkrikke SebMartinus yourneighbourhood planometric-vic spatialsteve muzzie86 ianheggie-oaf

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (23.6 MB) Use the API

rows 10 / 81759

council_reference address description info_url date_scraped date_received lat lng
BW/4335/2020
4 Worsley Lane PARK RIDGE 4125, QLD
Residential dwelling and garage
https://devet.loganhub.com.au/#/applications/BW-4335-2020
2020-07-29
2020-06-29
-27.718037
153.08813
BW/4337/2020
2 Worsley Lane PARK RIDGE 4125, QLD
Residential dwelling and garage
https://devet.loganhub.com.au/#/applications/BW-4337-2020
2020-07-29
2020-06-29
-27.717979
153.08802
BW/4338/2020
7 Flannery Terrace PARK RIDGE 4125, QLD
Residential dwelling and garage
https://devet.loganhub.com.au/#/applications/BW-4338-2020
2020-07-29
2020-06-29
-27.71861
153.08767
BW/4340/2020
9 Flannery Terrace PARK RIDGE 4125, QLD
Residential dwelling and garage
https://devet.loganhub.com.au/#/applications/BW-4340-2020
2020-07-29
2020-06-29
-27.71861
153.0875
BW/4341/2020
11 Flannery Terrace PARK RIDGE 4125, QLD
Residential dwelling and garage
https://devet.loganhub.com.au/#/applications/BW-4341-2020
2020-07-29
2020-06-29
-27.71861
153.08739
BW/4342/2020
13 Flannery Terrace PARK RIDGE 4125, QLD
Residential dwelling and garage
https://devet.loganhub.com.au/#/applications/BW-4342-2020
2020-07-29
2020-06-29
-27.71861
153.08727
BW/4343/2020
15 Flannery Terrace PARK RIDGE 4125, QLD
Residential dwelling and garage
https://devet.loganhub.com.au/#/applications/BW-4343-2020
2020-07-29
2020-06-29
-27.718552
153.08716
BW/4344/2020
20 Flannery Terrace PARK RIDGE 4125, QLD
Residential dwelling and garage
https://devet.loganhub.com.au/#/applications/BW-4344-2020
2020-07-29
2020-06-29
-27.718953
153.0871
BW/4345/2020
16 Flannery Terrace PARK RIDGE 4125, QLD
Residential dwelling and garage
https://devet.loganhub.com.au/#/applications/BW-4345-2020
2020-07-29
2020-06-29
-27.719011
153.08744
BW/4347/2020
14 Flannery Terrace PARK RIDGE 4125, QLD
Residential dwelling and garage
https://devet.loganhub.com.au/#/applications/BW-4347-2020
2020-07-29
2020-06-29
-27.719011
153.08756

Statistics

Average successful run time: 10 minutes

Total run time: 13 days

Total cpu time used: about 1 hour

Total disk space used: 24 MB

History

  • Auto ran revision 966e3057 and failed .
    nothing changed in the database
  • Auto ran revision 966e3057 and failed .
    nothing changed in the database
  • Auto ran revision 966e3057 and failed .
    nothing changed in the database
  • Auto ran revision 966e3057 and failed .
    nothing changed in the database
  • Auto ran revision 966e3057 and failed .
    nothing changed in the database
  • ...
  • Created on { hostname }

Show complete history

Scraper code

Ruby

logan / scraper.rb