StashProperty / coffs-harbour

Scrapes multiple authorities that have an icon system


This is a scraper that runs on Morph. To get started see the documentation

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

To run the scraper

bundle exec ruby scraper.rb

To run the tests

bundle exec rake

To run style and coding checks

bundle exec rubocop

Contributors mlandauer AndreM101

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Scraping authorities: strathfield, mackay, georges_river, kyogle, greater_hume, richmond_valley, whitsunday, cumberland, coffs_harbour, blue_mountains, swan, gosnells, hobart, hornsby, leichhardt, mosman, north_sydney, penrith, randwick, redland, bayside, scenic_rim, waverley, willoughby, canada_bay, tweed, boroondara Collecting feed data for strathfield... Collecting feed data for mackay... strathfield: ERROR: Failed to open TCP connection to daenquiry.strathfield.nsw.gov.au:80 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Storing DA-2013-434/F - Bluewater The Beach 4 Petrie Street EAST MACKAY QLD 4740 Storing DA-2010-185/C - 109 Leichhardt Road MIRANI QLD 4754 Storing EC-2026-79 - 9 Bellavista Circuit BEACONSFIELD QLD 4740 Storing EC-2026-78 - 55 William Street SOUTH MACKAY QLD 4740 Storing EC-2026-77 - 64 Grendon Street NORTH MACKAY QLD 4740 Storing EC-2026-76 - 5 Coyne Street SOUTH MACKAY QLD 4740 Storing EC-2026-75 - 7 Pindo Circuit RURAL VIEW QLD 4740 Storing EC-2026-74 - 4 Nott Street EAST MACKAY QLD 4740 Storing EC-2026-73 - 26 Devereux Street RURAL VIEW QLD 4740 Storing EC-2026-72 - 19 Buoro Street BALL BAY QLD 4741 Storing EC-2026-71 - 12 Almora Drive BEACONSFIELD QLD 4740 Storing DA-2026-178 - L 908 Wallmans Road RURAL VIEW QLD 4740 Storing DA-2026-177 - 229 Quattromanis Road ETON QLD 4741 Storing DA-2026-170 - 1431 Sarina Homebush Road SUNNYSIDE QLD 4737 Storing DA-2026-175 - 258 Farleigh-Dumbleton Road DUMBLETON QLD 4740 Storing DA-2026-174 - L 908 Wallmans Road RURAL VIEW QLD 4740 Storing DA-2026-165 - L 908 Wallmans Road RURAL VIEW QLD 4740 Storing DA-2026-155 - 123 Commander Parade BUCASIA QLD 4750 Storing DA-2026-154 - 117 Commander Parade BUCASIA QLD 4750 Storing DA-2015-152/C - 4 Hoey Street SARINA QLD 4737 Storing DA-2015-152/B - 4 Hoey Street SARINA QLD 4737 Storing DA-2026-169 - 85 Kellys Road WALKERSTON QLD 4751 Storing DA-2026-168 - 321 Geeberga Buthurra Road KUTTABUL QLD 4741 Storing DA-2026-163 - 46 Elvins Road ETON QLD 4741 Storing DA-2026-166 - 29 Grimas Road PALMYRA QLD 4751 Storing DA-2026-161 - L 62 Balnagowan Mandarana Road THE LEAP QLD 4740 Storing DA-2026-164 - 46 Elvins Road ETON QLD 4741 Storing DA-2021-101/C - 121 Rosewood Drive RURAL VIEW QLD 4740 Storing DA-2026-159 - 30 Longman Place ERAKALA QLD 4740 Storing DA-2026-162 - 5 Coyne Street SOUTH MACKAY QLD 4740 Storing DA-2026-157 - 30 Bassett Street NORTH MACKAY QLD 4740 Storing DA-2026-171 - L 805 Farmhouse Crescent BEACONSFIELD QLD 4740 Storing OW-2024-8/B - L 1 Milton Street SOUTH MACKAY QLD 4740 Storing OW-2020-57/A - L 3 McEwens Beach Road MCEWENS BEACH QLD 4740 Storing OW-2026-46 - 122-126 Kellys Road WALKERSTON QLD 4751 Storing OW-2025-44 - 7 Connolly Street SARINA QLD 4737 Storing OW-2026-39 - 99 McColl Street WALKERSTON QLD 4751 Storing OW-2024-63/A - 189 Shoal Point Road SHOAL POINT QLD 4750 Storing OW-2024-38/D - 40-42 Caterpillar Drive PAGET QLD 4740 Storing OW-2025-52/A - L 930 Landsborough Drive RURAL VIEW QLD 4740 Storing OW-2025-16/A - L 900 Mirani-Eton Road MIRANI QLD 4754 Storing OW-2025-39/A - L 930 Landsborough Drive RURAL VIEW QLD 4740 Storing OW-2026-41 - L 702 Cutler Drive ANDERGROVE QLD 4740 Storing DA-2021-193/B - 115-155 Maggiolo Drive PAGET QLD 4740 Storing DA-2026-176 - 87 Andergrove Road ANDERGROVE QLD 4740 Storing DA-2026-173 - 4 Kilkenny Court EIMEO QLD 4740 Storing DA-2026-172 - 12 Caroline Street MIRANI QLD 4754 Storing DA-2017-64/B - L 11 Hudsons Road KUTTABUL QLD 4741 Storing DA-2026-167 - L 608 Shoal Point Road SHOAL POINT QLD 4750 Storing DA-2026-158 - 7 Matsen Street BAKERS CREEK QLD 4740 Storing DA-2026-147 - L 6 Newmans Road DEVEREUX CREEK QLD 4754 Storing DA-2010-199/B - L 7 Shoal Point Road SHOAL POINT QLD 4750 Storing DA-2026-160 - 26 McIntyre Street CALEN QLD 4798 Storing DA-2025-2/B - L 908 Wallmans Road RURAL VIEW QLD 4740 Storing DA-2026-151 - 119 Christensens Road BALBERRA QLD 4740 Storing DA-2018-82/A - 26 Andergrove Road ANDERGROVE QLD 4740 Storing DA-2018-81/A - 26 Andergrove Road ANDERGROVE QLD 4740 Collecting feed data for georges_river... Collecting feed data for kyogle... georges_river: ERROR: SSL_connect returned=1 errno=0 state=SSLv3 read server certificate B: certificate verify failed (self signed certificate in certificate chain) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `connect_nonblock' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `ssl_socket_connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:981:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for greater_hume... kyogle: ERROR: Failed to open TCP connection to etrack.kyogle.nsw.gov.au:443 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for richmond_valley... greater_hume: ERROR: Failed to open TCP connection to datracker.greaterhume.nsw.gov.au:80 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for whitsunday... richmond_valley: ERROR: Failed to open TCP connection to datracker.richmondvalley.nsw.gov.au:80 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for cumberland... whitsunday: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for coffs_harbour... cumberland: ERROR: 403 => Net::HTTPForbidden for https://cumberland-eplanning.t1cloud.com/Pages/XC.Track/SearchApplication.aspx -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' coffs_harbour: ERROR: 403 => Net::HTTPForbidden for https://chcc-icon.saas.t1cloud.com/public/Pages/xc.Track/SearchApplication.aspx -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' Collecting feed data for blue_mountains... scraper.rb:31:in `<main>' Collecting feed data for swan... blue_mountains: ERROR: SSL_connect returned=1 errno=0 state=SSLv3 read server certificate B: certificate verify failed (unable to get local issuer certificate) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `connect_nonblock' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `ssl_socket_connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:981:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for gosnells... swan: ERROR: Failed to open TCP connection to elodge.swan.wa.gov.au:443 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for hobart... gosnells: ERROR: 504 => Net::HTTPGatewayTimeOut for https://apps.gosnells.wa.gov.au/ICON/Pages/XC.Track/SearchApplication.aspx -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:998:in `response_redirect' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:321:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for hornsby... hobart: ERROR: SSL_connect returned=1 errno=0 state=SSLv3 read server certificate B: certificate verify failed (certificate has expired) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `connect_nonblock' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `ssl_socket_connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:981:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for leichhardt... hornsby: ERROR: 502 => Net::HTTPBadGateway for https://hscenquiry.hornsby.nsw.gov.au/Pages/XC.Track/SearchApplication.aspx -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:998:in `response_redirect' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:321:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for mosman... leichhardt: ERROR: Failed to open TCP connection to www.eservices.lmc.nsw.gov.au:80 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' mosman: ERROR: Failed to open TCP connection to portal.mosman.nsw.gov.au:80 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' Collecting feed data for north_sydney... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for penrith... north_sydney: ERROR: Failed to open TCP connection to apptracking.northsydney.nsw.gov.au:443 (getaddrinfo: No address associated with hostname) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for randwick... penrith: ERROR: 404 => Net::HTTPNotFound for http://bizsearch.penrithcity.nsw.gov.au/ePlanning/Pages/XC.Track/SearchApplication.aspx -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for redland... randwick: ERROR: Failed to open TCP connection to planning.randwick.nsw.gov.au:443 (getaddrinfo: No address associated with hostname) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for bayside... redland: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for scenic_rim... bayside: ERROR: 403 => Net::HTTPForbidden for https://eplanning.bayside.nsw.gov.au/ePlanning/Pages/XC.Track/SearchApplication.aspx -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' scenic_rim: ERROR: 403 => Net::HTTPForbidden for https://srr-prod-icon.saas.t1cloud.com/Pages/XC.Track/SearchApplication.aspx -- unhandled response Collecting feed data for waverley... /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for willoughby... waverley: ERROR: Failed to open TCP connection to eservices.waverley.nsw.gov.au:80 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for canada_bay... Collecting feed data for tweed... canada_bay: ERROR: Failed to open TCP connection to datracking.canadabay.nsw.gov.au:80 (getaddrinfo: No address associated with hostname) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Storing DA26/0479 - 3 Heffron Street, TWEED HEADS SOUTH NSW 2486 Storing DA26/0481 - 8 McGregor Crescent, TWEED HEADS NSW 2485 Storing DA26/0482 - 4 Brighton Street, BANORA POINT NSW 2486 Storing DA26/0484 - 8 Limosa Road, TWEED HEADS WEST NSW 2485 Storing DA26/0485 - 41 Birkdale Court, BANORA POINT NSW 2486 Storing DA26/0486 - 14 Prichard Place, CUDGEN NSW 2487 Storing DA26/0474 - 17 Sandpiper Avenue, TWEED HEADS NSW 2485 Storing DA26/0480 - 73 Enmore Crescent, KINGS FOREST NSW 2487 Storing DA26/0488 - 29 Franklin Street, BANORA POINT NSW 2486 Storing DA26/0487 - 13 Laceflower Parade, CASUARINA NSW 2487 Storing DA26/0489 - 12 Lakes Drive, TWEED HEADS WEST NSW 2485 Storing DA25/0606.01 - 71 Tamarind Avenue, BOGANGAR NSW 2488 Storing DA26/0491 - 10 Spirabo Street, KINGS FOREST NSW 2487 Storing DA26/0492 - 20 Quayside Court, TWEED HEADS NSW 2485 Storing DA26/0493 - 9 Darro Road, TERRANORA NSW 2486 Storing DA26/0494 - 98 Nolans Road, STOKERS SIDING NSW 2484 Storing DA06/0399.07 - 28 Machinery Drive, TWEED HEADS SOUTH NSW 2486 Storing DA26/0490 - 7 Habitat Drive, CASUARINA NSW 2487 Storing DA26/0495 - 21 Brampton Crescent, BURRINGBAR NSW 2483 Storing DA26/0496 - 1 / 704 Casuarina Way, CASUARINA NSW 2487 Storing DA26/0498 - 7 Boorabee Street, KINGS FOREST NSW 2487 Storing DA26/0497 - 11 Jalibah Avenue, TWEED HEADS NSW 2485 Storing DA26/0499 - 50 Fingal Road, FINGAL HEAD NSW 2487 Storing DA26/0500 - 3 Bulla Court, TERRANORA NSW 2486 Storing DA26/0501 - 25 Oxford Street, KINGSCLIFF NSW 2487 Storing DA26/0502 - 9 Captains Way, BANORA POINT NSW 2486 Storing DA26/0503 - 814 Tyalgum Road, EUNGELLA NSW 2484 Storing DA26/0507 - 9 Midship Court, BANORA POINT NSW 2486 Storing DA25/0504.01 - 20 Jacaranda Avenue, TWEED HEADS WEST NSW 2485 Storing DA26/0504 - 39 Peisley Street, KINGS FOREST NSW 2487 Storing DA26/0505 - 6 Berida Street, KINGS FOREST NSW 2487 Storing DA26/0506 - 2 Highland Drive, TERRANORA NSW 2486 Storing DA26/0509 - 10 Attunga Street, KINGS FOREST NSW 2487 Storing DA26/0508 - 151 Clothiers Creek Road, NUNDERI NSW 2484 Storing CDC26/0081 - 5927 Tweed Valley Way, MOOBALL NSW 2483 Storing DA14/0582.04 - 1 Leisure Drive, BANORA POINT NSW 2486 Storing DA26/0510 - 18 Letitia Road, FINGAL HEAD NSW 2487 Storing DA26/0511 - 16 Franklin Street, BANORA POINT NSW 2486 Storing DA26/0513 - 282 Burringbar Road, BURRINGBAR NSW 2483 Storing DA26/0514 - 31 Lalina Avenue, TWEED HEADS WEST NSW 2485 Storing DA26/0515 - 11 Duranbah Road, DURANBAH NSW 2487 Storing DA26/0517 - 15 Macquarie Street, BANORA POINT NSW 2486 Storing S94/0070.14 - 51 / 2981 Kyogle Road, KUNGHUR NSW 2484 Storing DA26/0518 - 6 Acacia Street, TWEED HEADS SOUTH NSW 2486 Storing DA26/0519 - 8368 Tweed Valley Way, CONDONG NSW 2484 Storing DA26/0520 - 44 Main Road, FINGAL HEAD NSW 2487 Storing CDC26/0083 - 19 Tweed Coast Road, POTTSVILLE NSW 2489 Storing DA26/0198.01 - 25 Enmore Crescent, KINGS FOREST NSW 2487 Storing DA26/0516 - 7 Mistral Road, SOUTH MURWILLUMBAH NSW 2484 Storing DA26/0521 - 15 Kiata Parade, TWEED HEADS NSW 2485 Storing DA26/0522 - 45 Andrew Avenue, POTTSVILLE NSW 2489 Storing DA26/0523 - 1 A Creek Street, HASTINGS POINT NSW 2489 Storing DA26/0524 - 18 Tamarind Avenue, BOGANGAR NSW 2488 Storing DA26/0526 - 3 Breeza Street, KINGS FOREST NSW 2487 Storing DA26/0527 - 5 Julius Place, KINGSCLIFF NSW 2487 Storing CDC26/0084 - 5 Glen Ayr Drive, BANORA POINT NSW 2486 Storing CDC26/0085 - 49 Shamrock Avenue, BANORA POINT NSW 2486 Storing CDC26/0086 - 24 Pearl Street, KINGSCLIFF NSW 2487 Storing CDC26/0087 - 79 Mylestom Circle, POTTSVILLE NSW 2489 Storing CDC26/0089 - 19 Altitude Boulevard, TERRANORA NSW 2486 Storing CDC26/0090 - 7 Bulla Court, TERRANORA NSW 2486 Storing CDC26/0091 - 20 Eliza Fraser Court, TERRANORA NSW 2486 Storing DA26/0512 - 10 Megan Street, TWEED HEADS SOUTH NSW 2486 Storing DA26/0528 - 72 Bosun Boulevard, BANORA POINT NSW 2486 Storing DA26/0529 - 22 Myrtle Street, MURWILLUMBAH NSW 2484 Storing CDC26/0092 - Leisure Drive, BANORA POINT NSW 2486 Storing CDC26/0093 - 13 Thornbill Drive, SOUTH MURWILLUMBAH NSW 2484 Storing CDC26/0094 - 16 - 32 Wharf Street, TWEED HEADS NSW 2485 Storing CDC26/0095 - 4 Winchelsea Way, TERRANORA NSW 2486 Storing CDC26/0096 - 17 Bulla Court, TERRANORA NSW 2486 Storing CDC26/0097 - 75 Henry Lawson Drive, TERRANORA NSW 2486 Storing DA26/0525 - 13 Maple Avenue, BOGANGAR NSW 2488 Storing DA26/0530 - 16 Keith Compton Drive, TWEED HEADS NSW 2485 Storing DA26/0532 - 1 / 1 Eddy Avenue, KINGSCLIFF NSW 2487 Storing DA26/0534 - 4 Penrose Street, KINGS FOREST NSW 2487 Storing DA25/0146.01 - 66 Sailfish Way, KINGSCLIFF NSW 2487 Storing DA19/0565.02 - 11 Fig Tree Road, TERRANORA NSW 2486 Storing DA25/0627.01 - 9 Altitude Boulevard, TERRANORA NSW 2486 Storing DA26/0531 - 29 Torrington Street, KINGS FOREST NSW 2487 Storing DA26/0535 - 37 Tweed Valley Way, SOUTH MURWILLUMBAH NSW 2484 Storing DA26/0536 - 7 Bongaree Road, TERRANORA NSW 2486 Storing DA26/0537 - 44 Peisley Street, KINGS FOREST NSW 2487 Storing DA22/0543.01 - North Point Avenue, KINGSCLIFF NSW 2487 Collecting feed data for boroondara... *************************************************** Now retrying authorities which earlier had failures *************************************************** boroondara: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' Collecting feed data for strathfield... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' strathfield: ERROR: Failed to open TCP connection to daenquiry.strathfield.nsw.gov.au:80 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' Collecting feed data for georges_river... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for kyogle... georges_river: ERROR: SSL_connect returned=1 errno=0 state=SSLv3 read server certificate B: certificate verify failed (self signed certificate in certificate chain) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `connect_nonblock' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `ssl_socket_connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:981:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' kyogle: ERROR: Failed to open TCP connection to etrack.kyogle.nsw.gov.au:443 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' Collecting feed data for greater_hume... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' greater_hume: ERROR: Failed to open TCP connection to datracker.greaterhume.nsw.gov.au:80 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' Collecting feed data for richmond_valley... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for whitsunday... richmond_valley: ERROR: Failed to open TCP connection to datracker.richmondvalley.nsw.gov.au:80 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' whitsunday: ERROR: execution expired Collecting feed data for cumberland... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for coffs_harbour... cumberland: ERROR: 403 => Net::HTTPForbidden for https://cumberland-eplanning.t1cloud.com/Pages/XC.Track/SearchApplication.aspx -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' coffs_harbour: ERROR: 403 => Net::HTTPForbidden for https://chcc-icon.saas.t1cloud.com/public/Pages/xc.Track/SearchApplication.aspx -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' Collecting feed data for blue_mountains... scraper.rb:38:in `<main>' Collecting feed data for swan... blue_mountains: ERROR: SSL_connect returned=1 errno=0 state=SSLv3 read server certificate B: certificate verify failed (unable to get local issuer certificate) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `connect_nonblock' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `ssl_socket_connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:981:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for gosnells... swan: ERROR: Failed to open TCP connection to elodge.swan.wa.gov.au:443 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for hobart... gosnells: ERROR: 504 => Net::HTTPGatewayTimeOut for https://apps.gosnells.wa.gov.au/ICON/Pages/XC.Track/SearchApplication.aspx -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:998:in `response_redirect' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:321:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for hornsby... hobart: ERROR: SSL_connect returned=1 errno=0 state=SSLv3 read server certificate B: certificate verify failed (certificate has expired) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `connect_nonblock' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `ssl_socket_connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:981:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for leichhardt... hornsby: ERROR: 502 => Net::HTTPBadGateway for https://hscenquiry.hornsby.nsw.gov.au/Pages/XC.Track/SearchApplication.aspx -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:998:in `response_redirect' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:321:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for mosman... leichhardt: ERROR: Failed to open TCP connection to www.eservices.lmc.nsw.gov.au:80 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for north_sydney... mosman: ERROR: Failed to open TCP connection to portal.mosman.nsw.gov.au:80 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for penrith... north_sydney: ERROR: Failed to open TCP connection to apptracking.northsydney.nsw.gov.au:443 (getaddrinfo: No address associated with hostname) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for randwick... penrith: ERROR: 404 => Net::HTTPNotFound for http://bizsearch.penrithcity.nsw.gov.au/ePlanning/Pages/XC.Track/SearchApplication.aspx -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for redland... randwick: ERROR: Failed to open TCP connection to planning.randwick.nsw.gov.au:443 (getaddrinfo: No address associated with hostname) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for bayside... redland: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for scenic_rim... bayside: ERROR: 403 => Net::HTTPForbidden for https://eplanning.bayside.nsw.gov.au/ePlanning/Pages/XC.Track/SearchApplication.aspx -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for waverley... scenic_rim: ERROR: 403 => Net::HTTPForbidden for https://srr-prod-icon.saas.t1cloud.com/Pages/XC.Track/SearchApplication.aspx -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for canada_bay... waverley: ERROR: Failed to open TCP connection to eservices.waverley.nsw.gov.au:80 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for boroondara... canada_bay: ERROR: Failed to open TCP connection to datracking.canadabay.nsw.gov.au:80 (getaddrinfo: No address associated with hostname) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' boroondara: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' scraper.rb:42:in `<main>': There were errors with the following authorities: [:strathfield, :georges_river, :kyogle, :greater_hume, :richmond_valley, :whitsunday, :cumberland, :coffs_harbour, :blue_mountains, :swan, :gosnells, :hobart, :hornsby, :leichhardt, :mosman, :north_sydney, :penrith, :randwick, :redland, :bayside, :scenic_rim, :waverley, :canada_bay, :boroondara]. See earlier output for details (RuntimeError)

Data

Downloaded 206 times by dcalde tkrikke repose-lecture odnagroup

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (39.9 MB) Use the API

rows 10 / 99919

council_reference description date_received address date_scraped info_url authority_label
0139/21DM
S4.55 (2) - Modification - Changes to Consent Conditions
2021-04-01
1 OCEAN STREET WOOLGOOLGA NSW 2456
2021-04-15
coffs_harbour
0900/21DA
New Dwelling
2021-04-06
5 SHELLY CLOSE WOOLGOOLGA NSW 2456
2021-04-15
coffs_harbour
0902/21DA
PATIO
2021-04-06
82 RALEIGH STREET COFFS HARBOUR NSW 2450
2021-04-15
coffs_harbour
0142/21DM
Modificatin - Extend Carport
2021-04-07
7 DILLON STREET SAWTELL NSW 2452
2021-04-15
coffs_harbour
0906/21DA
Proposed two storey dwelling
2021-04-08
23 TREVALLY STREET KORORA NSW 2450
2021-04-15
coffs_harbour
0907/21DA
Proposed two storey dwelling
2021-04-08
25 TREVALLY STREET KORORA NSW 2450
2021-04-15
coffs_harbour
0908/21DA
Erection of an aircraft hangar - Proposed Lot 69
2021-04-08
AIRPORT DRIVE COFFS HARBOUR NSW 2450 AIRPORT DRIVE COFFS HARBOUR NSW 2450
2021-04-15
coffs_harbour
0909/21DA
Construction of 4 bedroom residential dwelling with attached garage.
2021-04-08
MIDDLE BOAMBEE ROAD BOAMBEE NSW 2450
2021-04-15
coffs_harbour
0910/21DA
Covered deck
2021-04-09
35 BAILEY AVENUE COFFS HARBOUR NSW 2450
2021-04-23
coffs_harbour
0912/21DA
Detached new studio addition
2021-04-09
5 REID DRIVE COFFS HARBOUR NSW 2450
2021-04-23
coffs_harbour

Statistics

Average successful run time: 5 minutes

Total run time: 9 days

Total cpu time used: about 2 hours

Total disk space used: 72 MB

History

  • Auto ran revision 6d62d6a4 and failed .
    140 records added, 138 records removed in the database
  • Auto ran revision 6d62d6a4 and failed .
    144 records added, 133 records removed in the database
  • Auto ran revision 6d62d6a4 and failed .
    73 records added, 69 records removed in the database
  • Auto ran revision 6d62d6a4 and failed .
    129 records added, 129 records removed in the database
  • Auto ran revision 6d62d6a4 and failed .
    69 records added, 64 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

coffs-harbour / scraper.rb