StashProperty / coffs-harbour

Scrapes multiple authorities that have an icon system


This is a scraper that runs on Morph. To get started see the documentation

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

To run the scraper

bundle exec ruby scraper.rb

To run the tests

bundle exec rake

To run style and coding checks

bundle exec rubocop

Contributors mlandauer AndreM101

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Scraping authorities: strathfield, mackay, georges_river, kyogle, greater_hume, richmond_valley, whitsunday, cumberland, coffs_harbour, blue_mountains, swan, gosnells, hobart, hornsby, leichhardt, mosman, north_sydney, penrith, randwick, redland, bayside, scenic_rim, waverley, willoughby, canada_bay, tweed, boroondara Collecting feed data for strathfield... Collecting feed data for mackay... strathfield: ERROR: Failed to open TCP connection to daenquiry.strathfield.nsw.gov.au:80 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' No address found for DA-2012-323/M. So, skipping Storing DA-2020-41/C - 7 Midge Point Road BLOOMSBURY QLD 4799 Storing DA-2025-225 - L 102 Logistics Drive BAKERS CREEK QLD 4740 Storing DA-2025-237 - 254 Broadsound Road OORALEA QLD 4740 Storing EC-2025-115 - 6 Bannister Street SOUTH MACKAY QLD 4740 Storing EC-2025-114 - 47 Palm Avenue SEAFORTH QLD 4741 Storing EC-2025-113 - 5 Michelle Crescent BUCASIA QLD 4750 Storing EC-2025-112 - 204-208 Victoria Street MACKAY QLD 4740 Storing EC-2025-111 - 7 Shiers Court RURAL VIEW QLD 4740 Storing EC-2025-110 - 94A Binnington Esplanade EAST MACKAY QLD 4740 Storing EC-2025-109 - 209 Goldsmith Street EAST MACKAY QLD 4740 Storing EC-2025-108 - 9 Reef Parade EAST MACKAY QLD 4740 Storing EC-2025-101 - 1 Walz Avenue MCEWENS BEACH QLD 4740 Storing DA-2025-241 - 284 Farrellys Road PAGET QLD 4740 Storing DA-2025-239 - 46 Mulherin Drive MACKAY HARBOUR QLD 4740 Storing DA-2025-238 - 484 Anzac Avenue MARIAN QLD 4753 Storing DA-2025-235 - 2/5 Bridge Road EAST MACKAY QLD 4740 Storing DA-2025-233 - 2 Coles Road ANDERGROVE QLD 4740 Storing DA-2025-62/A - 70 Mountney Road SARINA QLD 4737 Storing DA-2025-231 - 84 Dozer Drive PAGET QLD 4740 Storing DA-2023-17/C - 18 Drew Street FINCH HATTON QLD 4756 Storing DA-2023-54/A - 534 Kinchant Dam Road KINCHANT DAM QLD 4741 Storing DA-2025-227 - 88-92 Michelmore Street PAGET QLD 4740 Storing DA-2025-226 - 326 Bells Road PALMYRA QLD 4751 Storing DA-2025-41 - L 2 Lindeman Island LINDEMAN ISLAND QLD 4741 Storing DA-2015-66/B - 7 Brooks Road SARINA QLD 4737 Storing DA-2022-85/A - 47 Palm Avenue SEAFORTH QLD 4741 Storing DA-2014-240/A - 371 Connors Road BAKERS CREEK QLD 4740 Storing OW-2025-87 - 5 Sarah Street WEST MACKAY QLD 4740 Storing OW-2025-85 - 22 Chidlow Street FARLEIGH QLD 4741 Storing OW-2025-86 - L 719 East Point Drive MACKAY HARBOUR QLD 4740 Storing OW-2018-26/D - L 719 East Point Drive MACKAY HARBOUR QLD 4740 Storing OW-2025-82 - 6 Eimeo Esplanade EIMEO QLD 4740 Storing OW-2025-22/B - Magpies Sporting Club 2 Sweeney Court GLENELLA QLD 4740 Storing OW-2025-84 - 121 Rosewood Drive RURAL VIEW QLD 4740 Storing OW-2025-83 - L 912 Aviland Drive SEAFORTH QLD 4741 Storing PDA-2025-5 - 7 Victoria Street MACKAY QLD 4740 Storing DA-2025-240 - 3 Samantha Street SEAFORTH QLD 4741 Storing DA-2025-234 - L 14 Murrays Road GLENELLA QLD 4740 Storing DA-2025-229 - L 608 Shoal Point Road SHOAL POINT QLD 4750 Storing DA-2025-228 - 6428 Mackay-Eungella Road NETHERDALE QLD 4757 Storing DA-2025-230 - 29 Karwin Drive ANDERGROVE QLD 4740 No address found for DA-2013-171/H. So, skipping Storing DA-2025-87/A - L 3 Rogers Road MOUNT OSSA QLD 4741 Collecting feed data for georges_river... Collecting feed data for kyogle... georges_river: ERROR: SSL_connect returned=1 errno=0 state=SSLv3 read server certificate B: certificate verify failed (self signed certificate in certificate chain) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `connect_nonblock' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `ssl_socket_connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:981:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for greater_hume... kyogle: ERROR: 502 => Net::HTTPBadGateway for https://etrack.kyogle.nsw.gov.au/Pages/XC.Track/SearchApplication.aspx -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for richmond_valley... greater_hume: ERROR: Failed to open TCP connection to datracker.greaterhume.nsw.gov.au:80 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' richmond_valley: ERROR: Failed to open TCP connection to datracker.richmondvalley.nsw.gov.au:80 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' Collecting feed data for whitsunday... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for cumberland... whitsunday: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Storing CC2025/0448 - 0 Butu Wargun Drive, PEMULWUY NSW 2145 Storing CC2025/0449 - 16 Gooreen Street, LIDCOMBE NSW 2141 Storing CC2025/0450 - 31 Mary Street, LIDCOMBE NSW 2141 Storing CDC2025/0905 - 665-699 Merrylands Road, GREYSTANES NSW 2145 Storing CDC2025/0906 - 28-30 Auburn Road, AUBURN NSW 2144 Storing CDC2025/0907 - 58 Park Road, AUBURN NSW 2144 Storing CDC2025/0908 - 11 Beszant Street, MERRYLANDS NSW 2160 Storing CDC2025/0909 - 46 Bowral Street, GREYSTANES NSW 2145 Storing CDC2025/0910 - 30 Northumberland Road, AUBURN NSW 2144 Storing CDC2025/0911 - 24 Church Street, LIDCOMBE NSW 2141 Storing DA2025/0896 - 8 Murphy Street, MERRYLANDS WEST NSW 2160 Storing DA2025/0897 - 62 Kootingal Street, GREYSTANES NSW 2145 Storing DA2025/0898 - 124 Blaxcell Street, GRANVILLE NSW 2142 Storing DA2025/0899 - 277-289 Woodpark Road, SMITHFIELD NSW 2164 Storing DA2025/0900 - 18 Irrigation Road, MERRYLANDS NSW 2160 Storing DA2025/0901 - 62 Bridge Road, WESTMEAD NSW 2145 Storing DA2025/0902 - 46 Pegler Avenue, SOUTH GRANVILLE NSW 2142 Storing DA2025/0903 - 117 Richmond Street, MERRYLANDS NSW 2160 Storing DA2025/0904 - 10 Otto Street, MERRYLANDS WEST NSW 2160 Storing DA2025/0905 - 102 Centenary Road, SOUTH WENTWORTHVILLE NSW 2145 Storing DA2025/0906 - 481 Woodville Road, GUILDFORD NSW 2161 Storing MOD2025/0413 - 323B Chisholm Road, AUBURN NSW 2144 Storing MOD2025/0414 - 49 Dennis Street, GREYSTANES NSW 2145 Storing MOD2025/0415 - 3/19 Jonathan Street, GREYSTANES NSW 2145 Storing CC2025/0451 - 27 Claremont Street, MERRYLANDS NSW 2160 Storing CC2025/0452 - 159 Joseph Street, LIDCOMBE NSW 2141 Storing CC2025/0453 - 258 Park Road, BERALA NSW 2141 Storing CDC2025/0912 - 10/72-78 Percival Road, SMITHFIELD NSW 2164 Storing CDC2025/0913 - 95 Lockwood Street, MERRYLANDS NSW 2160 Storing CDC2025/0914 - 3 Denver Place, TOONGABBIE NSW 2146 Storing CDC2025/0915 - 62 Graham Street, AUBURN NSW 2144 Storing CDC2025/0916 - 9 Bando Road, GIRRAWEEN NSW 2145 Storing CDC2025/0917 - 46 Bowral Street, GREYSTANES NSW 2145 Storing CDC2025/0918 - 10 Gregory Street, GREYSTANES NSW 2145 Storing DA2025/0907 - 27 Montrose Avenue, MERRYLANDS NSW 2160 Storing DA2025/0908 - 16 Yoogali Street, MERRYLANDS NSW 2160 Storing DA2025/0909 - 29 Ivan Street, GREYSTANES NSW 2145 Storing DA2025/0910 - 113 Station Street, WENTWORTHVILLE NSW 2145 Storing DA2025/0911 - 21/11 John Street, LIDCOMBE NSW 2141 Storing DA2025/0912 - 2 Victor Street, GREYSTANES NSW 2145 Storing DA2025/0913 - 46 Pegler Avenue, SOUTH GRANVILLE NSW 2142 Storing MOD2025/0416 - 7A Smith Street, WENTWORTHVILLE NSW 2145 No address found for CC2025/0454. So, skipping Storing CC2025/0455 - 15 Torrens Street, MERRYLANDS WEST NSW 2160 Storing CDC2025/0919 - 6 MacArthur Crescent, WESTMEAD NSW 2145 Storing CDC2025/0920 - 3 Fullagar Road, WENTWORTHVILLE NSW 2145 Storing CDC2025/0921 - 339 Cumberland Road, AUBURN NSW 2144 Storing DA2025/0914 - 107 Vaughan Street, AUBURN NSW 2144 Storing DA2025/0915 - 62 Bridge Road, WESTMEAD NSW 2145 Storing DA2025/0916 - 325 Clyde Street, SOUTH GRANVILLE NSW 2142 Storing DA2025/0917 - 26 Gibbs Street, AUBURN NSW 2144 Storing MOD2025/0417 - 10 Morshead Crescent, SOUTH GRANVILLE NSW 2142 Storing MOD2025/0418 - Storing CC2025/0456 - 71 Yarram Street, LIDCOMBE NSW 2141 Storing CDC2025/0922 - 10 Third Street, GRANVILLE NSW 2142 Storing CDC2025/0923 - 665-699 Merrylands Road, GREYSTANES NSW 2145 Storing CDC2025/0924 - 135 Fullagar Road, WENTWORTHVILLE NSW 2145 Storing CDC2025/0925 - 7 Mills Street, MERRYLANDS NSW 2160 Storing CDC2025/0926 - 22 Britton Street, SMITHFIELD NSW 2164 Storing CDC2025/0927 - 59 Cambridge Street, BERALA NSW 2141 Storing CDC2025/0928 - 28 Railway Parade, GRANVILLE NSW 2142 Storing CDC2025/0929 - 48 Jonathan Street, GREYSTANES NSW 2145 Storing CDC2025/0930 - 59 Aurelia Street, TOONGABBIE NSW 2146 Storing DA2025/0918 - 102 South Street, GRANVILLE NSW 2142 Storing DA2025/0919 - 102 South Street, GRANVILLE NSW 2142 Storing DA2025/0920 - 10 Florrie Street, GRANVILLE NSW 2142 Storing DA2025/0921 - 37 Belmont Street, MERRYLANDS NSW 2160 Storing DA2025/0922 - 10 Florrie Street, GRANVILLE NSW 2142 Storing DA2025/0923 - 217 Auburn Road, AUBURN NSW 2144 Storing DA2025/0924 - 29 Ivan Street, GREYSTANES NSW 2145 Storing DA2025/0925 - 14 Johnstone Street, GUILDFORD WEST NSW 2161 Storing DA2025/0926 - 14 Drew Street, WESTMEAD NSW 2145 Storing DA2025/0927 - 375 Blaxcell Street, SOUTH GRANVILLE NSW 2142 Storing MOD2025/0419 - 6 Boyne Avenue, PENDLE HILL NSW 2145 Storing CDC2025/0931 - 25A Price Street, MERRYLANDS NSW 2160 Storing CDC2025/0932 - 57 Zillah Street, GUILDFORD NSW 2161 Storing CDC2025/0933 - 18 Monash Street, WENTWORTHVILLE NSW 2145 Storing DA2025/0928 - 375 Blaxcell Street, SOUTH GRANVILLE NSW 2142 Storing DA2025/0929 - 11 Karuk Street, PEMULWUY NSW 2145 Storing MOD2025/0420 - 59 Aurelia Street, TOONGABBIE NSW 2146 Storing CDC2025/0934 - 50 Gozo Road, GREYSTANES NSW 2145 Storing CC2025/0457 - 6 Wallaba Place, GREYSTANES NSW 2145 Storing DA2025/0930 - 2 Elvina Street, GREYSTANES NSW 2145 Storing DA2025/0931 - 15 Lance Crescent, GREYSTANES NSW 2145 Storing CC2025/0458 - 29 Heath Street, AUBURN NSW 2144 Storing CDC2025/0935 - 40 Bruce Street, MERRYLANDS WEST NSW 2160 Storing MOD2025/0421 - 59 Wilfred Street, LIDCOMBE NSW 2141 Collecting feed data for coffs_harbour... Storing 0444/26DA - 53 KUMBAINGERI CLOSE, MOONEE BEACH NSW 2450 Storing 0081/26DM - 44 OCEAN STREET, WOOLGOOLGA NSW 2456 Storing 0436/26DA - 243 WOOLGOOLGA CREEK ROAD, WOOLGOOLGA NSW 2456 Storing 0431/26DA - 110 A FINLAYS ROAD, KORORA NSW 2450 Storing 0443/26DA - 25 THORNBILL CRESCENT, CORINDI BEACH NSW 2456 Storing 0445/26DA - 1 A COOK DRIVE, COFFS HARBOUR NSW 2450 Storing 0447/26DA - 31 CEDARVALE ROAD, BOAMBEE NSW 2450 Storing 0448/26DA - 198 SAWTELL ROAD, TOORMINA NSW 2452 Storing 0408/26DA - 5 / 22 FORGE DRIVE, NORTH BOAMBEE VALLEY NSW 2450 Storing 0449/26DA - 7 A MUIRFIELD CLOSE, COFFS HARBOUR NSW 2450 Storing 0456/26DA - 17 B BONNIE STREET, NORTH BOAMBEE VALLEY NSW 2450 Storing 0464/26DA - 79 THOROUGHBRED CLOSE, NANA GLEN NSW 2450 Storing 0454/26DA - 1 - 3 MARIAN PLACE, TOORMINA NSW 2452 Storing 0457/26DA - 99 KEOGHS ROAD, BONVILLE NSW 2450 Storing 0458/26DA - 113 BRAY STREET, COFFS HARBOUR NSW 2450 Storing 0462/26DA - 12 CURRAWONG CLOSE, COFFS HARBOUR NSW 2450 Storing 0465/26DA - 34 WATSONIA AVENUE, COFFS HARBOUR NSW 2450 Storing 0466/26DA - 115 B BRUXNER PARK ROAD, KORORA NSW 2450 Storing 0467/26DA - 111 NORTH BOAMBEE ROAD, NORTH BOAMBEE VALLEY NSW 2450 Storing 0471/26DA - 110 EAST BONVILLE ROAD, BONVILLE NSW 2450 Storing 0473/26DA - 98 HIDDEN VALLEY GROVE, BONVILLE NSW 2450 Collecting feed data for blue_mountains... Collecting feed data for swan... blue_mountains: ERROR: SSL_connect returned=1 errno=0 state=SSLv3 read server certificate B: certificate verify failed (unable to get local issuer certificate) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `connect_nonblock' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `ssl_socket_connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:981:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for gosnells... swan: ERROR: Failed to open TCP connection to elodge.swan.wa.gov.au:443 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for hobart... gosnells: ERROR: 404 => Net::HTTPNotFound for https://apps.gosnells.wa.gov.au/ICON/Pages/XC.Track/SearchApplication.aspx -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:998:in `response_redirect' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:321:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for hornsby... hobart: ERROR: SSL_connect returned=1 errno=0 state=SSLv3 read server certificate B: certificate verify failed (certificate has expired) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `connect_nonblock' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `ssl_socket_connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:981:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for leichhardt... hornsby: ERROR: 502 => Net::HTTPBadGateway for https://hscenquiry.hornsby.nsw.gov.au/Pages/XC.Track/SearchApplication.aspx -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:998:in `response_redirect' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:321:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for mosman... leichhardt: ERROR: Failed to open TCP connection to www.eservices.lmc.nsw.gov.au:80 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for north_sydney... mosman: ERROR: Failed to open TCP connection to portal.mosman.nsw.gov.au:80 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for penrith... north_sydney: ERROR: Failed to open TCP connection to apptracking.northsydney.nsw.gov.au:443 (getaddrinfo: No address associated with hostname) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for randwick... penrith: ERROR: 404 => Net::HTTPNotFound for http://bizsearch.penrithcity.nsw.gov.au/ePlanning/Pages/XC.Track/SearchApplication.aspx -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for redland... randwick: ERROR: Failed to open TCP connection to planning.randwick.nsw.gov.au:443 (getaddrinfo: No address associated with hostname) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for bayside... redland: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for scenic_rim... Storing BuildEnv25/011 - 7 Sharyn Place, BENOBBLE QLD 4275 Storing CAR25/126 - 70 - 74 Prospect Street, TAMBORINE MOUNTAIN QLD 4272 Storing MCU25/189 - 654 Lamington National Park Road, CANUNGRA QLD 4275 Storing MCU25/190 - 2136 Tamborine Mountain Road, BENOBBLE QLD 4275 Storing MCU25/191 - 83 Curtis Road, TAMBORINE MOUNTAIN QLD 4272 Storing POS25/043 - Outlook Boulevard, GLENEAGLE QLD 4285 Storing MCU25/192 - 84 Coomera Gorge Drive, TAMBORINE MOUNTAIN QLD 4272 Storing MCU25/193 - 123 Guanaba Road, TAMBORINE MOUNTAIN QLD 4272 Storing CAR25/127 - 6 Birnam Street, BEAUDESERT QLD 4285 Storing MCU25/194 - 339 Kruger Road, COLEYVILLE QLD 4307 Storing POS25/044 - 34 - 48 Geiger Road, CANUNGRA QLD 4275 Storing POS25/045 - Cunningham Highway, TAROME QLD 4309 Storing POS25/046 - 22 - 32 Pine Street, CANUNGRA QLD 4275 Storing CAR25/128 - 145 Behrendorff Road, BUNJURGEN QLD 4310 Storing MCU25/195 - 7 Scenic Street, ARATULA QLD 4309 Storing RAL25/068 - 877 Cannon Creek Road, CANNON CREEK QLD 4310 Storing RAL25/069 - 6050 Cunningham Highway, KALBAR QLD 4309 Storing MCU25/196 - 79 - 85 Main Western Road, TAMBORINE MOUNTAIN QLD 4272 Storing CAR25/129 - 75 - 77 Benowa Street, TAMBORINE MOUNTAIN QLD 4272 Storing MCU25/197 - 11 Tina Street, BEAUDESERT QLD 4285 Storing MCU25/198 - 108 B Wongawallan Road, TAMBORINE MOUNTAIN QLD 4272 Storing RAL25/070 - 107 Hoya Road, BOONAH QLD 4310 Storing RAL25/071 - 14 Selwyn Street, BEAUDESERT QLD 4285 Storing CAR25/130 - 83 Curtis Road, TAMBORINE MOUNTAIN QLD 4272 Storing MCU25/199 - 10 Oakland Way, BEAUDESERT QLD 4285 Storing OPW25/089 - Telemon Street, BEAUDESERT QLD 4285 Storing POS25/047 - 26 Carter Road, ARATULA QLD 4309 Storing MCU25/200 - 14 Joanne Court, GLENEAGLE QLD 4285 Storing OPW25/090 - Telemon Street, BEAUDESERT QLD 4285 Storing OPW25/091 - 70 Robson Road, COULSON QLD 4310 Storing POS25/048 - 86 Eagle Heights Road, TAMBORINE MOUNTAIN QLD 4272 Storing RAL25/072 - Beaudesert-Nerang Road, CANUNGRA QLD 4275 Collecting feed data for waverley... Collecting feed data for willoughby... waverley: ERROR: Failed to open TCP connection to eservices.waverley.nsw.gov.au:80 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for canada_bay... Collecting feed data for tweed... canada_bay: ERROR: Failed to open TCP connection to datracking.canadabay.nsw.gov.au:80 (getaddrinfo: No address associated with hostname) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for boroondara... *************************************************** boroondara: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' Now retrying authorities which earlier had failures *************************************************** /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' Collecting feed data for strathfield... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:31:in `<main>' Collecting feed data for georges_river... strathfield: ERROR: Failed to open TCP connection to daenquiry.strathfield.nsw.gov.au:80 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for kyogle... georges_river: ERROR: SSL_connect returned=1 errno=0 state=SSLv3 read server certificate B: certificate verify failed (self signed certificate in certificate chain) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `connect_nonblock' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `ssl_socket_connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:981:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for greater_hume... kyogle: ERROR: 502 => Net::HTTPBadGateway for https://etrack.kyogle.nsw.gov.au/Pages/XC.Track/SearchApplication.aspx -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for richmond_valley... greater_hume: ERROR: Failed to open TCP connection to datracker.greaterhume.nsw.gov.au:80 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for whitsunday... richmond_valley: ERROR: Failed to open TCP connection to datracker.richmondvalley.nsw.gov.au:80 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' whitsunday: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' Collecting feed data for blue_mountains... /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for swan... blue_mountains: ERROR: SSL_connect returned=1 errno=0 state=SSLv3 read server certificate B: certificate verify failed (unable to get local issuer certificate) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `connect_nonblock' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `ssl_socket_connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:981:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for gosnells... swan: ERROR: Failed to open TCP connection to elodge.swan.wa.gov.au:443 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for hobart... gosnells: ERROR: 404 => Net::HTTPNotFound for https://apps.gosnells.wa.gov.au/ICON/Pages/XC.Track/SearchApplication.aspx -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:998:in `response_redirect' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:321:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for hornsby... hobart: ERROR: SSL_connect returned=1 errno=0 state=SSLv3 read server certificate B: certificate verify failed (certificate has expired) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `connect_nonblock' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `ssl_socket_connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:981:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for leichhardt... hornsby: ERROR: 502 => Net::HTTPBadGateway for https://hscenquiry.hornsby.nsw.gov.au/Pages/XC.Track/SearchApplication.aspx -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:998:in `response_redirect' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:321:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' leichhardt: ERROR: Failed to open TCP connection to www.eservices.lmc.nsw.gov.au:80 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' Collecting feed data for mosman... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for north_sydney... mosman: ERROR: Failed to open TCP connection to portal.mosman.nsw.gov.au:80 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for penrith... north_sydney: ERROR: Failed to open TCP connection to apptracking.northsydney.nsw.gov.au:443 (getaddrinfo: No address associated with hostname) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for randwick... penrith: ERROR: 404 => Net::HTTPNotFound for http://bizsearch.penrithcity.nsw.gov.au/ePlanning/Pages/XC.Track/SearchApplication.aspx -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' randwick: ERROR: Failed to open TCP connection to planning.randwick.nsw.gov.au:443 (getaddrinfo: No address associated with hostname) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' Collecting feed data for redland... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for waverley... redland: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' waverley: ERROR: Failed to open TCP connection to eservices.waverley.nsw.gov.au:80 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' Collecting feed data for canada_bay... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' Collecting feed data for boroondara... canada_bay: ERROR: Failed to open TCP connection to datracking.canadabay.nsw.gov.au:80 (getaddrinfo: No address associated with hostname) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' boroondara: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/icon_scraper.rb:34:in `scrape_with_params' /app/lib/icon_scraper.rb:17:in `scrape' scraper.rb:14:in `block in scrape' scraper.rb:10:in `each' scraper.rb:10:in `scrape' scraper.rb:38:in `<main>' scraper.rb:42:in `<main>': There were errors with the following authorities: [:strathfield, :georges_river, :kyogle, :greater_hume, :richmond_valley, :whitsunday, :blue_mountains, :swan, :gosnells, :hobart, :hornsby, :leichhardt, :mosman, :north_sydney, :penrith, :randwick, :redland, :waverley, :canada_bay, :boroondara]. See earlier output for details (RuntimeError)

Data

Downloaded 176 times by dcalde tkrikke repose-lecture odnagroup

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (38.5 MB) Use the API

rows 10 / 96491

council_reference description date_received address date_scraped info_url authority_label
0139/21DM
S4.55 (2) - Modification - Changes to Consent Conditions
2021-04-01
1 OCEAN STREET WOOLGOOLGA NSW 2456
2021-04-15
coffs_harbour
0900/21DA
New Dwelling
2021-04-06
5 SHELLY CLOSE WOOLGOOLGA NSW 2456
2021-04-15
coffs_harbour
0902/21DA
PATIO
2021-04-06
82 RALEIGH STREET COFFS HARBOUR NSW 2450
2021-04-15
coffs_harbour
0142/21DM
Modificatin - Extend Carport
2021-04-07
7 DILLON STREET SAWTELL NSW 2452
2021-04-15
coffs_harbour
0906/21DA
Proposed two storey dwelling
2021-04-08
23 TREVALLY STREET KORORA NSW 2450
2021-04-15
coffs_harbour
0907/21DA
Proposed two storey dwelling
2021-04-08
25 TREVALLY STREET KORORA NSW 2450
2021-04-15
coffs_harbour
0908/21DA
Erection of an aircraft hangar - Proposed Lot 69
2021-04-08
AIRPORT DRIVE COFFS HARBOUR NSW 2450 AIRPORT DRIVE COFFS HARBOUR NSW 2450
2021-04-15
coffs_harbour
0909/21DA
Construction of 4 bedroom residential dwelling with attached garage.
2021-04-08
MIDDLE BOAMBEE ROAD BOAMBEE NSW 2450
2021-04-15
coffs_harbour
0910/21DA
Covered deck
2021-04-09
35 BAILEY AVENUE COFFS HARBOUR NSW 2450
2021-04-23
coffs_harbour
0912/21DA
Detached new studio addition
2021-04-09
5 REID DRIVE COFFS HARBOUR NSW 2450
2021-04-23
coffs_harbour

Statistics

Average successful run time: 5 minutes

Total run time: 8 days

Total cpu time used: about 2 hours

Total disk space used: 70.6 MB

History

  • Auto ran revision 6d62d6a4 and failed .
    181 records added, 180 records removed in the database
  • Auto ran revision 6d62d6a4 and failed .
    424 records added, 420 records removed in the database
  • Auto ran revision 6d62d6a4 and failed .
    435 records added, 432 records removed in the database
  • Auto ran revision 6d62d6a4 and failed .
    436 records added, 436 records removed in the database
  • Auto ran revision 6d62d6a4 and failed .
    436 records added, 433 records removed in the database
  • ...
  • Created on { hostname }

Show complete history

Scraper code

Ruby

coffs-harbour / scraper.rb