StashProperty / multiple_masterview

Scrapes multiple authorities that have a masterview system


This is a scraper that runs on Morph. To get started see the documentation

To run the scraper

bundle exec ruby scraper.rb

To run the tests

bundle exec rake

To run style and coding checks

bundle exec rubocop

What a Masterview website looks like

Sign up

(To update this screenshot run bundle exec rake screenshots)

Contributors mlandauer AndreM101 njenkins

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Scraping authorities: gunnedah, maranoa, broken_hill, gympie, fairfield, fraser_coast, hawkesbury, toowoomba, bundaberg, wingecarribee, albury, bogan, lismore, port_macquarie_hastings, port_stephens, singleton, camden Collecting feed data for gunnedah... Saving record 2024/1015/1 - 94 Kerry Elizabeth Dr, Gunnedah 2380 NSW Saving record 2024/1/2 - 415 Edmonds Rd, Emerald Hill 2380 NSW Saving record 2024/43/1 - 58 Edward St, Gunnedah 2380 NSW Saving record 2024/1015/2 - 94 Kerry Elizabeth Dr, Gunnedah 2380 NSW Saving record 2024/41/1 - 474 Wandobah Rd, Gunnedah 2380 NSW Saving record 2024/37/1 - 2 Harrie Rowland Pl, Gunnedah 2380 NSW Saving record 2024/42/1 - 58 Edward St, Gunnedah 2380 NSW Saving record 2024/39/1 - 102 Little Conadilly St, Gunnedah 2380 NSW Saving record 2007/301619/2 - 20 Sunnyside Farm Dr, Gunnedah 2380 NSW Saving record 2024/1013/1 - 39 Robert Gordon Rd, Gunnedah 2380 NSW Saving record 2024/34/1 - 39 View St, Gunnedah 2380 NSW Saving record 2024/1014/1 - 16 Parish Ave, Gunnedah 2380 NSW Saving record 2024/40/1 - 37 Wattle St, Gunnedah 2380 NSW Saving record 2024/38/1 - 30 Galway Ave, Gunnedah 2380 NSW Saving record 2020/8/2 - 20 Sunnyside Farm Dr, Gunnedah 2380 NSW Saving record 2024/35/1 - 94 Kerry Elizabeth Dr, Gunnedah 2380 NSW Saving record 2024/1012/1 - 1 Dries Ave, Gunnedah 2380 NSW Saving record 2024/33/1 - 5 Anderson Pl, Gunnedah 2380 NSW Collecting feed data for maranoa... Saving record 23 - 2023 - 20783 - 1 - 219-223 Raglan St, Roma 4455 QLD Saving record 23 - 2024 - 21125 - 1 - 44426 Warrego Hwy, Roma 4455 QLD Saving record 30 - 2024 - 21052 - 2 - 1218 Glen Arden Rd, Durham Downs 4454 QLD Saving record 22 - 2024 - 21111 - 1 - 23 Derry St, Roma 4455 QLD Saving record 30 - 2024 - 21140 - 1 - 98 Corfe Rd, Roma 4455 QLD Saving record 22 - 2024 - 21139 - 1 - 40 Howard St, Roma 4455 QLD Saving record 30 - 2022 - 20728 - 3 - 34 Quintin St, Roma 4455 QLD Saving record 23 - 2024 - 21115 - 1 - Blue Hills Rd, Tingun 4455 QLD Saving record 22 - 2020 - 20144 - 2 - 301 Wallumbilla South Rd, Wallumbilla 4428 QLD Saving record 30 - 2024 - 21120 - 1 - 17 Allen St, Roma 4455 QLD Saving record 22 - 2024 - 21134 - 1 - 72 Alice St, Mitchell 4465 QLD Saving record 22 - 2024 - 21138 - 1 - 410 Hoganthulla Rd, Forestvale 4465 QLD Saving record 30 - 2012 - 18058 - 4 - Primaries Rd, Roma 4455 QLD Saving record 22 - 2024 - 21132 - 1 - 12 William St, Roma 4455 QLD Saving record 22 - 2024 - 21133 - 1 - 18 Downs St, Roma 4455 QLD Saving record 22 - 2024 - 21135 - 1 - 285 Edwardes St, Roma 4455 QLD Saving record 22 - 2024 - 21136 - 1 - 43-45 Quintin St, Roma 4455 QLD Saving record 22 - 2024 - 21137 - 1 - 113 Charles St, Roma 4455 QLD Saving record 22 - 2024 - 21131 - 1 - 10L Freemans Rd, Euthulla 4455 QLD Saving record 22 - 2024 - 21130 - 1 - Wallumbilla North Rd, Wallumbilla North 4428 QLD Saving record 22 - 2024 - 21129 - 1 - 133 Corfe Rd, Roma 4455 QLD Saving record 30 - 2024 - 21128 - 1 - 1 Bowen St, Roma 4455 QLD Saving record 23 - 2024 - 21127 - 1 - 74 Burrowes St, Surat 4417 QLD Saving record 22 - 2024 - 21126 - 1 - 260 Geoghegan Rd, Roma 4455 QLD Saving record 22 - 2024 - 21125 - 1 - 44426 Warrego Hwy, Roma 4455 QLD Saving record 22 - 2024 - 21124 - 1 - 15 Arthur St, Roma 4455 QLD Saving record 22 - 2024 - 21123 - 1 - 10-12 Edna St, Roma 4455 QLD Saving record 30 - 2024 - 21121 - 1 - 39 Hoffman St, Roma 4455 QLD Saving record 23 - 2023 - 20981 - 1 - 74 Burrowes St, Surat 4417 QLD Saving record 22 - 2024 - 21118 - 1 - 116 Currey St, Roma 4455 QLD Saving record 22 - 2024 - 21117 - 1 - 35 Miscamble St, Roma 4455 QLD Saving record 30 - 2023 - 20838 - 2 - 5960 Mt Abundance Rd, Mount Abundance 4455 QLD Saving record 22 - 2024 - 21116 - 1 - 113 Charles St, Roma 4455 QLD Saving record 22 - 2024 - 21119 - 1 - 10-12 Edna St, Roma 4455 QLD Saving record 23 - 2024 - 21114 - 1 - 93-95 Cambridge St, Mitchell 4465 QLD Saving record 22 - 2024 - 21109 - 1 - 260 Geoghegan Rd, Roma 4455 QLD Saving record 23 - 2024 - 21113 - 1 - 1-5 Billy Bob Wy, Roma 4455 QLD Saving record 30 - 2024 - 21112 - 1 - 5 Holland St, Roma 4455 QLD Saving record 22 - 2024 - 21107 - 1 - 59 Louisa St, Mitchell 4465 QLD Saving record 22 - 2024 - 21108 - 1 - 28 Derry St, Roma 4455 QLD Saving record 22 - 2024 - 21110 - 1 - 143 Duke St, Roma 4455 QLD Collecting feed data for broken_hill... Saving record 10 - 2024 - 36 - 1 - 42 Kanandah Rd, Broken Hill 2880 NSW Saving record 10 - 2024 - 37 - 1 - 385B Kaolin St, Broken Hill 2880 NSW Saving record 10 - 2024 - 41 - 1 - 321-325 Blende St, Broken Hill 2880 NSW Saving record 10 - 2024 - 43 - 1 - 320 Chloride St, Broken Hill 2880 NSW Saving record 10 - 2024 - 1 - 2 - 210 Cornish St, Broken Hill 2880 NSW Saving record 10 - 2024 - 38 - 1 - 415 Cummins Lane, Broken Hill 2880 NSW Saving record 10 - 2023 - 93 - 2 - 426 Lane Lane, Broken Hill 2880 NSW Saving record 10 - 2024 - 33 - 1 - 28 Brooks St, Broken Hill 2880 NSW Saving record 10 - 2024 - 27 - 1 - 622 Cummins St, Broken Hill 2880 NSW Saving record 10 - 2024 - 39 - 1 - 78 Wyman St, Broken Hill 2880 NSW Saving record 10 - 2024 - 24 - 1 - 13 South St, Broken Hill 2880 NSW Saving record 10 - 2024 - 22 - 1 - 2 South St, Broken Hill 2880 NSW Saving record 10 - 2024 - 26 - 1 - 143 Jamieson St, Broken Hill 2880 NSW Saving record 10 - 2024 - 28 - 1 - 25 Thomas St, Broken Hill 2880 NSW Collecting feed data for gympie... Saving record 7.2024.1487.1 - 56-58 Sorensen Rd, Southside 4570 QLD Saving record 7.2024.1486.1 - 56-58 Sorensen Rd, Southside 4570 QLD Saving record 7.2024.1363.1 - 41 Penny Rd, East Deep Creek 4570 QLD Saving record 7.2024.1481.1 - 56-58 Sorensen Rd, Southside 4570 QLD Saving record 8.2024.1264.1 - 240 Schollick Rd, Woolooga 4570 QLD Saving record 7.2024.1467.1 - 2 Shields St, Gympie 4570 QLD Saving record 7.2024.1438.1 - 9H Mulcahy Tce, Gympie 4570 QLD Saving record 7.2024.1428.1 - Hyne St, Gympie 4570 QLD Saving record 8.2024.1349.1 - 131 Thomason Rd, Traveston 4570 QLD Saving record 8.2024.1351.1 - 16 Cooloola Dve, Rainbow Beach 4581 QLD Saving record 7.2024.1196.1 - 24 Langara Dve, Southside 4570 QLD Saving record 7.2024.1408.1 - 123 Eel Creek Rd, Southside 4570 QLD Saving record 7.2024.1195.1 - 30 Langara Dve, Southside 4570 QLD gympie: ERROR: Unknown value of determination type: Received /app/lib/masterview_scraper/pages/detail.rb:226:in `scrape_new_version' /app/lib/masterview_scraper/pages/detail.rb:12:in `scrape' /app/lib/masterview_scraper.rb:112:in `block in scrape_api_period' /app/lib/masterview_scraper/get_applications_api.rb:23:in `block in scrape' /app/lib/masterview_scraper/get_applications_api.rb:60:in `block in scrape_page' Collecting feed data for fairfield... /app/lib/masterview_scraper/get_applications_api.rb:54:in `each' /app/lib/masterview_scraper/get_applications_api.rb:54:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:97:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Saving record DA - 88.1/2024 - 7 Araluen RD LANSVALE, NSW Saving record DA - 89.1/2024 - 48 Hemphill AVE MOUNT PRITCHARD, NSW Saving record DA - 90.1/2024 - 54 Wilga ST FAIRFIELD, NSW Saving record DA - 91.1/2024 - 109 Prairie Vale RD BOSSLEY PARK, NSW Saving record DA - 92.1/2024 - 616C Cabramatta RDW MOUNT PRITCHARD, NSW Saving record DA - 93.1/2024 - 7 Balson CL ABBOTSBURY, NSW Saving record DA - 94.1/2024 - 484-486 Victoria ST WETHERILL PARK, NSW Saving record DA - 95.1/2024 - 6 Ute PL BOSSLEY PARK, NSW Saving record DA - 96.1/2024 - 37-41 Day ST LANSVALE, NSW Saving record DA - 97.1/2024 - 190 The Boulevarde FAIRFIELD HEIGHTS, NSW Saving record DA - 99.1/2024 - 459 Cabramatta RDW CABRAMATTA WEST, NSW Saving record DA - 100.1/2024 - 2 Bundarra ST LANSVALE, NSW Saving record DA - 101.1/2024 - 17 Davis RD WETHERILL PARK, NSW Saving record DA - 102.1/2024 - 59 Hemphill AVE MOUNT PRITCHARD, NSW Saving record DA - 103.1/2024 - 16 Bennett AVE CARRAMAR, NSW Saving record DA - 104.1/2024 - 45 Walworth RD HORSLEY PARK, NSW Saving record DA - 105.1/2024 - 115 Oliphant ST MOUNT PRITCHARD, NSW Saving record DA - 106.1/2024 - 3 Davis RD WETHERILL PARK, NSW Saving record DA - 107.1/2024 - 26 Bonham ST CANLEY VALE, NSW Saving record DA - 108.1/2024 - 23 Orchardleigh ST YENNORA, NSW Saving record DA - 109.1/2024 - 2/5 Johnston CRES HORSLEY PARK, NSW Saving record DA - 110.1/2024 - 50 Larra ST YENNORA, NSW Saving record DA - 111.1/2024 - 19 Hargraves PL WETHERILL PARK, NSW Saving record DA - 112.1/2024 - 2 Romney PL WAKELEY, NSW Saving record DA - 113.1/2024 - 15 Shamrock ST SMITHFIELD, NSW Saving record DA - 114.1/2024 - 8 Dunstan ST FAIRFIELD WEST, NSW Saving record DA - 115.1/2024 - 677 The Horsley DR SMITHFIELD, NSW Saving record DA - 116.1/2024 - 47 Whitlam AVE EDENSOR PARK, NSW Saving record DA - 117.1/2024 - 111 Ware ST FAIRFIELD, NSW Collecting feed data for fraser_coast... Collecting feed data for hawkesbury... fraser_coast: ERROR: 404 => Net::HTTPNotFound for https://pdonline.frasercoast.qld.gov.au/Modules/ApplicationMaster/default.aspx?page=found&1=10/04/2024&2=10/05/2024&4a=BPS%27,%27MC%27,%27OP%27,%27SB%27,%27MCU%27,%27ROL%27,%27OPWKS%27,%27QMCU%27,%27QRAL%27,%27QOPW%27,%27QDBW%27,%27QPOS%27,%27QSPS%27,%27QEXE%27,%27QCAR%27,%27ACA&6=F -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:153:in `scrape_url' /app/lib/masterview_scraper.rb:61:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Collecting feed data for toowoomba... hawkesbury: ERROR: Failed to open TCP connection to datrack.hawkesbury.nsw.gov.au:443 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:153:in `scrape_url' /app/lib/masterview_scraper.rb:61:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Collecting feed data for bundaberg... toowoomba: ERROR: SSL_connect returned=1 errno=0 state=SSLv3 read server certificate B: certificate verify failed (unable to get local issuer certificate) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `connect_nonblock' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `ssl_socket_connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:981:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:153:in `scrape_url' /app/lib/masterview_scraper.rb:61:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' bundaberg: ERROR: Net::ReadTimeout /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:181:in `rbuf_fill' Collecting feed data for wingecarribee... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:157:in `readuntil' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:167:in `readline' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:40:in `read_status_line' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:29:in `read_new' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1494:in `block in transport_request' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1491:in `catch' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1491:in `transport_request' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1464:in `request' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:891:in `block in request' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:606:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:1323:in `post_form' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:536:in `post' /app/lib/masterview_scraper/get_applications_api.rb:43:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:97:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' wingecarribee: ERROR: Couldn't find table /app/lib/masterview_scraper/pages/index.rb:41:in `scrape' /app/lib/masterview_scraper.rb:165:in `scrape_url' /app/lib/masterview_scraper.rb:61:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' Collecting feed data for albury... scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' albury: ERROR: execution expired Collecting feed data for bogan... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' bogan: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Collecting feed data for lismore... Saving record 5.2024.83.1 - 38 Blue Hills Ave, Goonellabah 2480 NSW Saving record 5.2023.139.2 - 2 Middleton Way, Dunoon 2480 NSW Saving record 10.2023.271.1 - 76 Willis Rd, Tregeagle 2480 NSW Saving record 5.2023.271.2 - 76 Willis Rd, Tregeagle 2480 NSW Saving record 5.2024.65.1 - 1 Southern Cross Tce, Goonellabah 2480 NSW Saving record 5.2022.326.2 - 1 Numulgi St, Bexhill 2480 NSW Saving record 13.2022.19.1 - 16 Keerrong Rd, Blakebrook 2480 NSW Saving record 8.2024.24.1 - 764 Ballina Rd, Goonellabah 2480 NSW Saving record 5.2024.88.1 - 116 Woodlark St, Lismore 2480 NSW Saving record 5.2024.81.1 - 47 Palmers Rd, Mcleans Ridges 2480 NSW Saving record 5.2024.91.1 - 31 Hunter St, Lismore 2480 NSW Saving record 10.2024.36.1 - 13 Funnell Dr, Modanville 2480 NSW Saving record 10.2022.356.2 - 57 Acacia Ave, Goonellabah 2480 NSW Saving record 10.2024.20.1 - 32 Evergreen Dr, Goonellabah 2480 NSW Saving record 5.2022.30.2 - 221 Emerson Rd, Rosebank 2480 NSW Saving record 10.2024.71.1 - 380 Whian Whian Rd, Whian Whian 2480 NSW Saving record 5.2024.85.1 - 113 Eastment Lane, South Gundurimba 2480 NSW Saving record 10.2023.335.1 - 14 Mcintosh Rd, Chilcotts Grass 2480 NSW Saving record 5.2023.307.2 - 2 Wardell St, South Lismore 2480 NSW Saving record 5.2024.79.1 - 3 Jubilee Ave, Goonellabah 2480 NSW Saving record 10.2023.282.2 - 33 Waratah Way, Goonellabah 2480 NSW Saving record 5.2024.74.1 - 11 Rural St, Lismore 2480 NSW Saving record 10.2023.230.1 - 2430 Nimbin Rd, Nimbin 2480 NSW Saving record 10.2023.249.2 - 92 Richmond Hill Rd, Richmond Hill 2480 NSW Saving record 5.2024.68.1 - 5 Grey Gum Cl, Caniaba 2480 NSW Saving record 10.2023.250.4 - 41 Hidden Valley Cct, Chilcotts Grass 2480 NSW Saving record 10.2022.74.2 - 12 Oak Dr, Goonellabah 2480 NSW Saving record 8.2024.23.1 - 47 Hidden Valley Cct, Chilcotts Grass 2480 NSW Saving record 10.2023.250.3 - 41 Hidden Valley Cct, Chilcotts Grass 2480 NSW Saving record 8.2024.22.1 - 5 Wedgetail Ct, Goonellabah 2480 NSW Saving record 5.2023.15.3 - 96D Yeager Rd, Leycester 2480 NSW Saving record 10.2023.221.1 - 44 Federation Dr, Eltham 2480 NSW Saving record 5.2023.208.2 - 62 Rous Rd, Goonellabah 2480 NSW Saving record 10.2024.62.1 - 45 Waratah Way, Goonellabah 2480 NSW Saving record 13.2024.1002.1 - 101 Rosebank Rd, Rosebank 2480 NSW Saving record 5.2022.59.2 - 1343 Dunoon Rd, Dunoon 2480 NSW Saving record 13.2022.384.1 - 296 Stony Chute Rd, Nimbin 2480 NSW Saving record 10.2021.620.2 - 74 Conway St, Lismore 2480 NSW Saving record 13.2020.328.1 - 62 Main St, Clunes 2480 NSW Saving record 5.2024.52.1 - 64 Bishops Creek Rd, Coffee Camp 2480 NSW Saving record 10.2023.216.1 - 42 May St, Dunoon 2480 NSW Saving record 5.2024.76.1 - 161 Military Rd, East Lismore 2480 NSW Saving record 8.2024.20.1 - 34 Greenwood Dr, Goonellabah 2480 NSW Saving record 5.2024.80.1 - 4 Kenzi Rise, Nimbin 2480 NSW Saving record 8.2024.19.1 - 64/95 Diadem St, Lismore 2480 NSW Saving record 5.2024.73.1 - 152 Keen St, Lismore 2480 NSW Saving record 10.2023.208.1 - 62 Rous Rd, Goonellabah 2480 NSW Saving record 5.2024.21.1 - 61 Acacia Ave, Goonellabah 2480 NSW Saving record 13.2022.122.1 - 14 Eden Pl, Girards Hill 2480 NSW Collecting feed data for port_macquarie_hastings... port_macquarie_hastings: ERROR: end of file reached /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:189:in `rbuf_fill' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:157:in `readuntil' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:167:in `readline' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:40:in `read_status_line' Collecting feed data for port_stephens... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:29:in `read_new' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1494:in `block in transport_request' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1491:in `catch' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1491:in `transport_request' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1464:in `request' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:891:in `block in request' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:606:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Collecting feed data for singleton... port_stephens: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Saving record 10.2023.592.1 - 6 Burbank Cres, Hunterview NSW 2330 Saving record 10.2024.29.1 - 31 Freeman Cl, Wattle Ponds NSW 2330 Saving record 8.2023.392.2 - 11 Maybon Cl, Branxton NSW 2335 Saving record 15.2024.22.1 - 129 Wollombi Rd, Broke NSW 2330 Saving record 8.2024.38.2 - Pitt St, Singleton NSW 2330 Saving record 15.2024.23.1 - 491 Hermitage Rd, Pokolbin NSW 2320 Saving record 15.2024.24.1 - 769 Hermitage Rd, Pokolbin NSW 2320 Saving record 15.2024.25.1 - 769 Hermitage Rd, Pokolbin NSW 2320 Saving record 9.2024.21.1 - 11 Robinia Dr, Branxton NSW 2335 Saving record 15.2024.18.1 - 327 Long Point Rd, Long Point NSW 2330 Saving record 8.2022.300.6 - 133 Pioneer Rd, Hunterview NSW 2330 Saving record 12.2023.375.1 - 193 Hanwood Rd, Branxton NSW 2335 Saving record 8.2024.107.1 - 9 Lifestyle Dr, Wattle Ponds NSW 2330 Saving record 8.2024.108.1 - 511 Standen Dr, Lower Belford NSW 2335 Saving record 15.2024.21.1 - 303 Robertson Cct, Sedgefield NSW 2330 Saving record 10.2023.304.1 - 14 Pepper Cl, Hunterview NSW 2330 Saving record 8.2023.304.2 - 14 Pepper Cl, Hunterview NSW 2330 Saving record 12.2021.392.2 - 7 Emblem Ct, Wattle Ponds NSW 2330 Saving record 8.2024.106.1 - 12 Clara Pl, Singleton Heights NSW 2330 Saving record 10.2024.51.1 - 13 Madden Pde, Singleton Heights NSW 2330 Saving record 8.2024.105.1 - 252 Sunnyside Lane, Bridgman NSW 2330 Saving record 12.2021.419.2 - 197 Roughit Lane, Roughit NSW 2330 Saving record 10.2017.205.2 - 393 Hermitage Rd, Pokolbin NSW 2320 Saving record 12.2023.183.1 - 337 Robertson Cct, Sedgefield NSW 2330 Saving record 10.2022.176.1 - 31 William St, Singleton NSW 2330 Saving record 15.2024.20.1 - 122 Fernhill Rd, Dalwood NSW 2335 Saving record 10.2024.12.2 - 11 Pistacia Gr, Branxton NSW 2335 Saving record 8.2024.94.1 - 31 Cranston Ave, Singleton NSW 2330 Saving record 10.2023.601.1 - 232E Fernhill Rd, Dalwood NSW 2335 Saving record 12.2023.260.1 - 169 Standen Dr, Lower Belford NSW 2335 Saving record 10.2023.591.1 - 52 Church St, Singleton NSW 2330 Saving record 12.2022.120.1 - 44 Freeman Cl, Wattle Ponds NSW 2330 Saving record 8.2024.101.1 - 9 Pin Oak Cct, Branxton NSW 2335 Saving record 12.2022.8.2 - 1297 Mirannie Rd, Reedy Creek NSW 2330 Saving record 8.2024.93.1 - 303 Robertson Cct, Sedgefield NSW 2330 Saving record 8.2020.108.3 - 7 Church St, Singleton NSW 2330 Saving record 15.2024.19.1 - 409A Wollombi Rd, Broke NSW 2330 Saving record 15.2024.17.1 - 7 Dyrring St, Camberwell NSW 2330 Saving record 8.2024.95.1 - 245-255 John St, Singleton NSW 2330 Saving record 8.2024.99.1 - 27 Kennedy St, Singleton NSW 2330 Saving record 8.2024.103.1 - 198 Robertson Cct, Sedgefield NSW 2330 Saving record 8.2024.98.1 - 45 Pin Oak Cct, Branxton NSW 2335 Saving record 10.2022.144.2 - 56 Greenwood Ave, Redbournberry NSW 2330 Saving record 8.2024.97.1 - 819 Hermitage Rd, Pokolbin NSW 2320 Saving record 10.2024.97.1 - 819 Hermitage Rd, Pokolbin NSW 2320 Saving record 10.2024.47.1 - 341 The Inlet Rd, Bulga NSW 2330 Saving record 10.2024.89.1 - 38 Barton Ave, Singleton NSW 2330 Saving record 8.2024.89.1 - 38 Barton Ave, Singleton NSW 2330 Saving record 9.2024.16.1 - 30 Pin Oak Cct, Branxton NSW 2335 Saving record 8.2024.100.1 - 22 Lloyd Jones Dr, Singleton Heights NSW 2330 Saving record 10.2024.4.1 - 34 Green Gr, Sedgefield NSW 2330 Saving record 12.2021.49.2 - 998 Milbrodale Rd, Broke NSW 2330 Saving record 8.2024.96.1 - 14 Maskey Rd, Mount Thorley NSW 2330 Saving record 15.2024.16.1 - 819 Hermitage Rd, Pokolbin NSW 2320 Saving record 8.2024.75.1 - 6121 Putty Rd, Howes Valley NSW 2330 Saving record 10.2022.501.2 - 231 Glendon Rd, Clydesdale NSW 2330 Saving record 10.2020.338.2 - 232B Fernhill Rd, Dalwood NSW 2335 Saving record 8.2024.92.1 - 82 Pioneer Rd, Hunterview NSW 2330 Saving record 8.2024.8.3 - 2 Retreat Rd, Wattle Ponds NSW 2330 Collecting feed data for camden... Saving record CDC/2024/10301/1 - 16 Furlong Dr, Currans Hill 2567 NSW Saving record OC/2023/638/1 - 80 Burrell Rd, Spring Farm 2570 NSW Saving record OC/2024/10307/1 - 53 Lillydale Ave, Gledswood Hills 2557 NSW Saving record CDC/2024/10307/1 - 53 Lillydale Ave, Gledswood Hills 2557 NSW Saving record CDC/2024/10305/1 - 33 Ellis Ln, Ellis Lane 2570 NSW Saving record CDC/2024/10306/1 - 96 Somervaille Dr, Catherine Field 2557 NSW Saving record OC/2023/186/1 - 4 Yarra Ave, Gregory Hills 2557 NSW Saving record OC/2023/344/1 - 6 Killen Pde, Catherine Field 2557 NSW Saving record OC/2023/350/2 - 28 Swift Ave, Leppington 2179 NSW Saving record OC/2023/816/1 - 49 Ballandean Bvd, Gledswood Hills 2557 NSW Saving record OC/2022/848/2 - 25 Evergreen Dr, Oran Park 2570 NSW Saving record S96/2022/991/2 - 67 Mcclymont Dr, Catherine Field 2557 NSW Saving record OC/2023/78/2 - 49 Ballandean Bvd, Gledswood Hills 2557 NSW Saving record S96/2023/672/2 - 33 Robert Ingham Dr, Catherine Field 2557 NSW Saving record OC/2022/857/2 - 83 Banfield Dr, Oran Park 2570 NSW Saving record SC/2021/96/1 - 21 Do_Not_Use St, Unknown 2570 NSW Saving record SC/2021/1453/1 - 650 The Northern Rd, Oran Park 2570 NSW Saving record OC/2021/1150/2 - 22 Cato Cct, Leppington 2179 NSW Saving record DA/2024/191/1 - 13 Chisholm Rd, Catherine Field 2557 NSW Saving record DA/2024/190/1 - 14 Myuna Pl, Camden South 2570 NSW Saving record DA/2024/188/1 - 2/45 Central Hills Dr, Gregory Hills 2557 NSW Saving record S96/1996/11/2 - 192 Cobbitty Rd, Cobbitty 2570 NSW Saving record DA/2024/186/1 - 26 Alma Rd, Leppington 2179 NSW Saving record DA/2024/189/1 - 49 Bowman Ave, Camden South 2570 NSW Saving record S96/2006/1264/5 - 1 Forestgrove Dr, Harrington Park 2567 NSW Saving record OC/2021/139/3 - 1 Meridian St, Leppington 2179 NSW Saving record OC/2023/275/1 - 12 Battam Rd, Gregory Hills 2557 NSW Saving record OC/2022/482/1 - 9 Menangle Rd, Camden 2570 NSW Saving record OC/2024/10136/1 - 351 Oran Park Dr, Oran Park 2570 NSW Saving record OC/2024/10218/1 - 33 Herd St, Oran Park 2570 NSW Saving record DA/2024/176/1 - 420 Oran Park Dr, Oran Park 2570 NSW Saving record DA/2024/178/1 - 90 Hillston Cct, Gregory Hills 2557 NSW Saving record S96/2022/628/2 - 420 Oran Park Dr, Oran Park 2570 NSW Saving record DA/2024/173/1 - 187A-187B Cawdor Rd, Cawdor 2570 NSW Saving record S96/2022/899/2 - 15 Grassbird Ave, Oran Park 2570 NSW Saving record DA/2024/183/1 - 3/151 Hartley Rd, Smeaton Grange 2567 NSW Saving record OC/2022/2053/2 - 60 Central Ave, Oran Park 2570 NSW Saving record DA/2024/182/1 - 7 Glenlee Ct, Narellan Vale 2567 NSW Saving record S96/2023/673/2 - 103 Hillston Cct, Gregory Hills 2557 NSW Saving record DA/2024/187/1 - 45 Southwell Rd, Oran Park 2570 NSW Saving record S96/2022/649/4 - 137 Heath Rd, Leppington 2179 NSW Saving record CC/2024/42/1 - 29 Callicoma St, Mount Annan 2567 NSW Saving record DA/2024/177/1 - 14 Clematis Pl, Mount Annan 2567 NSW Saving record DA/2024/180/1 - 11 Gleditsia Cl, Narellan Vale 2567 NSW Saving record S96/2023/17/2 - 189A Springfield Rd, Catherine Field 2557 NSW Saving record S96/2023/386/2 - 1 Bowerbird Loop, Oran Park 2570 NSW Saving record S96/2022/838/2 - 91 Central Ave, Oran Park 2570 NSW Saving record S96/2022/837/2 - 5 Mack Pl, Oran Park 2570 NSW Saving record OC/2018/1019/2 - 18 Bellingham St, Narellan 2567 NSW Saving record S96/2022/545/2 - 91 Central Ave, Oran Park 2570 NSW Saving record OC/2022/1082/2 - 105 Somervaille Dr, Catherine Field 2557 NSW Saving record CC/2024/184/1 - 17 Sultana Ave, Leppington 2179 NSW Saving record DA/2024/184/1 - 17 Sultana Ave, Leppington 2179 NSW Saving record DA/2024/175/1 - 650 The Northern Rd, Oran Park 2570 NSW Saving record SC/2021/1077/1 - 1395 Camden Valley Way, Leppington 2179 NSW Saving record OC/2023/102/2 - 167 Emerald Hills Bvd, Leppington 2179 NSW Saving record DA/2024/168/1 - 7 Burragorang Rd, Cawdor 2570 NSW Saving record SC/2020/264/2 - 21 Do_Not_Use St, Unknown 2570 NSW Saving record OC/2022/566/3 - 16 Peppercress Rdge, Leppington 2179 NSW Saving record OC/2021/1426/3 - 35 Swallow Loop, Oran Park 2570 NSW Saving record OC/2024/10086/1 - 21 Newmarket St, Currans Hill 2567 NSW Saving record OC/2022/950/2 - 64 Archer Rd, Spring Farm 2570 NSW Saving record S96/2022/544/2 - 91 Central Ave, Oran Park 2570 NSW Saving record S96/2023/423/2 - 50 Bowerbird Loop, Oran Park 2570 NSW Saving record S96/2023/6/2 - 91 Central Ave, Oran Park 2570 NSW Saving record S96/2011/96/2 - 192 Cobbitty Rd, Cobbitty 2570 NSW Saving record OC/2022/520/1 - 3 Funnell Cl, Camden South 2570 NSW Saving record DA/2024/170/1 - 92 Wainwright Dr, Cobbitty 2570 NSW Saving record DA/2024/179/1 - 49 Platypus St, Cobbitty 2570 NSW Saving record OC/2023/718/2 - 2/59 Smeaton Grange Rd, Smeaton Grange 2567 NSW Saving record S96/2023/470/2 - 1 Freshwater Dr, Cobbitty 2570 NSW Saving record DA/2024/172/1 - 3 Silky Oak Gr, Elderslie 2570 NSW Saving record DA/2024/174/1 - 22 Little St, Camden 2570 NSW Saving record CC/2022/285/2 - 23 Old Hume Hwy, Camden 2570 NSW Saving record S96/2006/1163/5 - 7 Iando Way, Currans Hill 2567 NSW Saving record EngCC/2021/1317/8 - 139 Turner Rd, Gregory Hills 2557 NSW Saving record DA/2024/185/1 - 45 Harrington St, Elderslie 2570 NSW Saving record FIRE/2018/9/2 - 2/13 Bluett Dr, Smeaton Grange 2567 NSW Saving record CC/2021/1199/4 - 450 The Northern Rd, Oran Park 2570 NSW Saving record DA/2024/181/1 - 2 Bruchhauser Cres, Elderslie 2570 NSW Saving record OC/2023/569/2 - 12 Robert Ingham Dr, Catherine Field 2557 NSW Saving record CC/2018/1435/11 - 18 Charbray Loop, Oran Park 2570 NSW Saving record OC/2022/603/2 - 15 Rock Fern Ave, Cobbitty 2570 NSW Saving record OC/2023/681/1 - 65 Bluebell Cres, Spring Farm 2570 NSW Saving record OC/2023/682/1 - 4 Monash Ave, Gledswood Hills 2557 NSW Saving record OC/2022/934/2 - 75 Pluto Ave, Leppington 2179 NSW Saving record OC/2021/1596/2 - 127 Emerald Hills Bvd, Leppington 2179 NSW Saving record OC/2024/10128/1 - 204/3 Fordham Way, Oran Park 2570 NSW Saving record CDC/2024/10283/1 - 24 Barrett St, Gregory Hills 2557 NSW Saving record SC/2020/682/1 - 42 Podium Way, Oran Park 2570 NSW Saving record FIRE/2005/18/2 - 1/29A Hill St, Camden 2570 NSW Saving record S96/2022/616/4 - 112 Colonel Pye Dr, Cobbitty 2570 NSW Saving record DA/2024/169/1 - 2 Lentil St, Oran Park 2570 NSW Saving record CDC/2024/10270/1 - 27 Platypus St, Cobbitty 2570 NSW Saving record OC/2023/46/1 - 13 Acre St, Oran Park 2570 NSW Saving record DA/2024/171/1 - 44 Cawdor Farms Rd, Grasmere 2570 NSW Saving record CC/2024/68/2 - 42 Queen St, Narellan 2567 NSW Saving record CC/2016/1321/1 - 92 Cobbitty Rd, Cobbitty 2570 NSW Saving record OC/2022/2117/2 - 20 Wisteria Rise, Cobbitty 2570 NSW Saving record OC/2023/663/1 - 75 Lodges Rd, Elderslie 2570 NSW Saving record OC/2023/812/3 - 345 Bringelly Rd, Leppington 2179 NSW Saving record CDC/2024/10302/1 - 28 Old Hume Hwy, Camden 2570 NSW Saving record CDC/2024/10303/1 - 30 Old Hume Hwy, Camden 2570 NSW Saving record CDC/2024/10267/1 - 12 Freshwater Dr, Cobbitty 2570 NSW Saving record CDC/2024/10309/1 - 46 Starling St, Cobbitty 2570 NSW Saving record OC/2023/494/1 - 37 Thompson Rd, Oran Park 2570 NSW Saving record CC/2024/97/1 - 29 Possum St, Cobbitty 2570 NSW Saving record OC/2023/505/1 - 35 Thompson Rd, Oran Park 2570 NSW Saving record CDC/2023/29/2 - 26 Horizon Loop, Oran Park 2570 NSW Saving record OC/2020/617/3 - 22 Ingall Loop, Catherine Field 2557 NSW Saving record DA/2024/157/1 - 50 Raby Rd, Gledswood Hills 2557 NSW Saving record DA/2024/146/1 - 39-47 Lasso Rd, Gregory Hills 2557 NSW Saving record OC/2022/1096/1 - 25 Mansfield Cct, Gledswood Hills 2557 NSW Saving record CDC/2024/10297/1 - 103 Seaborn Ave, Oran Park 2570 NSW Saving record DA/2024/148/1 - 210 Springs Rd, Spring Farm 2570 NSW Saving record S96/2008/644/11 - 11 Elizabeth St, Camden 2570 NSW Saving record OC/2021/1242/4 - 10 Samphire St, Cobbitty 2570 NSW Saving record OC/2022/878/1 - 11 Horizon Loop, Oran Park 2570 NSW Saving record CDC/2024/10292/1 - 49 Mccall Ave, Camden South 2570 NSW Saving record CDC/2024/10293/1 - 59 Heartfruit Ave, Cobbitty 2570 NSW Saving record OC/2022/217/1 - 139 Olive Hill Dr, Cobbitty 2570 NSW Saving record OC/2021/829/2 - 5 Mckervey St, Catherine Field 2557 NSW Saving record SC/2021/1536/1 - 36 Stoneham Cct, Oran Park 2570 NSW Saving record DA/2024/158/1 - 33 Platypus St, Cobbitty 2570 NSW Saving record DA/2024/147/1 - 31 Fuyu St, Cobbitty 2570 NSW Saving record DA/2024/162/1 - 430 Oran Park Dr, Oran Park 2570 NSW Saving record DA/2024/152/1 - 10 Rowell Dr, Oran Park 2570 NSW Saving record DA/2024/166/1 - 41 Abidi St, Spring Farm 2570 NSW Saving record CC/2022/686/2 - 120-130 Lodges Rd, Elderslie 2570 NSW Saving record CDC/2024/10285/1 - 351 Oran Park Dr, Oran Park 2570 NSW camden: ERROR: Unknown value of determination type: Withdrawn/Cancelled- Council /app/lib/masterview_scraper/pages/detail.rb:226:in `scrape_new_version' /app/lib/masterview_scraper/pages/detail.rb:12:in `scrape' /app/lib/masterview_scraper.rb:112:in `block in scrape_api_period' /app/lib/masterview_scraper/get_applications_api.rb:23:in `block in scrape' *************************************************** Now retrying authorities which earlier had failures *************************************************** /app/lib/masterview_scraper/get_applications_api.rb:60:in `block in scrape_page' Collecting feed data for gympie... /app/lib/masterview_scraper/get_applications_api.rb:54:in `each' /app/lib/masterview_scraper/get_applications_api.rb:54:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:97:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Saving record 7.2024.1487.1 - 56-58 Sorensen Rd, Southside 4570 QLD Saving record 7.2024.1486.1 - 56-58 Sorensen Rd, Southside 4570 QLD Saving record 7.2024.1363.1 - 41 Penny Rd, East Deep Creek 4570 QLD Saving record 7.2024.1481.1 - 56-58 Sorensen Rd, Southside 4570 QLD Saving record 8.2024.1264.1 - 240 Schollick Rd, Woolooga 4570 QLD Saving record 7.2024.1467.1 - 2 Shields St, Gympie 4570 QLD Saving record 7.2024.1438.1 - 9H Mulcahy Tce, Gympie 4570 QLD Saving record 7.2024.1428.1 - Hyne St, Gympie 4570 QLD Saving record 8.2024.1349.1 - 131 Thomason Rd, Traveston 4570 QLD Saving record 8.2024.1351.1 - 16 Cooloola Dve, Rainbow Beach 4581 QLD Saving record 7.2024.1196.1 - 24 Langara Dve, Southside 4570 QLD Saving record 7.2024.1408.1 - 123 Eel Creek Rd, Southside 4570 QLD Saving record 7.2024.1195.1 - 30 Langara Dve, Southside 4570 QLD gympie: ERROR: Unknown value of determination type: Received /app/lib/masterview_scraper/pages/detail.rb:226:in `scrape_new_version' Collecting feed data for fraser_coast... /app/lib/masterview_scraper/pages/detail.rb:12:in `scrape' /app/lib/masterview_scraper.rb:112:in `block in scrape_api_period' /app/lib/masterview_scraper/get_applications_api.rb:23:in `block in scrape' /app/lib/masterview_scraper/get_applications_api.rb:60:in `block in scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:54:in `each' /app/lib/masterview_scraper/get_applications_api.rb:54:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:97:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' Collecting feed data for hawkesbury... fraser_coast: ERROR: 404 => Net::HTTPNotFound for https://pdonline.frasercoast.qld.gov.au/Modules/ApplicationMaster/default.aspx?page=found&1=10/04/2024&2=10/05/2024&4a=BPS%27,%27MC%27,%27OP%27,%27SB%27,%27MCU%27,%27ROL%27,%27OPWKS%27,%27QMCU%27,%27QRAL%27,%27QOPW%27,%27QDBW%27,%27QPOS%27,%27QSPS%27,%27QEXE%27,%27QCAR%27,%27ACA&6=F -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:153:in `scrape_url' /app/lib/masterview_scraper.rb:61:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' Collecting feed data for toowoomba... hawkesbury: ERROR: Failed to open TCP connection to datrack.hawkesbury.nsw.gov.au:443 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:153:in `scrape_url' /app/lib/masterview_scraper.rb:61:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' Collecting feed data for bundaberg... toowoomba: ERROR: SSL_connect returned=1 errno=0 state=SSLv3 read server certificate B: certificate verify failed (unable to get local issuer certificate) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `connect_nonblock' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `ssl_socket_connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:981:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:153:in `scrape_url' /app/lib/masterview_scraper.rb:61:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' Collecting feed data for wingecarribee... bundaberg: ERROR: Net::ReadTimeout /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:181:in `rbuf_fill' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:157:in `readuntil' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:167:in `readline' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:40:in `read_status_line' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:29:in `read_new' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1494:in `block in transport_request' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1491:in `catch' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1491:in `transport_request' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1464:in `request' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:891:in `block in request' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:606:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:1323:in `post_form' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:536:in `post' /app/lib/masterview_scraper/get_applications_api.rb:43:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:97:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' Collecting feed data for albury... wingecarribee: ERROR: Couldn't find table /app/lib/masterview_scraper/pages/index.rb:41:in `scrape' /app/lib/masterview_scraper.rb:165:in `scrape_url' /app/lib/masterview_scraper.rb:61:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' albury: ERROR: execution expired Collecting feed data for bogan... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' Collecting feed data for port_macquarie_hastings... bogan: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' Collecting feed data for port_stephens... port_macquarie_hastings: ERROR: end of file reached /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:189:in `rbuf_fill' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:157:in `readuntil' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:167:in `readline' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:40:in `read_status_line' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:29:in `read_new' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1494:in `block in transport_request' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1491:in `catch' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1491:in `transport_request' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1464:in `request' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:891:in `block in request' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:606:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' port_stephens: ERROR: execution expired Collecting feed data for camden... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' Saving record CDC/2024/10301/1 - 16 Furlong Dr, Currans Hill 2567 NSW Saving record OC/2023/638/1 - 80 Burrell Rd, Spring Farm 2570 NSW Saving record OC/2024/10307/1 - 53 Lillydale Ave, Gledswood Hills 2557 NSW Saving record CDC/2024/10307/1 - 53 Lillydale Ave, Gledswood Hills 2557 NSW Saving record CDC/2024/10305/1 - 33 Ellis Ln, Ellis Lane 2570 NSW Saving record CDC/2024/10306/1 - 96 Somervaille Dr, Catherine Field 2557 NSW Saving record OC/2023/186/1 - 4 Yarra Ave, Gregory Hills 2557 NSW Saving record OC/2023/344/1 - 6 Killen Pde, Catherine Field 2557 NSW Saving record OC/2023/350/2 - 28 Swift Ave, Leppington 2179 NSW Saving record OC/2023/816/1 - 49 Ballandean Bvd, Gledswood Hills 2557 NSW Saving record OC/2022/848/2 - 25 Evergreen Dr, Oran Park 2570 NSW Saving record S96/2022/991/2 - 67 Mcclymont Dr, Catherine Field 2557 NSW Saving record OC/2023/78/2 - 49 Ballandean Bvd, Gledswood Hills 2557 NSW Saving record S96/2023/672/2 - 33 Robert Ingham Dr, Catherine Field 2557 NSW Saving record OC/2022/857/2 - 83 Banfield Dr, Oran Park 2570 NSW Saving record SC/2021/96/1 - 21 Do_Not_Use St, Unknown 2570 NSW Saving record SC/2021/1453/1 - 650 The Northern Rd, Oran Park 2570 NSW Saving record OC/2021/1150/2 - 22 Cato Cct, Leppington 2179 NSW Saving record DA/2024/191/1 - 13 Chisholm Rd, Catherine Field 2557 NSW Saving record DA/2024/190/1 - 14 Myuna Pl, Camden South 2570 NSW Saving record DA/2024/188/1 - 2/45 Central Hills Dr, Gregory Hills 2557 NSW Saving record S96/1996/11/2 - 192 Cobbitty Rd, Cobbitty 2570 NSW Saving record DA/2024/186/1 - 26 Alma Rd, Leppington 2179 NSW Saving record DA/2024/189/1 - 49 Bowman Ave, Camden South 2570 NSW Saving record S96/2006/1264/5 - 1 Forestgrove Dr, Harrington Park 2567 NSW Saving record OC/2021/139/3 - 1 Meridian St, Leppington 2179 NSW Saving record OC/2023/275/1 - 12 Battam Rd, Gregory Hills 2557 NSW Saving record OC/2022/482/1 - 9 Menangle Rd, Camden 2570 NSW Saving record OC/2024/10136/1 - 351 Oran Park Dr, Oran Park 2570 NSW Saving record OC/2024/10218/1 - 33 Herd St, Oran Park 2570 NSW Saving record DA/2024/176/1 - 420 Oran Park Dr, Oran Park 2570 NSW Saving record DA/2024/178/1 - 90 Hillston Cct, Gregory Hills 2557 NSW Saving record S96/2022/628/2 - 420 Oran Park Dr, Oran Park 2570 NSW Saving record DA/2024/173/1 - 187A-187B Cawdor Rd, Cawdor 2570 NSW Saving record S96/2022/899/2 - 15 Grassbird Ave, Oran Park 2570 NSW Saving record DA/2024/183/1 - 3/151 Hartley Rd, Smeaton Grange 2567 NSW Saving record OC/2022/2053/2 - 60 Central Ave, Oran Park 2570 NSW Saving record DA/2024/182/1 - 7 Glenlee Ct, Narellan Vale 2567 NSW Saving record S96/2023/673/2 - 103 Hillston Cct, Gregory Hills 2557 NSW Saving record DA/2024/187/1 - 45 Southwell Rd, Oran Park 2570 NSW Saving record S96/2022/649/4 - 137 Heath Rd, Leppington 2179 NSW Saving record CC/2024/42/1 - 29 Callicoma St, Mount Annan 2567 NSW Saving record DA/2024/177/1 - 14 Clematis Pl, Mount Annan 2567 NSW Saving record DA/2024/180/1 - 11 Gleditsia Cl, Narellan Vale 2567 NSW Saving record S96/2023/17/2 - 189A Springfield Rd, Catherine Field 2557 NSW Saving record S96/2023/386/2 - 1 Bowerbird Loop, Oran Park 2570 NSW Saving record S96/2022/838/2 - 91 Central Ave, Oran Park 2570 NSW Saving record S96/2022/837/2 - 5 Mack Pl, Oran Park 2570 NSW Saving record OC/2018/1019/2 - 18 Bellingham St, Narellan 2567 NSW Saving record S96/2022/545/2 - 91 Central Ave, Oran Park 2570 NSW Saving record OC/2022/1082/2 - 105 Somervaille Dr, Catherine Field 2557 NSW Saving record CC/2024/184/1 - 17 Sultana Ave, Leppington 2179 NSW Saving record DA/2024/184/1 - 17 Sultana Ave, Leppington 2179 NSW Saving record DA/2024/175/1 - 650 The Northern Rd, Oran Park 2570 NSW Saving record SC/2021/1077/1 - 1395 Camden Valley Way, Leppington 2179 NSW Saving record OC/2023/102/2 - 167 Emerald Hills Bvd, Leppington 2179 NSW Saving record DA/2024/168/1 - 7 Burragorang Rd, Cawdor 2570 NSW Saving record SC/2020/264/2 - 21 Do_Not_Use St, Unknown 2570 NSW Saving record OC/2022/566/3 - 16 Peppercress Rdge, Leppington 2179 NSW Saving record OC/2021/1426/3 - 35 Swallow Loop, Oran Park 2570 NSW Saving record OC/2024/10086/1 - 21 Newmarket St, Currans Hill 2567 NSW Saving record OC/2022/950/2 - 64 Archer Rd, Spring Farm 2570 NSW Saving record S96/2022/544/2 - 91 Central Ave, Oran Park 2570 NSW Saving record S96/2023/423/2 - 50 Bowerbird Loop, Oran Park 2570 NSW Saving record S96/2023/6/2 - 91 Central Ave, Oran Park 2570 NSW Saving record S96/2011/96/2 - 192 Cobbitty Rd, Cobbitty 2570 NSW Saving record OC/2022/520/1 - 3 Funnell Cl, Camden South 2570 NSW Saving record DA/2024/170/1 - 92 Wainwright Dr, Cobbitty 2570 NSW Saving record DA/2024/179/1 - 49 Platypus St, Cobbitty 2570 NSW Saving record OC/2023/718/2 - 2/59 Smeaton Grange Rd, Smeaton Grange 2567 NSW Saving record S96/2023/470/2 - 1 Freshwater Dr, Cobbitty 2570 NSW Saving record DA/2024/172/1 - 3 Silky Oak Gr, Elderslie 2570 NSW Saving record DA/2024/174/1 - 22 Little St, Camden 2570 NSW Saving record CC/2022/285/2 - 23 Old Hume Hwy, Camden 2570 NSW Saving record S96/2006/1163/5 - 7 Iando Way, Currans Hill 2567 NSW Saving record EngCC/2021/1317/8 - 139 Turner Rd, Gregory Hills 2557 NSW Saving record DA/2024/185/1 - 45 Harrington St, Elderslie 2570 NSW Saving record FIRE/2018/9/2 - 2/13 Bluett Dr, Smeaton Grange 2567 NSW Saving record CC/2021/1199/4 - 450 The Northern Rd, Oran Park 2570 NSW Saving record DA/2024/181/1 - 2 Bruchhauser Cres, Elderslie 2570 NSW Saving record OC/2023/569/2 - 12 Robert Ingham Dr, Catherine Field 2557 NSW Saving record CC/2018/1435/11 - 18 Charbray Loop, Oran Park 2570 NSW Saving record OC/2022/603/2 - 15 Rock Fern Ave, Cobbitty 2570 NSW Saving record OC/2023/681/1 - 65 Bluebell Cres, Spring Farm 2570 NSW Saving record OC/2023/682/1 - 4 Monash Ave, Gledswood Hills 2557 NSW Saving record OC/2022/934/2 - 75 Pluto Ave, Leppington 2179 NSW Saving record OC/2021/1596/2 - 127 Emerald Hills Bvd, Leppington 2179 NSW Saving record OC/2024/10128/1 - 204/3 Fordham Way, Oran Park 2570 NSW Saving record CDC/2024/10283/1 - 24 Barrett St, Gregory Hills 2557 NSW Saving record SC/2020/682/1 - 42 Podium Way, Oran Park 2570 NSW Saving record FIRE/2005/18/2 - 1/29A Hill St, Camden 2570 NSW Saving record S96/2022/616/4 - 112 Colonel Pye Dr, Cobbitty 2570 NSW Saving record DA/2024/169/1 - 2 Lentil St, Oran Park 2570 NSW Saving record CDC/2024/10270/1 - 27 Platypus St, Cobbitty 2570 NSW Saving record OC/2023/46/1 - 13 Acre St, Oran Park 2570 NSW Saving record DA/2024/171/1 - 44 Cawdor Farms Rd, Grasmere 2570 NSW Saving record CC/2024/68/2 - 42 Queen St, Narellan 2567 NSW Saving record CC/2016/1321/1 - 92 Cobbitty Rd, Cobbitty 2570 NSW Saving record OC/2022/2117/2 - 20 Wisteria Rise, Cobbitty 2570 NSW Saving record OC/2023/663/1 - 75 Lodges Rd, Elderslie 2570 NSW Saving record OC/2023/812/3 - 345 Bringelly Rd, Leppington 2179 NSW Saving record CDC/2024/10302/1 - 28 Old Hume Hwy, Camden 2570 NSW Saving record CDC/2024/10303/1 - 30 Old Hume Hwy, Camden 2570 NSW Saving record CDC/2024/10267/1 - 12 Freshwater Dr, Cobbitty 2570 NSW Saving record CDC/2024/10309/1 - 46 Starling St, Cobbitty 2570 NSW Saving record OC/2023/494/1 - 37 Thompson Rd, Oran Park 2570 NSW Saving record CC/2024/97/1 - 29 Possum St, Cobbitty 2570 NSW Saving record OC/2023/505/1 - 35 Thompson Rd, Oran Park 2570 NSW Saving record CDC/2023/29/2 - 26 Horizon Loop, Oran Park 2570 NSW Saving record OC/2020/617/3 - 22 Ingall Loop, Catherine Field 2557 NSW Saving record DA/2024/157/1 - 50 Raby Rd, Gledswood Hills 2557 NSW Saving record DA/2024/146/1 - 39-47 Lasso Rd, Gregory Hills 2557 NSW Saving record OC/2022/1096/1 - 25 Mansfield Cct, Gledswood Hills 2557 NSW Saving record CDC/2024/10297/1 - 103 Seaborn Ave, Oran Park 2570 NSW Saving record DA/2024/148/1 - 210 Springs Rd, Spring Farm 2570 NSW Saving record S96/2008/644/11 - 11 Elizabeth St, Camden 2570 NSW Saving record OC/2021/1242/4 - 10 Samphire St, Cobbitty 2570 NSW Saving record OC/2022/878/1 - 11 Horizon Loop, Oran Park 2570 NSW Saving record CDC/2024/10292/1 - 49 Mccall Ave, Camden South 2570 NSW Saving record CDC/2024/10293/1 - 59 Heartfruit Ave, Cobbitty 2570 NSW Saving record OC/2022/217/1 - 139 Olive Hill Dr, Cobbitty 2570 NSW Saving record OC/2021/829/2 - 5 Mckervey St, Catherine Field 2557 NSW Saving record SC/2021/1536/1 - 36 Stoneham Cct, Oran Park 2570 NSW Saving record DA/2024/158/1 - 33 Platypus St, Cobbitty 2570 NSW Saving record DA/2024/147/1 - 31 Fuyu St, Cobbitty 2570 NSW Saving record DA/2024/162/1 - 430 Oran Park Dr, Oran Park 2570 NSW Saving record DA/2024/152/1 - 10 Rowell Dr, Oran Park 2570 NSW Saving record DA/2024/166/1 - 41 Abidi St, Spring Farm 2570 NSW Saving record CC/2022/686/2 - 120-130 Lodges Rd, Elderslie 2570 NSW Saving record CDC/2024/10285/1 - 351 Oran Park Dr, Oran Park 2570 NSW camden: ERROR: Unknown value of determination type: Withdrawn/Cancelled- Council /app/lib/masterview_scraper/pages/detail.rb:226:in `scrape_new_version' /app/lib/masterview_scraper/pages/detail.rb:12:in `scrape' /app/lib/masterview_scraper.rb:112:in `block in scrape_api_period' /app/lib/masterview_scraper/get_applications_api.rb:23:in `block in scrape' /app/lib/masterview_scraper/get_applications_api.rb:60:in `block in scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:54:in `each' /app/lib/masterview_scraper/get_applications_api.rb:54:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:97:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' scraper.rb:43:in `<main>': There were errors with the following authorities: [:gympie, :fraser_coast, :hawkesbury, :toowoomba, :bundaberg, :wingecarribee, :albury, :bogan, :port_macquarie_hastings, :port_stephens, :camden]. See earlier output for details (RuntimeError)

Data

Downloaded 72 times by dcalde AndreM101 muzzie86 jamasalbertastash

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (18 MB) Use the API

rows 10 / 46953

council_reference address description info_url date_scraped date_received authority_label
10-2021-16-1
2 Angus St, Forbes 2871 NSW
New Garages/Sheds - Industrial
2021-03-16
2021-02-22
forbes
10-2021-15-1
613 Wongajong Rd, Forbes 2871 NSW
New Single Dwelling
2021-03-16
2021-02-18
forbes
10-2021-13-1
1829 Lachlan Valley Wy, Jemalong 2871 NSW
New Single Dwelling
2021-03-16
2021-02-15
forbes
10-2021-14-1
131A Wambat St, Forbes 2871 NSW
New Ancillary Residential Development - Shed
2021-03-16
2021-02-16
forbes
10-2017-80-3
33-37 Sam St, Forbes 2871 NSW
New Commercial Building
2021-03-16
2021-03-03
forbes
10-2021-19-1
36A William St, Forbes 2871 NSW
Patio Cover
2021-03-16
2021-03-05
forbes
10-2021-20-1
2 Rae St, Forbes 2871 NSW
New Ancillary Residential Development-Shed/Carport
2021-03-16
2021-03-05
forbes
10-2021-18-1
12 Acacia Ave, Forbes 2871 NSW
New Ancillary Residential Development-Shed
2021-03-16
2021-03-02
forbes
10-2021-17-1
10 Thelma St, Forbes 2871 NSW
New Ancillary Residential Development - Shed
2021-03-16
2021-03-02
forbes
10-2021-1-1
Ooma St, Forbes 2871 NSW
Ancillary Residential Development - Awning
2021-03-16
2021-02-25
forbes

Statistics

Average successful run time: about 7 hours

Total run time: about 2 months

Total cpu time used: about 4 hours

Total disk space used: 144 MB

History

  • Auto ran revision 028c1c13 and failed .
    353 records added, 342 records removed in the database
  • Auto ran revision 028c1c13 and failed .
    361 records added, 326 records removed in the database
  • Auto ran revision 028c1c13 and failed .
    295 records added, 278 records removed in the database
  • Auto ran revision 028c1c13 and failed .
    345 records added, 309 records removed in the database
  • Auto ran revision 028c1c13 and failed .
    229 records added, 209 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

multiple_masterview / scraper.rb