StashProperty / multiple_masterview

Scrapes multiple authorities that have a masterview system


This is a scraper that runs on Morph. To get started see the documentation

To run the scraper

bundle exec ruby scraper.rb

To run the tests

bundle exec rake

To run style and coding checks

bundle exec rubocop

What a Masterview website looks like

Sign up

(To update this screenshot run bundle exec rake screenshots)

Contributors mlandauer AndreM101 njenkins

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Scraping authorities: gunnedah, maranoa, broken_hill, gympie, fairfield, fraser_coast, hawkesbury, toowoomba, bundaberg, wingecarribee, albury, bogan, lismore, port_macquarie_hastings, port_stephens, singleton, camden Collecting feed data for gunnedah... Collecting feed data for maranoa... gunnedah: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Saving record 30 - 2020 - 20082 - 3 - 31 Duke St, Roma 4455 QLD Saving record 22 - 2024 - 21350 - 1 - 101 Raglan St, Roma 4455 QLD Saving record 22 - 2024 - 21349 - 1 - 27 Charles St, Roma 4455 QLD Saving record 22 - 2024 - 21348 - 1 - 11 Timbury St, Roma 4455 QLD Saving record 22 - 2024 - 21347 - 1 - 43 Howard St, Roma 4455 QLD Saving record 22 - 2024 - 21346 - 1 - 32-34 Wormwell Dr, Roma 4455 QLD Saving record 22 - 2024 - 21345 - 1 - 37 William St, Roma 4455 QLD Saving record 30 - 2024 - 21340 - 1 - 25 Airport Dr, Roma 4455 QLD maranoa: ERROR: Net::ReadTimeout /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:181:in `rbuf_fill' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:157:in `readuntil' Collecting feed data for broken_hill... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:167:in `readline' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:40:in `read_status_line' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:29:in `read_new' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1494:in `block in transport_request' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1491:in `catch' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1491:in `transport_request' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1464:in `request' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:891:in `block in request' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:606:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:104:in `block in scrape_api_period' /app/lib/masterview_scraper/get_applications_api.rb:23:in `block in scrape' /app/lib/masterview_scraper/get_applications_api.rb:60:in `block in scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:54:in `each' /app/lib/masterview_scraper/get_applications_api.rb:54:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:97:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Saving record 10 - 2024 - 109 - 1 - 389 Oxide St, Broken Hill NSW 2880 Saving record 10 - 2024 - 103 - 1 - 13 Picton St, Broken Hill NSW 2880 Saving record 10 - 2024 - 105 - 1 - 83 Piper St, Broken Hill NSW 2880 Saving record 10 - 2020 - 24 - 4 - 14 Kanandah Rd, Broken Hill NSW 2880 Saving record 10 - 2024 - 108 - 1 - 1 Hynes St, Broken Hill NSW 2880 Saving record 10 - 2024 - 107 - 1 - 550 Rhodonite St, Broken Hill NSW 2880 Saving record 10 - 2024 - 104 - 1 - 252 Argent St, Broken Hill NSW 2880 Saving record 10 - 2024 - 101 - 1 - 343 Blende St, Broken Hill NSW 2880 Saving record 10 - 2024 - 100 - 1 - 244 Jamieson St, Broken Hill NSW 2880 Saving record 10 - 2024 - 106 - 1 - 472 Cummins Lane, Broken Hill NSW 2880 Saving record 10 - 2024 - 102 - 1 - Mann St, Broken Hill NSW 2880 Saving record 10 - 2024 - 96 - 1 - 121 Bagot St, Broken Hill NSW 2880 Collecting feed data for gympie... Saving record 15.2024.3932.1 - 3 Imbil Island Rd, Imbil 4570 QLD Saving record 7.2024.3931.1 - 5 Heritage La, Southside 4570 QLD Saving record 7.2024.3930.1 - 5 Heritage La, Southside 4570 QLD Saving record 7.2024.3929.1 - 5 Heritage La, Southside 4570 QLD Saving record 7.2024.3928.1 - 5 Heritage La, Southside 4570 QLD Saving record 7.2024.3927.1 - 5 Heritage La, Southside 4570 QLD Saving record 15.2024.3802.1 - Mooloo Rd, Pie Creek 4570 QLD Saving record 7.2024.3817.1 - 2 Boambillee Cct, Cooloola Cove 4580 QLD Saving record 8.2024.3851.1 - 15 Canina Rd, Canina 4570 QLD Saving record 8.2024.3849.1 - 358 Bular Rd, Kilkivan 4600 QLD Saving record 8.2024.3824.1 - Heights Dve, Gympie 4570 QLD Saving record 15.2024.3824.1 - Heights Dve, Gympie 4570 QLD Saving record 8.2024.3796.1 - 314 Chatsworth Rd, Two Mile 4570 QLD Saving record 7.2024.3797.1 - 38 Esplanade, Tin Can Bay 4580 QLD Saving record 7.2024.3755.1 - 75 Mellor St, Gympie 4570 QLD Saving record 8.2024.3821.1 - 55 Henry St, Gympie 4570 QLD Saving record 7.2024.3799.1 - 9 Maiden Crst, Southside 4570 QLD Saving record 15.2024.3704.1 - 46-48 Wickham St, Gympie 4570 QLD Saving record 8.2024.3798.1 - 83 Eitmann Cl, Curra 4570 QLD Saving record 7.2024.3798.1 - 83 Eitmann Cl, Curra 4570 QLD Saving record 22.2019.4497.3 - 173-175 Old Maryborough Rd, Araluen 4570 QLD Saving record 7.2024.3744.1 - Collard Rd, Mooloo 4570 QLD Saving record 15.2024.3764.1 - Meridian Tce, Gympie 4570 QLD Saving record 8.2024.3725.1 - 189 Old Maryborough Rd, Araluen 4570 QLD Saving record 8.2024.3707.1 - Thornside Rd, Widgee 4570 QLD Saving record 8.2024.3647.1 - 2549 Gympie Woolooga Rd, Widgee 4570 QLD Collecting feed data for fairfield... fairfield: ERROR: Couldn't find table Collecting feed data for fraser_coast... /app/lib/masterview_scraper/pages/index.rb:41:in `scrape' /app/lib/masterview_scraper.rb:165:in `scrape_url' /app/lib/masterview_scraper.rb:61:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Collecting feed data for hawkesbury... fraser_coast: ERROR: SSL_connect returned=1 errno=0 state=SSLv3 read server certificate B: certificate verify failed (unable to get local issuer certificate) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `connect_nonblock' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `ssl_socket_connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:981:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:153:in `scrape_url' /app/lib/masterview_scraper.rb:61:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Collecting feed data for toowoomba... hawkesbury: ERROR: Failed to open TCP connection to datrack.hawkesbury.nsw.gov.au:443 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:153:in `scrape_url' /app/lib/masterview_scraper.rb:61:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Collecting feed data for bundaberg... toowoomba: ERROR: SSL_connect returned=1 errno=0 state=SSLv3 read server certificate B: certificate verify failed (ok) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `connect_nonblock' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `ssl_socket_connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:981:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:153:in `scrape_url' /app/lib/masterview_scraper.rb:61:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Collecting feed data for wingecarribee... bundaberg: ERROR: 403 => Net::HTTPForbidden for https://da.bundaberg.qld.gov.au/ -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Collecting feed data for albury... wingecarribee: ERROR: Failed to open TCP connection to datracker.wsc.nsw.gov.au:443 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:153:in `scrape_url' /app/lib/masterview_scraper.rb:61:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Collecting feed data for bogan... albury: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' bogan: ERROR: execution expired Collecting feed data for lismore... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Saving record 5.2023.255.3 - 83 Magellan St, Lismore NSW 2480 Saving record 5.2024.330.1 - 3 Dawson St, Lismore NSW 2480 Saving record 5.2024.329.1 - 1001 Dunoon Rd, Modanville NSW 2480 Saving record 5.2024.322.1 - 28 Spurfield Rd, Mcleans Ridges NSW 2480 Saving record 5.2024.319.1 - 60 Gaden Rd, Numulgi NSW 2480 Collecting feed data for port_macquarie_hastings... lismore: ERROR: Unexpected field in: Determination Type: /app/lib/masterview_scraper/pages/detail.rb:198:in `block in extract_decision_block' /app/lib/masterview_scraper/pages/detail.rb:189:in `each' /app/lib/masterview_scraper/pages/detail.rb:189:in `extract_decision_block' /app/lib/masterview_scraper/pages/detail.rb:209:in `scrape_new_version' /app/lib/masterview_scraper/pages/detail.rb:12:in `scrape' /app/lib/masterview_scraper.rb:112:in `block in scrape_api_period' /app/lib/masterview_scraper/get_applications_api.rb:23:in `block in scrape' /app/lib/masterview_scraper/get_applications_api.rb:60:in `block in scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:54:in `each' /app/lib/masterview_scraper/get_applications_api.rb:54:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:97:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Collecting feed data for port_stephens... port_macquarie_hastings: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Collecting feed data for singleton... port_stephens: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Saving record 10.2024.263.1 - 38 Barton Ave, Singleton NSW 2330 Saving record 12.2024.101.1 - 9 Pin Oak Cct, Branxton NSW 2335 Saving record 8.2023.588.3 - 60 Wilkinson Bvd, Hunterview NSW 2330 Saving record 8.2024.332.1 - 97 Dimmock St, Hunterview NSW 2330 Saving record 15.2024.67.1 - 74C Range Rd, Whittingham NSW 2330 Saving record 15.2021.58.2 - 251 Putty Rd, Glenridding NSW 2330 Saving record 10.2024.275.1 - 92 Casey Dr, Hunterview NSW 2330 Saving record 10.2024.231.1 - 4A Lester Cl, Wattle Ponds NSW 2330 Saving record 12.2024.25.1 - 126 John St, Singleton NSW 2330 Saving record 8.2024.318.1 - 15 Radford Pwy, Branxton NSW 2335 Saving record 8.2024.330.1 - 9 Maybon Cl, Branxton NSW 2335 Saving record 8.2022.226.3 - 29 Green Gr, Sedgefield NSW 2330 Saving record 8.2024.319.1 - 112 Brigadier Hammett Rd, Wattle Ponds NSW 2330 Saving record 8.2024.11.2 - 169 Springvale Rd, Elderslie NSW 2335 Saving record 12.2023.596.1 - 5 Adair St, Broke NSW 2330 Saving record 8.2024.316.1 - 12 Radford Pwy, Branxton NSW 2335 Saving record 10.2024.269.1 - 6 Sister Luke Pl, Singleton Heights NSW 2330 Saving record 10.2024.228.1 - 6 St Davids Cl, Gowrie NSW 2330 Saving record 10.2024.229.3 - 3 Dangar Rd, Singleton NSW 2330 Saving record 9.2024.57.1 - 2 Dawson St, Camberwell NSW 2330 Saving record 9.2024.56.1 - 1-3 Powditch St, Camberwell NSW 2330 Saving record 10.2024.65.1 - 25 Doyle St, Jerrys Plains NSW 2330 Saving record 8.2024.328.1 - 29 John St, Singleton NSW 2330 Saving record 10.2019.73.1 - 345 Milbrodale Rd, Fordwich NSW 2330 Saving record 15.2024.66.1 - 694A Hermitage Rd, Pokolbin NSW 2320 Saving record 8.2008.177.2 - 453 Glendon Lane, Mitchells Flat NSW 2330 Saving record 12.2022.349.1 - 30 Dimmock St, Hunterview NSW 2330 Saving record 12.2023.457.1 - 11 Pistacia Gr, Branxton NSW 2335 Saving record 8.2024.314.1 - 42 Robertson Cct, Sedgefield NSW 2330 Saving record 10.2024.291.1 - 7 Maybon Cl, Branxton NSW 2335 Saving record 12.2024.13.1 - 7 Claret Ave, Branxton NSW 2335 Saving record 12.2023.53.1 - 34 Wattle Ponds Rd, Hunterview NSW 2330 Saving record 8.2024.320.1 - 111 Old Carrowbrook Rd, Mount Olive NSW 2330 Saving record 8.2024.322.1 - 1 Barton Ave, Singleton NSW 2330 Saving record 12.2023.528.1 - 36 Partridge Pl, Singleton Heights NSW 2330 Saving record 12.2023.553.1 - 758 Elderslie Rd, Elderslie NSW 2335 Saving record 9.2024.55.1 - 14 Rawcliffe St, Singleton NSW 2330 Saving record 9.2024.54.1 - 24 Mcinerney Rd, Camberwell NSW 2330 Saving record 12.2024.50.1 - 1 Gowrie St, Singleton NSW 2330 singleton: ERROR: Unexpected field in: Determination Type: Collecting feed data for camden... /app/lib/masterview_scraper/pages/detail.rb:198:in `block in extract_decision_block' /app/lib/masterview_scraper/pages/detail.rb:189:in `each' /app/lib/masterview_scraper/pages/detail.rb:189:in `extract_decision_block' /app/lib/masterview_scraper/pages/detail.rb:209:in `scrape_new_version' /app/lib/masterview_scraper/pages/detail.rb:12:in `scrape' /app/lib/masterview_scraper.rb:112:in `block in scrape_api_period' /app/lib/masterview_scraper/get_applications_api.rb:23:in `block in scrape' /app/lib/masterview_scraper/get_applications_api.rb:60:in `block in scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:54:in `each' /app/lib/masterview_scraper/get_applications_api.rb:54:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:97:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' *************************************************** Now retrying authorities which earlier had failures *************************************************** camden: ERROR: 765: unexpected token at '<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd"> <html lang="en-US"> Collecting feed data for gunnedah... <head> <meta http-equiv="X-UA-Compatible" content="IE=edge" /> <meta http-equiv="Content-Type" content="text/html; charset=UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1, maximum-scale=1" /> <title> Authority e-Services - live </title> <link rel="stylesheet" href="/eservice/library/bootstrap-3.4.1.min.css" type="text/css" media="screen, projection, print" > <link rel="stylesheet" href="/eservice/library/jquery-ui.min.css" type="text/css" media="screen, projection, print" > <link rel="stylesheet" href="/eservice/library/jquery-ui.structure.min.css" type="text/css" media="screen, projection, print" > <link rel="stylesheet" href="/eservice/library/jquery-ui.theme.min.css" type="text/css" media="screen, projection, print" > <link rel="stylesheet" href="/eservice/library/e-services.css" type="text/css" media="screen, projection, print" > <link rel="stylesheet" href="/eservice/library/calendar.css" type="text/css" media="screen, projection, print" > <link rel="stylesheet" href="/eservice/library/daEnquiry_daEnquiry.css" id="pagecss" type="text/css" media="screen, projection" > <link rel="stylesheet" href="/eservice/library/e-print.css" type="text/css" media="print" > <link rel="stylesheet" href="/eservice/library/header-eserv.css" type="text/css" media="screen, projection, print" > <link rel="stylesheet" href="/council/eservice/custom.css" type="text/css" media="screen, projection, print" > <script>var AUTHJS = {};AUTHJS.productName = "i-Services";</script> <script type="text/javascript" src="/eservice/jscalendar-1.0/calendar.js"></script> <script type="text/javascript" src="/eservice/javascript/jquery/jquery-3.6.0.min.js"></script> <script>AUTHJS.productName = "e-Services";</script> <script type="text/javascript" src="/eservice/javascript/tether-1.3.3.js"></script> <script type="text/javascript" src="/eservice/javascript/modernizr-283.min.js"></script> <script type="text/javascript" src="/eservice/javascript/jquery/bootstrap-3.4.1.js"></script> <script type="text/javascript" src="/eservice/javascript/jquery/jquery-ui.min.js"></script> <script type="text/javascript" src="/eservice/javascript/e-services-page.js"></script> <script type="text/javascript" src="/eservice/javascript/prototype.js"></script> <script type="text/javascript" src="/eservice/javascript/civica.jquery.plugins.js"></script> <script type="text/javascript" src="/eservice/javascript/civica.common.init.js"></script> <script type="text/javascript" src="/eservice/javascript/civica.jquery.functions.js"></script> <script type="text/javascript" src="/eservice/javascript/util.js"></script> <script type="text/javascript" src="/eservice/javascript/json2.js"></script> <script type="text/javascript" src="/eservice/javascript/effects.js"></script> <script type="text/javascript" src="/eservice/javascript/controls.js"></script> <script type="text/javascript" src="/eservice/javascript/dragdrop.js"></script> <script type="text/javascript" src="/eservice/javascript/lightbox.js"></script> <script type="text/javascript" src="/eservice/javascript/menu.js"></script> <script type="text/javascript" src="/eservice/javascript/menuScroll.js"></script> <script type="text/javascript" src="/eservice/javascript/sitemap.js"></script> <script type="text/javascript" src="/eservice/javascript/jquery.imageTickBox.js"></script> <script type="text/javascript" src="/eservice/javascript/jquery.metadata.js"></script> <script type="text/javascript" src="/eservice/javascript/jquery/jquery.form-3.46.0.js"></script> <link rel="shortcut icon" href="/favicon.ico" /> <script src="/eservice/javascript/da.js" type="text/javascript"></script> <script src="/eservice/javascript/mkTree.js" type="text/javascript"></script> </head> <body > <script type="text/javascript"> var initialTabPage= "null"; jQuery(document).ready(function() { if (initialTabPage != "null") { if (initialTabPage=="sitemap"){ initialTabPage="#sitemap-controller"; } else { initialTabPage="#dashboard-controller"; } jQuery(initialTabPage + " a.tab-clicker").not(".tabs-content *").click(); } }); (function() { var isBootstrapEvent = false; if (window.jQuery) { var all = jQuery('*'); jQuery.each(['hide.bs.dropdown', 'hide.bs.collapse', 'hide.bs.modal', 'hide.bs.tooltip', 'hide.bs.popover', 'hide.bs.tab'], function(index, eventName) { all.on(eventName, function( event ) { isBootstrapEvent = true; }); }); } var originalHide = Element.hide; Element.addMethods({ hide: function(element) { if(isBootstrapEvent) { isBootstrapEvent = false; return element; } return originalHide(element); } }); })(); </script> <!-- eServices --> <div id="page" class=" tabbed not-logged-in"> <div id="masthead" class="navbar navbar-static-top bs-docs-nav"> <div class="container" id="masthead-container"> <div class="navbar-header"> <a class="navbar-brand"> <span>e-Services</span> Camden Council </a> </div> <!-- masthead Quicklinks start --> <div id="wrapper-quick-links"> <ul id="quick-links" class="nav navbar-nav navbar-right"> <li class="top-link-home"> <a href="/eservice/navigationStart.do" id="quick-link-home"> Home </a> </li> <li class="top-link-signin"> <a href="/eservice/logonInit.do" id="quick-link-signin"> Sign In </a> </li> <li class="top-link-user"> <a> <!-- masthead User start --> You are a Guest <!-- masthead User end --> </a> </li> </ul> </div> <!-- masthead Quicklinks end --> </div> <!-- End container --> </div> <!-- End Masthead --> <!-- End Masthead navbar --> <div id="content"> <div class="container" id="content-container"> <div class="row" id="main-row"> <div class="col-sm-3" id="bstrap-leftnav"> <div id="search-results" > </div> <div id="admin-tabs" > <div id="dashboard" class="tabs-content"> <!-- START MENU CONTENT --> <div id="menus-toggle"> <div id="menus-button" class="btn btn-default"> <span id="menus-button-inner"> <a id="menus-button-link" href="#">Hide Menus</a> </span> </div> <div id="site-access" class="menu-on"> <ul id="siteaccesspanel"> <li id="siteaccesspanel_1"> <div class="menu-group"> <div class="menu-header-panel" title="Drag to change panel order"> <h3 class="panel-handle">Menu</h3> </div> <p class="menu-handlers"> <a href="/eservice/menu/minimisePanel.do?id=1" title="Minimise Panel" class="panel-min-max" id="panel-min-max-1" > <img src="/eservice/icons/minimise.gif" alt="Minimise" /> </a> </p> <div id="menu-search"> <form action="/eservice/menu/search.do" class="menu-search-form"> <p> <input type="text" size="15" name="search" id="search" class="field" value="Menu Search" /> <input type="submit" id="menu-search-submit" value="Go" class="buttonCalendar" /> <img src="/eservice/icons/loading.gif" alt="loading" class="loading" id="menu-search-loading" /> </p> <!-- div id="search-autocomplete" class="autocompleter"></div --> </form> <div id="search-results" > </div> </div> <div id="scrollingMenuContainer" class="scrolling-container"> <ul id="navigation"> <li class="nav-return" title="Back one menu level"><a href="/eservice/navigationStart.do" id="node-0"><img src="/eservice/icons/parent.gif" alt="Return to " />Applications</a></li> <li class='java'> <a href="/eservice/daEnquiryInit.do?doc_typ=10&nodeNum=3374010" class="linkitem" id="node-3374010">Development Application</a> </li> <li class='java'> <a href="/eservice/daEnquiry/currentlyAdvertised.do?nodeNum=3374975" class="linkitem" id="node-3374975">On Exhibition</a> </li> <li class='java'> <a href="/eservice/daEnquiry/recentlySubmitted.do?rangeType=M&rangeFrom=1&rangeTo=0&nodeNum=3374985" class="linkitem" id="node-3374985">Recently Submitted</a> </li> <li class='java'> <a href="/eservice/daEnquiry/recentlyDetermined.do?num_days=30&nodeNum=3374976" class="linkitem" id="node-3374976">Recently Determined</a> </li> <li class='java'> <a href="/eservice/daEnquiryInit.do?doc_typ=12&nodeNum=3374979" class="linkitem" id="node-3374979">Complying Development Certificate</a> </li> <li class='java'> <a href="/eservice/daEnquiryInit.do?doc_typ=11&nodeNum=3374980" class="linkitem" id="node-3374980">Construction Certificate</a> </li> <li class='java'> <a href="/eservice/daEnquiryInit.do?doc_typ=14&nodeNum=3374982" class="linkitem" id="node-3374982">Subdivision Certificate</a> </li> <li class='java'> <a href="/eservice/daEnquiryInit.do?doc_typ=13&nodeNum=3374986" class="linkitem" id="node-3374986">Occupation Certificate</a> </li> <li class='java'> <a href="/eservice/daEnquiryInit.do?doc_typ=16&nodeNum=3374987" class="linkitem" id="node-3374987">Engineering Construction</a> </li> <li class='java'> <a href="/eservice/daEnquiryInit.do?doc_typ=100&nodeNum=3374981" class="linkitem" id="node-3374981">Tree Development Application</a> </li> <li class='java'> <a href="/eservice/daEnquiryInit.do?doc_typ=27&nodeNum=3374011" class="linkitem" id="node-3374011">Fire Safety Schedule</a> </li> </ul> </div> </div> </li> <li id="siteaccesspanel_3"> <div class="menu-group"> <div class="menu-header-panel" title="Drag to change panel order"> <h3 class="panel-handle">History</h3> </div> <p class="menu-handlers"> <a href="/eservice/menu/movePanel.do?id=2" title="Panel Up" class="panel-up"> <img src="/eservice/icons/panel_move_up.gif" alt="Up" /></a> <a href="/eservice/menu/minimisePanel.do?id=2" title="Minimise Panel" class="panel-min-max" id="panel-min-max-2" > <img src="/eservice/icons/minimise.gif" alt="Minimise" /> </a> </p> <ul id="recently-used"> <li id="recently-used-0"> <a href="/eservice/daEnquiryInit.do?doc_typ=10&nodeNum=3374010" class="linkitem">Development Application</a> </li> </ul> </div> </li> </ul> <script type="text/javascript"> //Drag n Drop panels Sortable.create('siteaccesspanel', {handle: 'panel-handle', onUpdate:function(){new Ajax.Request(webContextPath + '/resequencePanels.do', {method: 'post', parameters:Sortable.serialize('siteaccesspanel')})}}); </script> <p id="scroll-trigger">15</p> <p id="alternate-scroll-trigger"></p> <p id="pixel-height-base-rate-for-list-item">24</p> </div> </div> </div> </div> </div> <div class="col-sm-9" id="bstrap-main"> <div id="main-content"> <div class="transaction-area" id="transaction-area"></div> <!-- END MENU CONTENT --> <div class="unique-content" id="daEnquiry_daEnquiry"> <div class="daEnquirySpecific" id="daEnquiry_daEnquiryDocumentType10"> <h1> Development Application Enquiry </h1> <div id="leftcontent"> <div class="infopanel"> <!-- CIVICA-INFO-START --> <div id="infopanel-header"> <h4 class="entryHeader" > Instructions </h4> </div> <div id="instructions-content" class="instructions"> <p>Enter some search criteria and select Search. If the search you entered does not yield any results, try broadening the search.</p> <p>When searching by the number, please enter the application number followed by the year, as in the example below.</p> </div> <!-- CIVICA-INFO-END --> </div> </div> <div id="rightcontent"> <div class="bodypanel" id="bodypanel1"> <!-- CIVICA-CONTENT-START:bodypanel1 --> <h2 > Details </h2> <?xml version="1.0" encoding="UTF-8"?> <div> <form action="daEnquiry.do" id="daEnquiryForm" name="daEnquiryForm" class="form-horizontal"> <div class="form-group"> <label class="col-sm-2 control-label">DA Number</label> <div class="col-sm-10"> <input type="text" class="text-medium" name="number" id="DANumber" size="10" maxlength="10" errors="DANumber" value="" /> <span class="subText">eg 121/2023</span> </div> </div> <p /> <p class="rowDataOnly"> <span class="rowInfo"> <strong>OR</strong> use any of the following search fields: </span> </p> <p> &nbsp; </p> <h2>Lodgement Date</h2> <div class="form-group" style="margin-bottom:2em; border:none; padding:0"> <div class="form-group" style="margin-bottom:2em"> <label class="radio-inline control-label control-radio" style="margin-left:10px"> <input type="radio" name="lodgeRangeType" id="lodgeRangeType" onclick="javascript:setDateRange('', '', 'DADateFrom', 'DADateTo')" /> Specified Range </label> <label class="radio-inline control-label control-radio"> <input type="radio" name="lodgeRangeType" id="lodgeRangeType" onclick="javascript:setDateRange('22/12/2024','26/12/2024', 'DADateFrom', 'DADateTo')" /> This Week </label> <label class="radio-inline control-label control-radio"> <input type="radio" name="lodgeRangeType" id="lodgeRangeType" onclick="javascript:setDateRange('15/12/2024','21/12/2024', 'DADateFrom', 'DADateTo')" /> Last Week </label> <label class="radio-inline control-label control-radio"> <input type="radio" name="lodgeRangeType" id="lodgeRangeType" onclick="javascript:setDateRange('01/12/2024','31/12/2024', 'DADateFrom', 'DADateTo')" /> This Month </label> <label class="radio-inline control-label control-radio"> <input type="radio" name="lodgeRangeType" id="lodgeRangeType" onclick="javascript:setDateRange('01/11/2024','30/11/2024', 'DADateFrom', 'DADateTo')" /> Last Month </label> </div> </div> <div class="form-group"> <div id="DADate"> <label class="col-sm-2 control-label" for="DADateFrom" id="daFromDateLabel">From</label> <div class="form-inline col-sm-10"> <input type="text" class="datepick text-small form-control" name="dateFrom" id="DADateFrom" style="padding-right: 0px" size="10" maxlength="10" errors="DADateFrom" value="" /> <label for="DADateTo" id="daToDateLabel">To</label> <input type="text" class="datepick text-small form-control" name="dateTo" id="DADateTo" style="padding-right: 0px" size="10" maxlength="10" errors="DADateTo" value="" /> </div> </div> </div> <h2>Determination Date</h2> <div class="form-group" style="margin-bottom:2em; border:none; padding:0"> <div class="form-group" style="margin-bottom:2em"> <label class="radio-inline control-label control-radio" style="margin-left:10px"> <input type="radio" name="detRangeType" id="detRangeType" onclick="javascript:setDateRange('','', 'detDateFromString', 'detDateToString')" /> Specified Range </label> <label class="radio-inline control-label control-radio"> <input type="radio" name="detRangeType" id="detRangeType" onclick="javascript:setDateRange('22/12/2024','26/12/2024', 'detDateFromString', 'detDateToString')" /> This Week </label> <label class="radio-inline control-label control-radio"> <input type="radio" name="detRangeType" id="detRangeType" onclick="javascript:setDateRange('15/12/2024','21/12/2024', 'detDateFromString', 'detDateToString')" /> Last Week </label> <label class="radio-inline control-label control-radio"> <input type="radio" name="detRangeType" id="detRangeType" onclick="javascript:setDateRange('01/12/2024','31/12/2024', 'detDateFromString', 'detDateToString')" /> This Month </label> <label class="radio-inline control-label control-radio"> <input type="radio" name="detRangeType" id="detRangeType" onclick="javascript:setDateRange('01/11/2024','30/11/2024', 'detDateFromString', 'detDateToString')" /> Last Month </label> </div> </div> <div class="form-group"> <div id="DetDate"> <label class="col-sm-2 control-label" for="detDateFrom" id="detFromDateLabel">From</label> <div class="form-inline col-sm-10" id="detDateFromInput"> <input type="text" class="datepick text-small form-control" name="detDateFrom" id="detDateFromString" style="padding-right: 0px" size="10" maxlength="10" errors="detDateFrom" value="" /> <label for="detDateTo" id="detToDateLabel">To</label> <input type="text" class="datepick text-small form-control" name="detDateTo" id="detDateToString" style="padding-right: 0px" size="10" maxlength="10" errors="detDateTo" value="" /> </div> </div> </div> <h2>Property Details</h2> <div class="form-group" id="streetNameRow"> <label class="control-label col-sm-2" for="streetName">Street Name</label> <div class="col-sm-10"> <input type="text" class="text-large" name="streetName" id="streetName" size="20" onblur="javascript:getHouseNum(); javascript:getSuburb()" value="" /> <div id="streetHints" class="autocompleter"> &nbsp; </div> </div> </div> <div class="form-group" id="suburbDropdownRow"> <label class="control-label col-sm-2" for="suburb">Suburb</label> <div class="col-sm-10"> <div id="suburbSelect"> <select class="select-medium" name="suburb" id="suburb"> <option value="0" selected="selected">- -None Selected- -</option> <option value="2">BICKLEY VALE</option> <option value="1">BRINGELLY</option> <option value="3">CAMDEN</option> <option value="8">CAMDEN SOUTH</option> <option value="4">CATHERINE FIELD</option> <option value="7">CAWDOR</option> <option value="6">COBBITTY</option> <option value="5">CURRANS HILL</option> <option value="9">ELDERSLIE</option> <option value="10">ELLIS LANE</option> <option value="23">GLEDSWOOD HILLS</option> <option value="11">GRASMERE</option> <option value="22">GREGORY HILLS</option> <option value="12">HARRINGTON PARK</option> <option value="13">KIRKHAM</option> <option value="14">LEPPINGTON</option> <option value="24">LEPPINGTON</option> <option value="15">MOUNT ANNAN</option> <option value="16">NARELLAN</option> <option value="17">NARELLAN VALE</option> <option value="18">ORAN PARK</option> <option value="19">ROSSMORE</option> <option value="21">SMEATON GRANGE</option> <option value="20">SPRING FARM</option> <option value="99">UNKNOWN</option> </select> </div> </div> </div> <div class="form-group" id="unitNumberRow"> <label class="control-label col-sm-2" for="unitNum">Unit</label> <div class="col-sm-10"> <input type="text" class="text-mini" name="unitNum" id="unitNum" size="10" value="" /> </div> </div> <div class="form-group" id="houseNumRow"> <label class="control-label col-sm-2" for="houseNum">House No.</label> <div class="col-sm-10"> <div id="houseNumSelect"> <select class="select-medium" name="houseNum" id="houseNum"> <option value="0&#xA;&#x9;&#x9;&#x9;&#x9;&#x9;&#x9;">- -None Selected- -</option> </select> </div> </div> </div> <div class="form-group" id="planNumberRow"> <label class="control-label col-sm-2" for="planNumber">Plan</label> <div class="col-sm-10"> <input type="text" class="text-small" name="planNumber" id="planNumber" size="10" value="" /> </div> </div> <div class="form-group" id="strataPlanRow"> <label class="control-label col-sm-2" for="strataPlan">Strata Plan</label> <div class="col-sm-10"> <input type="text" class="text-small" name="strataPlan" id="strataPlan" size="10" value="" /> </div> </div> <div class="form-group" id="lotRow"> <label class="control-label col-sm-2" for="lotNumber">Lot</label> <div class="col-sm-10"> <input type="text" class="text-small" name="lotNumber" id="lotNumber" size="10" value="" /> </div> </div> <div class="form-group" id="propertyNameRow"> <label class="control-label col-sm-2" for="propertyName">Place</label> <div class="col-sm-10"> <input type="text" class="text-large" name="propertyName" id="propertyName" size="20" value="" /> </div> </div> <p class="rowDataOnly"> <span class="rowInfo"> <strong>AND</strong> the following search field: </span> </p> <p> &nbsp; </p> <h2>Options</h2> <label class="radio-inline control-label control-radio"> <input type="radio" name="searchMode" value="A" id="searchModeA" checked="checked" /> <span class="indicator" /> All DAs </label> <label class="radio-inline control-label control-radio"> <input type="radio" name="searchMode" value="D" id="searchModeD" /> <span class="indicator" /> Determined DAs </label> <label class="radio-inline control-label control-radio"> <input type="radio" name="searchMode" value="P" id="searchModeP" /> <span class="indicator" /> DAs Awaiting Decision </label> <label class="radio-inline control-label control-radio"> <input type="radio" name="searchMode" value="C" id="searchModeC" /> <span class="indicator" /> On Exhibition </label> <div class="button-panel"> <input type="submit" name="submitButton" class="button" value="Search" onclick="javascript:checkDetDatesMakeSense()" /> <input type="button" name="clearButton" class="button" value="Clear" onclick="javascript:clearDaEnquiryFields()" /> </div> </form> </div> <!-- CIVICA-CONTENT-END:bodypanel1 --> </div> </div> </div> </div> </div> </div> </div> </div> <!-- container --> </div> <!-- content --> <div id="bottom" class="tabbed"> <div class="container" id="bottom-container"> <div class="row"> <div class="footer"> <p>&#169; Camden Council 2018 </p> <p id="web-context-path">/eservice</p> </div> </div> </div> </div> </div> <!-- End page div --> <!-- End Bootstrap eServices --> <!-- iServices --> </body> </html> ' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/json/common.rb:156:in `parse' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/json/common.rb:156:in `parse' /app/lib/masterview_scraper/get_applications_api.rb:50:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:97:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:33:in `<main>' Collecting feed data for maranoa... gunnedah: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' Saving record 30 - 2020 - 20082 - 3 - 31 Duke St, Roma 4455 QLD Saving record 22 - 2024 - 21350 - 1 - 101 Raglan St, Roma 4455 QLD Saving record 22 - 2024 - 21349 - 1 - 27 Charles St, Roma 4455 QLD Saving record 22 - 2024 - 21348 - 1 - 11 Timbury St, Roma 4455 QLD Saving record 22 - 2024 - 21347 - 1 - 43 Howard St, Roma 4455 QLD Saving record 22 - 2024 - 21346 - 1 - 32-34 Wormwell Dr, Roma 4455 QLD Saving record 22 - 2024 - 21345 - 1 - 37 William St, Roma 4455 QLD Saving record 30 - 2024 - 21340 - 1 - 25 Airport Dr, Roma 4455 QLD maranoa: ERROR: Net::ReadTimeout Collecting feed data for fairfield... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:181:in `rbuf_fill' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:157:in `readuntil' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:167:in `readline' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:40:in `read_status_line' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:29:in `read_new' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1494:in `block in transport_request' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1491:in `catch' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1491:in `transport_request' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1464:in `request' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:891:in `block in request' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:606:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:104:in `block in scrape_api_period' /app/lib/masterview_scraper/get_applications_api.rb:23:in `block in scrape' /app/lib/masterview_scraper/get_applications_api.rb:60:in `block in scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:54:in `each' /app/lib/masterview_scraper/get_applications_api.rb:54:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:97:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' fairfield: ERROR: Couldn't find table Collecting feed data for fraser_coast... /app/lib/masterview_scraper/pages/index.rb:41:in `scrape' /app/lib/masterview_scraper.rb:165:in `scrape_url' /app/lib/masterview_scraper.rb:61:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' Collecting feed data for hawkesbury... fraser_coast: ERROR: SSL_connect returned=1 errno=0 state=SSLv3 read server certificate B: certificate verify failed (unable to get local issuer certificate) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `connect_nonblock' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `ssl_socket_connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:981:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:153:in `scrape_url' /app/lib/masterview_scraper.rb:61:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' Collecting feed data for toowoomba... hawkesbury: ERROR: Failed to open TCP connection to datrack.hawkesbury.nsw.gov.au:443 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:153:in `scrape_url' /app/lib/masterview_scraper.rb:61:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' Collecting feed data for bundaberg... toowoomba: ERROR: SSL_connect returned=1 errno=0 state=SSLv3 read server certificate B: certificate verify failed (ok) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `connect_nonblock' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:44:in `ssl_socket_connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:981:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:153:in `scrape_url' /app/lib/masterview_scraper.rb:61:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' Collecting feed data for wingecarribee... bundaberg: ERROR: 403 => Net::HTTPForbidden for https://da.bundaberg.qld.gov.au/ -- unhandled response /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' Collecting feed data for albury... wingecarribee: ERROR: Failed to open TCP connection to datracker.wsc.nsw.gov.au:443 (getaddrinfo: Name or service not known) /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:153:in `scrape_url' /app/lib/masterview_scraper.rb:61:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' albury: ERROR: execution expired Collecting feed data for bogan... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' Collecting feed data for lismore... bogan: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' Saving record 5.2023.255.3 - 83 Magellan St, Lismore NSW 2480 Saving record 5.2024.330.1 - 3 Dawson St, Lismore NSW 2480 Saving record 5.2024.329.1 - 1001 Dunoon Rd, Modanville NSW 2480 Saving record 5.2024.322.1 - 28 Spurfield Rd, Mcleans Ridges NSW 2480 Saving record 5.2024.319.1 - 60 Gaden Rd, Numulgi NSW 2480 Collecting feed data for port_macquarie_hastings... lismore: ERROR: Unexpected field in: Determination Type: /app/lib/masterview_scraper/pages/detail.rb:198:in `block in extract_decision_block' /app/lib/masterview_scraper/pages/detail.rb:189:in `each' /app/lib/masterview_scraper/pages/detail.rb:189:in `extract_decision_block' /app/lib/masterview_scraper/pages/detail.rb:209:in `scrape_new_version' /app/lib/masterview_scraper/pages/detail.rb:12:in `scrape' /app/lib/masterview_scraper.rb:112:in `block in scrape_api_period' /app/lib/masterview_scraper/get_applications_api.rb:23:in `block in scrape' /app/lib/masterview_scraper/get_applications_api.rb:60:in `block in scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:54:in `each' /app/lib/masterview_scraper/get_applications_api.rb:54:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:97:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' port_macquarie_hastings: ERROR: execution expired Collecting feed data for port_stephens... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' Collecting feed data for singleton... port_stephens: ERROR: execution expired /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `initialize' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `open' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:937:in `block in connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/timeout.rb:103:in `timeout' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:935:in `connect' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:920:in `do_start' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:915:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:655:in `start' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:595:in `connection_for' /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-4.0.1/lib/net/http/persistent.rb:885:in `request' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:280:in `fetch' /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get' /app/lib/masterview_scraper.rb:91:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' Saving record 10.2024.263.1 - 38 Barton Ave, Singleton NSW 2330 Saving record 12.2024.101.1 - 9 Pin Oak Cct, Branxton NSW 2335 Saving record 8.2023.588.3 - 60 Wilkinson Bvd, Hunterview NSW 2330 Saving record 8.2024.332.1 - 97 Dimmock St, Hunterview NSW 2330 Saving record 15.2024.67.1 - 74C Range Rd, Whittingham NSW 2330 Saving record 15.2021.58.2 - 251 Putty Rd, Glenridding NSW 2330 Saving record 10.2024.275.1 - 92 Casey Dr, Hunterview NSW 2330 Saving record 10.2024.231.1 - 4A Lester Cl, Wattle Ponds NSW 2330 Saving record 12.2024.25.1 - 126 John St, Singleton NSW 2330 Saving record 8.2024.318.1 - 15 Radford Pwy, Branxton NSW 2335 Saving record 8.2024.330.1 - 9 Maybon Cl, Branxton NSW 2335 Saving record 8.2022.226.3 - 29 Green Gr, Sedgefield NSW 2330 Saving record 8.2024.319.1 - 112 Brigadier Hammett Rd, Wattle Ponds NSW 2330 Saving record 8.2024.11.2 - 169 Springvale Rd, Elderslie NSW 2335 Saving record 12.2023.596.1 - 5 Adair St, Broke NSW 2330 Saving record 8.2024.316.1 - 12 Radford Pwy, Branxton NSW 2335 Saving record 10.2024.269.1 - 6 Sister Luke Pl, Singleton Heights NSW 2330 Saving record 10.2024.228.1 - 6 St Davids Cl, Gowrie NSW 2330 Saving record 10.2024.229.3 - 3 Dangar Rd, Singleton NSW 2330 Saving record 9.2024.57.1 - 2 Dawson St, Camberwell NSW 2330 Saving record 9.2024.56.1 - 1-3 Powditch St, Camberwell NSW 2330 Saving record 10.2024.65.1 - 25 Doyle St, Jerrys Plains NSW 2330 Saving record 8.2024.328.1 - 29 John St, Singleton NSW 2330 Saving record 10.2019.73.1 - 345 Milbrodale Rd, Fordwich NSW 2330 Saving record 15.2024.66.1 - 694A Hermitage Rd, Pokolbin NSW 2320 Saving record 8.2008.177.2 - 453 Glendon Lane, Mitchells Flat NSW 2330 Saving record 12.2022.349.1 - 30 Dimmock St, Hunterview NSW 2330 Saving record 12.2023.457.1 - 11 Pistacia Gr, Branxton NSW 2335 Saving record 8.2024.314.1 - 42 Robertson Cct, Sedgefield NSW 2330 Saving record 10.2024.291.1 - 7 Maybon Cl, Branxton NSW 2335 Saving record 12.2024.13.1 - 7 Claret Ave, Branxton NSW 2335 Saving record 12.2023.53.1 - 34 Wattle Ponds Rd, Hunterview NSW 2330 Saving record 8.2024.320.1 - 111 Old Carrowbrook Rd, Mount Olive NSW 2330 Saving record 8.2024.322.1 - 1 Barton Ave, Singleton NSW 2330 Saving record 12.2023.528.1 - 36 Partridge Pl, Singleton Heights NSW 2330 Saving record 12.2023.553.1 - 758 Elderslie Rd, Elderslie NSW 2335 Saving record 9.2024.55.1 - 14 Rawcliffe St, Singleton NSW 2330 Saving record 9.2024.54.1 - 24 Mcinerney Rd, Camberwell NSW 2330 Saving record 12.2024.50.1 - 1 Gowrie St, Singleton NSW 2330 singleton: ERROR: Unexpected field in: Determination Type: Collecting feed data for camden... /app/lib/masterview_scraper/pages/detail.rb:198:in `block in extract_decision_block' /app/lib/masterview_scraper/pages/detail.rb:189:in `each' /app/lib/masterview_scraper/pages/detail.rb:189:in `extract_decision_block' /app/lib/masterview_scraper/pages/detail.rb:209:in `scrape_new_version' /app/lib/masterview_scraper/pages/detail.rb:12:in `scrape' /app/lib/masterview_scraper.rb:112:in `block in scrape_api_period' /app/lib/masterview_scraper/get_applications_api.rb:23:in `block in scrape' /app/lib/masterview_scraper/get_applications_api.rb:60:in `block in scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:54:in `each' /app/lib/masterview_scraper/get_applications_api.rb:54:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:97:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' camden: ERROR: 765: unexpected token at '<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd"> <html lang="en-US"> <head> <meta http-equiv="X-UA-Compatible" content="IE=edge" /> <meta http-equiv="Content-Type" content="text/html; charset=UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1, maximum-scale=1" /> <title> Authority e-Services - live </title> <link rel="stylesheet" href="/eservice/library/bootstrap-3.4.1.min.css" type="text/css" media="screen, projection, print" > <link rel="stylesheet" href="/eservice/library/jquery-ui.min.css" type="text/css" media="screen, projection, print" > <link rel="stylesheet" href="/eservice/library/jquery-ui.structure.min.css" type="text/css" media="screen, projection, print" > <link rel="stylesheet" href="/eservice/library/jquery-ui.theme.min.css" type="text/css" media="screen, projection, print" > <link rel="stylesheet" href="/eservice/library/e-services.css" type="text/css" media="screen, projection, print" > <link rel="stylesheet" href="/eservice/library/calendar.css" type="text/css" media="screen, projection, print" > <link rel="stylesheet" href="/eservice/library/daEnquiry_daEnquiry.css" id="pagecss" type="text/css" media="screen, projection" > <link rel="stylesheet" href="/eservice/library/e-print.css" type="text/css" media="print" > <link rel="stylesheet" href="/eservice/library/header-eserv.css" type="text/css" media="screen, projection, print" > <link rel="stylesheet" href="/council/eservice/custom.css" type="text/css" media="screen, projection, print" > <script>var AUTHJS = {};AUTHJS.productName = "i-Services";</script> <script type="text/javascript" src="/eservice/jscalendar-1.0/calendar.js"></script> <script type="text/javascript" src="/eservice/javascript/jquery/jquery-3.6.0.min.js"></script> <script>AUTHJS.productName = "e-Services";</script> <script type="text/javascript" src="/eservice/javascript/tether-1.3.3.js"></script> <script type="text/javascript" src="/eservice/javascript/modernizr-283.min.js"></script> <script type="text/javascript" src="/eservice/javascript/jquery/bootstrap-3.4.1.js"></script> <script type="text/javascript" src="/eservice/javascript/jquery/jquery-ui.min.js"></script> <script type="text/javascript" src="/eservice/javascript/e-services-page.js"></script> <script type="text/javascript" src="/eservice/javascript/prototype.js"></script> <script type="text/javascript" src="/eservice/javascript/civica.jquery.plugins.js"></script> <script type="text/javascript" src="/eservice/javascript/civica.common.init.js"></script> <script type="text/javascript" src="/eservice/javascript/civica.jquery.functions.js"></script> <script type="text/javascript" src="/eservice/javascript/util.js"></script> <script type="text/javascript" src="/eservice/javascript/json2.js"></script> <script type="text/javascript" src="/eservice/javascript/effects.js"></script> <script type="text/javascript" src="/eservice/javascript/controls.js"></script> <script type="text/javascript" src="/eservice/javascript/dragdrop.js"></script> <script type="text/javascript" src="/eservice/javascript/lightbox.js"></script> <script type="text/javascript" src="/eservice/javascript/menu.js"></script> <script type="text/javascript" src="/eservice/javascript/menuScroll.js"></script> <script type="text/javascript" src="/eservice/javascript/sitemap.js"></script> <script type="text/javascript" src="/eservice/javascript/jquery.imageTickBox.js"></script> <script type="text/javascript" src="/eservice/javascript/jquery.metadata.js"></script> <script type="text/javascript" src="/eservice/javascript/jquery/jquery.form-3.46.0.js"></script> <link rel="shortcut icon" href="/favicon.ico" /> <script src="/eservice/javascript/da.js" type="text/javascript"></script> <script src="/eservice/javascript/mkTree.js" type="text/javascript"></script> </head> <body > <script type="text/javascript"> var initialTabPage= "null"; jQuery(document).ready(function() { if (initialTabPage != "null") { if (initialTabPage=="sitemap"){ initialTabPage="#sitemap-controller"; } else { initialTabPage="#dashboard-controller"; } jQuery(initialTabPage + " a.tab-clicker").not(".tabs-content *").click(); } }); (function() { var isBootstrapEvent = false; if (window.jQuery) { var all = jQuery('*'); jQuery.each(['hide.bs.dropdown', 'hide.bs.collapse', 'hide.bs.modal', 'hide.bs.tooltip', 'hide.bs.popover', 'hide.bs.tab'], function(index, eventName) { all.on(eventName, function( event ) { isBootstrapEvent = true; }); }); } var originalHide = Element.hide; Element.addMethods({ hide: function(element) { if(isBootstrapEvent) { isBootstrapEvent = false; return element; } return originalHide(element); } }); })(); </script> <!-- eServices --> <div id="page" class=" tabbed not-logged-in"> <div id="masthead" class="navbar navbar-static-top bs-docs-nav"> <div class="container" id="masthead-container"> <div class="navbar-header"> <a class="navbar-brand"> <span>e-Services</span> Camden Council </a> </div> <!-- masthead Quicklinks start --> <div id="wrapper-quick-links"> <ul id="quick-links" class="nav navbar-nav navbar-right"> <li class="top-link-home"> <a href="/eservice/navigationStart.do" id="quick-link-home"> Home </a> </li> <li class="top-link-signin"> <a href="/eservice/logonInit.do" id="quick-link-signin"> Sign In </a> </li> <li class="top-link-user"> <a> <!-- masthead User start --> You are a Guest <!-- masthead User end --> </a> </li> </ul> </div> <!-- masthead Quicklinks end --> </div> <!-- End container --> </div> <!-- End Masthead --> <!-- End Masthead navbar --> <div id="content"> <div class="container" id="content-container"> <div class="row" id="main-row"> <div class="col-sm-3" id="bstrap-leftnav"> <div id="search-results" > </div> <div id="admin-tabs" > <div id="dashboard" class="tabs-content"> <!-- START MENU CONTENT --> <div id="menus-toggle"> <div id="menus-button" class="btn btn-default"> <span id="menus-button-inner"> <a id="menus-button-link" href="#">Hide Menus</a> </span> </div> <div id="site-access" class="menu-on"> <ul id="siteaccesspanel"> <li id="siteaccesspanel_1"> <div class="menu-group"> <div class="menu-header-panel" title="Drag to change panel order"> <h3 class="panel-handle">Menu</h3> </div> <p class="menu-handlers"> <a href="/eservice/menu/minimisePanel.do?id=1" title="Minimise Panel" class="panel-min-max" id="panel-min-max-1" > <img src="/eservice/icons/minimise.gif" alt="Minimise" /> </a> </p> <div id="menu-search"> <form action="/eservice/menu/search.do" class="menu-search-form"> <p> <input type="text" size="15" name="search" id="search" class="field" value="Menu Search" /> <input type="submit" id="menu-search-submit" value="Go" class="buttonCalendar" /> <img src="/eservice/icons/loading.gif" alt="loading" class="loading" id="menu-search-loading" /> </p> <!-- div id="search-autocomplete" class="autocompleter"></div --> </form> <div id="search-results" > </div> </div> <div id="scrollingMenuContainer" class="scrolling-container"> <ul id="navigation"> <li class="nav-return" title="Back one menu level"><a href="/eservice/navigationStart.do" id="node-0"><img src="/eservice/icons/parent.gif" alt="Return to " />Applications</a></li> <li class='java'> <a href="/eservice/daEnquiryInit.do?doc_typ=10&nodeNum=3374010" class="linkitem" id="node-3374010">Development Application</a> </li> <li class='java'> <a href="/eservice/daEnquiry/currentlyAdvertised.do?nodeNum=3374975" class="linkitem" id="node-3374975">On Exhibition</a> </li> <li class='java'> <a href="/eservice/daEnquiry/recentlySubmitted.do?rangeType=M&rangeFrom=1&rangeTo=0&nodeNum=3374985" class="linkitem" id="node-3374985">Recently Submitted</a> </li> <li class='java'> <a href="/eservice/daEnquiry/recentlyDetermined.do?num_days=30&nodeNum=3374976" class="linkitem" id="node-3374976">Recently Determined</a> </li> <li class='java'> <a href="/eservice/daEnquiryInit.do?doc_typ=12&nodeNum=3374979" class="linkitem" id="node-3374979">Complying Development Certificate</a> </li> <li class='java'> <a href="/eservice/daEnquiryInit.do?doc_typ=11&nodeNum=3374980" class="linkitem" id="node-3374980">Construction Certificate</a> </li> <li class='java'> <a href="/eservice/daEnquiryInit.do?doc_typ=14&nodeNum=3374982" class="linkitem" id="node-3374982">Subdivision Certificate</a> </li> <li class='java'> <a href="/eservice/daEnquiryInit.do?doc_typ=13&nodeNum=3374986" class="linkitem" id="node-3374986">Occupation Certificate</a> </li> <li class='java'> <a href="/eservice/daEnquiryInit.do?doc_typ=16&nodeNum=3374987" class="linkitem" id="node-3374987">Engineering Construction</a> </li> <li class='java'> <a href="/eservice/daEnquiryInit.do?doc_typ=100&nodeNum=3374981" class="linkitem" id="node-3374981">Tree Development Application</a> </li> <li class='java'> <a href="/eservice/daEnquiryInit.do?doc_typ=27&nodeNum=3374011" class="linkitem" id="node-3374011">Fire Safety Schedule</a> </li> </ul> </div> </div> </li> <li id="siteaccesspanel_3"> <div class="menu-group"> <div class="menu-header-panel" title="Drag to change panel order"> <h3 class="panel-handle">History</h3> </div> <p class="menu-handlers"> <a href="/eservice/menu/movePanel.do?id=2" title="Panel Up" class="panel-up"> <img src="/eservice/icons/panel_move_up.gif" alt="Up" /></a> <a href="/eservice/menu/minimisePanel.do?id=2" title="Minimise Panel" class="panel-min-max" id="panel-min-max-2" > <img src="/eservice/icons/minimise.gif" alt="Minimise" /> </a> </p> <ul id="recently-used"> <li id="recently-used-0"> <a href="/eservice/daEnquiryInit.do?doc_typ=10&nodeNum=3374010" class="linkitem">Development Application</a> </li> </ul> </div> </li> </ul> <script type="text/javascript"> //Drag n Drop panels Sortable.create('siteaccesspanel', {handle: 'panel-handle', onUpdate:function(){new Ajax.Request(webContextPath + '/resequencePanels.do', {method: 'post', parameters:Sortable.serialize('siteaccesspanel')})}}); </script> <p id="scroll-trigger">15</p> <p id="alternate-scroll-trigger"></p> <p id="pixel-height-base-rate-for-list-item">24</p> </div> </div> </div> </div> </div> <div class="col-sm-9" id="bstrap-main"> <div id="main-content"> <div class="transaction-area" id="transaction-area"></div> <!-- END MENU CONTENT --> <div class="unique-content" id="daEnquiry_daEnquiry"> <div class="daEnquirySpecific" id="daEnquiry_daEnquiryDocumentType10"> <h1> Development Application Enquiry </h1> <div id="leftcontent"> <div class="infopanel"> <!-- CIVICA-INFO-START --> <div id="infopanel-header"> <h4 class="entryHeader" > Instructions </h4> </div> <div id="instructions-content" class="instructions"> <p>Enter some search criteria and select Search. If the search you entered does not yield any results, try broadening the search.</p> <p>When searching by the number, please enter the application number followed by the year, as in the example below.</p> </div> <!-- CIVICA-INFO-END --> </div> </div> <div id="rightcontent"> <div class="bodypanel" id="bodypanel1"> <!-- CIVICA-CONTENT-START:bodypanel1 --> <h2 > Details </h2> <?xml version="1.0" encoding="UTF-8"?> <div> <form action="daEnquiry.do" id="daEnquiryForm" name="daEnquiryForm" class="form-horizontal"> <div class="form-group"> <label class="col-sm-2 control-label">DA Number</label> <div class="col-sm-10"> <input type="text" class="text-medium" name="number" id="DANumber" size="10" maxlength="10" errors="DANumber" value="" /> <span class="subText">eg 121/2023</span> </div> </div> <p /> <p class="rowDataOnly"> <span class="rowInfo"> <strong>OR</strong> use any of the following search fields: </span> </p> <p> &nbsp; </p> <h2>Lodgement Date</h2> <div class="form-group" style="margin-bottom:2em; border:none; padding:0"> <div class="form-group" style="margin-bottom:2em"> <label class="radio-inline control-label control-radio" style="margin-left:10px"> <input type="radio" name="lodgeRangeType" id="lodgeRangeType" onclick="javascript:setDateRange('', '', 'DADateFrom', 'DADateTo')" /> Specified Range </label> <label class="radio-inline control-label control-radio"> <input type="radio" name="lodgeRangeType" id="lodgeRangeType" onclick="javascript:setDateRange('22/12/2024','26/12/2024', 'DADateFrom', 'DADateTo')" /> This Week </label> <label class="radio-inline control-label control-radio"> <input type="radio" name="lodgeRangeType" id="lodgeRangeType" onclick="javascript:setDateRange('15/12/2024','21/12/2024', 'DADateFrom', 'DADateTo')" /> Last Week </label> <label class="radio-inline control-label control-radio"> <input type="radio" name="lodgeRangeType" id="lodgeRangeType" onclick="javascript:setDateRange('01/12/2024','31/12/2024', 'DADateFrom', 'DADateTo')" /> This Month </label> <label class="radio-inline control-label control-radio"> <input type="radio" name="lodgeRangeType" id="lodgeRangeType" onclick="javascript:setDateRange('01/11/2024','30/11/2024', 'DADateFrom', 'DADateTo')" /> Last Month </label> </div> </div> <div class="form-group"> <div id="DADate"> <label class="col-sm-2 control-label" for="DADateFrom" id="daFromDateLabel">From</label> <div class="form-inline col-sm-10"> <input type="text" class="datepick text-small form-control" name="dateFrom" id="DADateFrom" style="padding-right: 0px" size="10" maxlength="10" errors="DADateFrom" value="" /> <label for="DADateTo" id="daToDateLabel">To</label> <input type="text" class="datepick text-small form-control" name="dateTo" id="DADateTo" style="padding-right: 0px" size="10" maxlength="10" errors="DADateTo" value="" /> </div> </div> </div> <h2>Determination Date</h2> <div class="form-group" style="margin-bottom:2em; border:none; padding:0"> <div class="form-group" style="margin-bottom:2em"> <label class="radio-inline control-label control-radio" style="margin-left:10px"> <input type="radio" name="detRangeType" id="detRangeType" onclick="javascript:setDateRange('','', 'detDateFromString', 'detDateToString')" /> Specified Range </label> <label class="radio-inline control-label control-radio"> <input type="radio" name="detRangeType" id="detRangeType" onclick="javascript:setDateRange('22/12/2024','26/12/2024', 'detDateFromString', 'detDateToString')" /> This Week </label> <label class="radio-inline control-label control-radio"> <input type="radio" name="detRangeType" id="detRangeType" onclick="javascript:setDateRange('15/12/2024','21/12/2024', 'detDateFromString', 'detDateToString')" /> Last Week </label> <label class="radio-inline control-label control-radio"> <input type="radio" name="detRangeType" id="detRangeType" onclick="javascript:setDateRange('01/12/2024','31/12/2024', 'detDateFromString', 'detDateToString')" /> This Month </label> <label class="radio-inline control-label control-radio"> <input type="radio" name="detRangeType" id="detRangeType" onclick="javascript:setDateRange('01/11/2024','30/11/2024', 'detDateFromString', 'detDateToString')" /> Last Month </label> </div> </div> <div class="form-group"> <div id="DetDate"> <label class="col-sm-2 control-label" for="detDateFrom" id="detFromDateLabel">From</label> <div class="form-inline col-sm-10" id="detDateFromInput"> <input type="text" class="datepick text-small form-control" name="detDateFrom" id="detDateFromString" style="padding-right: 0px" size="10" maxlength="10" errors="detDateFrom" value="" /> <label for="detDateTo" id="detToDateLabel">To</label> <input type="text" class="datepick text-small form-control" name="detDateTo" id="detDateToString" style="padding-right: 0px" size="10" maxlength="10" errors="detDateTo" value="" /> </div> </div> </div> <h2>Property Details</h2> <div class="form-group" id="streetNameRow"> <label class="control-label col-sm-2" for="streetName">Street Name</label> <div class="col-sm-10"> <input type="text" class="text-large" name="streetName" id="streetName" size="20" onblur="javascript:getHouseNum(); javascript:getSuburb()" value="" /> <div id="streetHints" class="autocompleter"> &nbsp; </div> </div> </div> <div class="form-group" id="suburbDropdownRow"> <label class="control-label col-sm-2" for="suburb">Suburb</label> <div class="col-sm-10"> <div id="suburbSelect"> <select class="select-medium" name="suburb" id="suburb"> <option value="0" selected="selected">- -None Selected- -</option> <option value="2">BICKLEY VALE</option> <option value="1">BRINGELLY</option> <option value="3">CAMDEN</option> <option value="8">CAMDEN SOUTH</option> <option value="4">CATHERINE FIELD</option> <option value="7">CAWDOR</option> <option value="6">COBBITTY</option> <option value="5">CURRANS HILL</option> <option value="9">ELDERSLIE</option> <option value="10">ELLIS LANE</option> <option value="23">GLEDSWOOD HILLS</option> <option value="11">GRASMERE</option> <option value="22">GREGORY HILLS</option> <option value="12">HARRINGTON PARK</option> <option value="13">KIRKHAM</option> <option value="14">LEPPINGTON</option> <option value="24">LEPPINGTON</option> <option value="15">MOUNT ANNAN</option> <option value="16">NARELLAN</option> <option value="17">NARELLAN VALE</option> <option value="18">ORAN PARK</option> <option value="19">ROSSMORE</option> <option value="21">SMEATON GRANGE</option> <option value="20">SPRING FARM</option> <option value="99">UNKNOWN</option> </select> </div> </div> </div> <div class="form-group" id="unitNumberRow"> <label class="control-label col-sm-2" for="unitNum">Unit</label> <div class="col-sm-10"> <input type="text" class="text-mini" name="unitNum" id="unitNum" size="10" value="" /> </div> </div> <div class="form-group" id="houseNumRow"> <label class="control-label col-sm-2" for="houseNum">House No.</label> <div class="col-sm-10"> <div id="houseNumSelect"> <select class="select-medium" name="houseNum" id="houseNum"> <option value="0&#xA;&#x9;&#x9;&#x9;&#x9;&#x9;&#x9;">- -None Selected- -</option> </select> </div> </div> </div> <div class="form-group" id="planNumberRow"> <label class="control-label col-sm-2" for="planNumber">Plan</label> <div class="col-sm-10"> <input type="text" class="text-small" name="planNumber" id="planNumber" size="10" value="" /> </div> </div> <div class="form-group" id="strataPlanRow"> <label class="control-label col-sm-2" for="strataPlan">Strata Plan</label> <div class="col-sm-10"> <input type="text" class="text-small" name="strataPlan" id="strataPlan" size="10" value="" /> </div> </div> <div class="form-group" id="lotRow"> <label class="control-label col-sm-2" for="lotNumber">Lot</label> <div class="col-sm-10"> <input type="text" class="text-small" name="lotNumber" id="lotNumber" size="10" value="" /> </div> </div> <div class="form-group" id="propertyNameRow"> <label class="control-label col-sm-2" for="propertyName">Place</label> <div class="col-sm-10"> <input type="text" class="text-large" name="propertyName" id="propertyName" size="20" value="" /> </div> </div> <p class="rowDataOnly"> <span class="rowInfo"> <strong>AND</strong> the following search field: </span> </p> <p> &nbsp; </p> <h2>Options</h2> <label class="radio-inline control-label control-radio"> <input type="radio" name="searchMode" value="A" id="searchModeA" checked="checked" /> <span class="indicator" /> All DAs </label> <label class="radio-inline control-label control-radio"> <input type="radio" name="searchMode" value="D" id="searchModeD" /> <span class="indicator" /> Determined DAs </label> <label class="radio-inline control-label control-radio"> <input type="radio" name="searchMode" value="P" id="searchModeP" /> <span class="indicator" /> DAs Awaiting Decision </label> <label class="radio-inline control-label control-radio"> <input type="radio" name="searchMode" value="C" id="searchModeC" /> <span class="indicator" /> On Exhibition </label> <div class="button-panel"> <input type="submit" name="submitButton" class="button" value="Search" onclick="javascript:checkDetDatesMakeSense()" /> <input type="button" name="clearButton" class="button" value="Clear" onclick="javascript:clearDaEnquiryFields()" /> </div> </form> </div> <!-- CIVICA-CONTENT-END:bodypanel1 --> </div> </div> </div> </div> </div> </div> </div> </div> <!-- container --> </div> <!-- content --> <div id="bottom" class="tabbed"> <div class="container" id="bottom-container"> <div class="row"> <div class="footer"> <p>&#169; Camden Council 2018 </p> <p id="web-context-path">/eservice</p> </div> </div> </div> </div> </div> <!-- End page div --> <!-- End Bootstrap eServices --> <!-- iServices --> </body> </html> ' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/json/common.rb:156:in `parse' /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/json/common.rb:156:in `parse' /app/lib/masterview_scraper/get_applications_api.rb:50:in `scrape_page' /app/lib/masterview_scraper/get_applications_api.rb:18:in `scrape' /app/lib/masterview_scraper.rb:97:in `scrape_api_period' /app/lib/masterview_scraper.rb:48:in `scrape_period' /app/lib/masterview_scraper.rb:19:in `scrape' scraper.rb:16:in `block in scrape' scraper.rb:12:in `each' scraper.rb:12:in `scrape' scraper.rb:39:in `<main>' scraper.rb:43:in `<main>': There were errors with the following authorities: [:gunnedah, :maranoa, :fairfield, :fraser_coast, :hawkesbury, :toowoomba, :bundaberg, :wingecarribee, :albury, :bogan, :lismore, :port_macquarie_hastings, :port_stephens, :singleton, :camden]. See earlier output for details (RuntimeError)

Data

Downloaded 74 times by dcalde AndreM101 muzzie86 jamasalbertastash studiology

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (18.7 MB) Use the API

rows 10 / 48739

council_reference address description info_url date_scraped date_received authority_label
10-2021-16-1
2 Angus St, Forbes 2871 NSW
New Garages/Sheds - Industrial
2021-03-16
2021-02-22
forbes
10-2021-15-1
613 Wongajong Rd, Forbes 2871 NSW
New Single Dwelling
2021-03-16
2021-02-18
forbes
10-2021-13-1
1829 Lachlan Valley Wy, Jemalong 2871 NSW
New Single Dwelling
2021-03-16
2021-02-15
forbes
10-2021-14-1
131A Wambat St, Forbes 2871 NSW
New Ancillary Residential Development - Shed
2021-03-16
2021-02-16
forbes
10-2017-80-3
33-37 Sam St, Forbes 2871 NSW
New Commercial Building
2021-03-16
2021-03-03
forbes
10-2021-19-1
36A William St, Forbes 2871 NSW
Patio Cover
2021-03-16
2021-03-05
forbes
10-2021-20-1
2 Rae St, Forbes 2871 NSW
New Ancillary Residential Development-Shed/Carport
2021-03-16
2021-03-05
forbes
10-2021-18-1
12 Acacia Ave, Forbes 2871 NSW
New Ancillary Residential Development-Shed
2021-03-16
2021-03-02
forbes
10-2021-17-1
10 Thelma St, Forbes 2871 NSW
New Ancillary Residential Development - Shed
2021-03-16
2021-03-02
forbes
10-2021-1-1
Ooma St, Forbes 2871 NSW
Ancillary Residential Development - Awning
2021-03-16
2021-02-25
forbes

Statistics

Average successful run time: about 7 hours

Total run time: about 2 months

Total cpu time used: about 4 hours

Total disk space used: 144 MB

History

  • Auto ran revision 028c1c13 and failed .
    90 records added, 90 records removed in the database
  • Auto ran revision 028c1c13 and failed .
    120 records added, 114 records removed in the database
  • Auto ran revision 028c1c13 and failed .
    114 records added, 108 records removed in the database
  • Auto ran revision 028c1c13 and failed .
    107 records added, 107 records removed in the database
  • Auto ran revision 028c1c13 and failed .
    77 records added, 77 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

multiple_masterview / scraper.rb