ianheggie-oaf / wollondilly

Wollondilly Shire Council Development Applications

README.md

Wollondilly now has a custom web application which has an API. So, we're using that.

Contributors LoveMyData mlandauer tseyiokorodudu

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Using Australian proxy... /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:181:in `rbuf_fill': too many connection resets (due to Net::ReadTimeout - Net::ReadTimeout) after 0 requests on 50066924189720, last used 1745461233.017597 seconds ago (Net::HTTP::Persistent::Error) from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/protocol.rb:125:in `read' from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:293:in `block in read_body_0' from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:253:in `inflater' from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:283:in `read_body_0' from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:204:in `read_body' from /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.6/lib/mechanize/http/agent.rb:924:in `response_read' from /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.6/lib/mechanize/http/agent.rb:283:in `block in fetch' from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1503:in `block in transport_request' from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http/response.rb:165:in `reading_body' from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1502:in `transport_request' from /app/vendor/ruby-2.5.1/lib/ruby/2.5.0/net/http.rb:1464:in `request' from /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-3.0.1/lib/net/http/persistent.rb:951:in `block in request' from /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-3.0.1/lib/net/http/persistent.rb:648:in `connection_for' from /app/vendor/bundle/ruby/2.5.0/gems/net-http-persistent-3.0.1/lib/net/http/persistent.rb:945:in `request' from /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.6/lib/mechanize/http/agent.rb:280:in `fetch' from /app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.6/lib/mechanize.rb:464:in `get' from scraper.rb:26:in `<main>'

Statistics

Total run time: 30 minutes

Total cpu time used: less than 5 seconds

Total disk space used: 329 KB

History

  • Manually ran revision 95d5b551 and failed .
  • Created on morph.io

Scraper code

Ruby

wollondilly / scraper.rb