tmtmtmtm / guernsey-states

Scrapes github.com, theoldsite.gov.gg, and gov.gg

Build software better, together.


Contributors tmtmtmtm ondenman

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.0.0 [1G-----> Installing dependencies using bundler 1.11.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G Fetching gem metadata from https://rubygems.org/.......... [1G Fetching version metadata from https://rubygems.org/... [1G Fetching dependency metadata from https://rubygems.org/.. [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Rubygems 2.0.14.1 is not threadsafe, so your gems will be installed one at a time. Upgrade to Rubygems 2.1.0 or higher to enable parallel gem installation. [1G Installing public_suffix 2.0.4 [1G Installing coderay 1.1.0 [1G Installing colorize 0.7.7 [1G Installing safe_yaml 1.0.4 [1G Installing excon 0.45.4 [1G Installing execjs 2.5.2 [1G Installing multipart-post 2.0.0 [1G Installing fuzzy_match 2.1.0 [1G Installing git 1.3.0 [1G Installing hashdiff 0.3.1 [1G Installing hashie 3.4.2 [1G Installing httpclient 2.6.0.1 [1G Installing method_source 0.8.2 [1G Installing mini_portile 0.6.2 [1G Installing open-uri-cached 0.0.5 [1G Installing slop 3.6.0 [1G Installing vcr 3.0.3 [1G Installing sqlite3 1.3.10 with native extensions [1G Using bundler 1.11.2 [1G Installing addressable 2.5.0 [1G Installing crack 0.4.3 [1G Installing faraday 0.9.1 [1G Installing nokogiri 1.6.6.2 with native extensions [1G Installing pry 0.10.1 [1G Installing sqlite_magic 0.0.3 [1G Installing webmock 2.0.3 [1G Installing faraday_middleware 0.10.0 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Installing vcr-archive 0.3.0 [1G Installing wikidata-client 0.0.7 [1G Installing scraped_page_archive 0.5.0 [1G Bundle complete! 9 Gemfile dependencies, 31 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Post-install message from webmock: [1G WebMock 2.0 has some breaking changes. Please check the CHANGELOG: https://goo.gl/piDGLu [1G Bundle completed (19.90s) [1G Cleaning up the bundler cache. [1G Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... Switched to a new branch 'scraped-pages-archive' /app/vendor/ruby-2.0.0/lib/ruby/2.0.0/open-uri.rb:223:in `open_loop': redirection forbidden: http://gov.gg/states_members_contact_details -> https://gov.gg/states_members_contact_details (RuntimeError) from /app/vendor/ruby-2.0.0/lib/ruby/2.0.0/open-uri.rb:149:in `open_uri' from /app/vendor/bundle/ruby/2.0.0/gems/scraped_page_archive-0.5.0/lib/scraped_page_archive/open-uri.rb:9:in `block in open_uri' from /app/vendor/bundle/ruby/2.0.0/gems/vcr-3.0.3/lib/vcr/util/variable_args_block_caller.rb:9:in `call' from /app/vendor/bundle/ruby/2.0.0/gems/vcr-3.0.3/lib/vcr/util/variable_args_block_caller.rb:9:in `call_block' from /app/vendor/bundle/ruby/2.0.0/gems/vcr-3.0.3/lib/vcr.rb:189:in `use_cassette' from /app/vendor/bundle/ruby/2.0.0/gems/scraped_page_archive-0.5.0/lib/scraped_page_archive.rb:36:in `record' from /app/vendor/bundle/ruby/2.0.0/gems/scraped_page_archive-0.5.0/lib/scraped_page_archive/open-uri.rb:9:in `open_uri' from /app/vendor/ruby-2.0.0/lib/ruby/2.0.0/open-uri.rb:689:in `open' from /app/vendor/ruby-2.0.0/lib/ruby/2.0.0/open-uri.rb:34:in `open' from scraper.rb:19:in `noko_for' from scraper.rb:23:in `scrape_list' from scraper.rb:49:in `<main>'

Data

Downloaded 156 times by everypolitician MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (15 KB) Use the API

rows 10 / 49

name area party email twitter linkedin term source
Harvey, Neil
Alderney Representative
Independent
Neil.Harvey@deputies.gov.gg
2012
Storey, Martin J.
St. Peter Port North
Independent
Martin.Storey@deputies.gov.gg
2012
Adam, A. Hunter
Castel
Independent
Hunter.Adam@deputies.gov.gg
2012
Bebb, Elis G.
St. Peter Port North
Independent
elis.bebb@gmail.com
2012
Brehaut, Barry L.
St. Peter Port South
Independent
barry.brehaut@deputies.gov.gg
2012
Brouard, Al H.
West
Independent
al.brouard@deputies.gov.gg
2012
Burford, Yvonne
West
Independent
yvonne.burford@deputies.gov.gg
2012
Collins, Garry M.
Vale
Independent
Garry.Collins@deputies.gov.gg
2012
Conder, Richard
St. Peter Port North
Independent
Richard.Conder@deputies.gov.gg
2012
De Lisle, David de G
West
Independent
delisle.david@cwgsy.net
2012

Statistics

Average successful run time: less than 20 seconds

Total run time: about 1 hour

Total cpu time used: 7 minutes

Total disk space used: 40.1 KB

History

  • Auto ran revision b5623fbe and failed .
    nothing changed in the database
    4 pages scraped
  • Auto ran revision b5623fbe and failed .
    nothing changed in the database
    4 pages scraped
  • Auto ran revision b5623fbe and failed .
    nothing changed in the database
    4 pages scraped
  • Auto ran revision b5623fbe and failed .
    nothing changed in the database
    4 pages scraped
  • Auto ran revision b5623fbe and failed .
    nothing changed in the database
    4 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

guernsey-states