cpf-sh / welsh-assembly-p39s

Contributors tmtmtmtm cpf-sh

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.5.3 [1G-----> Installing dependencies using bundler version 1.15.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.6). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G Fetching gem metadata from https://rubygems.org/........ [1G Fetching version metadata from https://rubygems.org/.. [1G Fetching dependency metadata from https://rubygems.org/. [1G Fetching https://github.com/everypolitician/scraped.git [1G Fetching https://github.com/openc/sqlite_magic.git [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Fetching https://github.com/everypolitician/wikidata-fetcher.git [1G Fetching rake 12.3.2 [1G Fetching ast 2.4.0 [1G Using bundler 1.15.2 [1G Fetching coderay 1.1.2 [1G Installing ast 2.4.0 [1G Installing coderay 1.1.2 [1G Installing rake 12.3.2 [1G Fetching unf_ext 0.0.7.6 [1G Installing unf_ext 0.0.7.6 with native extensions [1G Fetching excon 0.64.0 [1G Fetching multipart-post 2.0.0 [1G Installing excon 0.64.0 [1G Installing multipart-post 2.0.0 [1G Fetching field_serializer 0.3.0 [1G Installing field_serializer 0.3.0 [1G Fetching hashie 3.6.0 [1G Installing hashie 3.6.0 [1G Fetching httpclient 2.8.3 [1G Installing httpclient 2.8.3 [1G Fetching jaro_winkler 1.5.2 [1G Installing jaro_winkler 1.5.2 with native extensions [1G Fetching json 2.2.0 [1G Installing json 2.2.0 with native extensions [1G Fetching method_source 0.9.2 [1G Installing method_source 0.9.2 [1G Fetching mime-types-data 3.2019.0331 [1G Installing mime-types-data 3.2019.0331 [1G Fetching mini_portile2 2.4.0 [1G Installing mini_portile2 2.4.0 [1G Fetching netrc 0.11.0 [1G Installing netrc 0.11.0 [1G Fetching parallel 1.17.0 [1G Installing parallel 1.17.0 [1G Fetching psych 3.1.0 [1G Installing psych 3.1.0 with native extensions [1G Fetching rainbow 3.0.0 [1G Installing rainbow 3.0.0 [1G Fetching require_all 2.0.0 [1G Installing require_all 2.0.0 [1G Fetching ruby-progressbar 1.10.0 [1G Installing ruby-progressbar 1.10.0 [1G Fetching unicode-display_width 1.5.0 [1G Installing unicode-display_width 1.5.0 [1G Fetching sqlite3 1.4.0 [1G Installing sqlite3 1.4.0 with native extensions [1G Fetching yajl-ruby 1.4.1 [1G Installing yajl-ruby 1.4.1 with native extensions [1G Fetching parser 2.6.2.1 [1G Fetching faraday 0.15.4 [1G Installing parser 2.6.2.1 [1G Installing faraday 0.15.4 [1G Fetching unf 0.1.4 [1G Installing unf 0.1.4 [1G Fetching pry 0.12.2 [1G Installing pry 0.12.2 [1G Fetching mime-types 3.2.2 [1G Installing mime-types 3.2.2 [1G Fetching nokogiri 1.10.3 [1G Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e) [1G Installing nokogiri 1.10.3 with native extensions [1G Fetching faraday_middleware 0.13.1 [1G Fetching domain_name 0.5.20180417 [1G Installing faraday_middleware 0.13.1 [1G Installing domain_name 0.5.20180417 [1G Fetching rubocop 0.67.2 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Installing rubocop 0.67.2 [1G Fetching wikisnakker 0.9.1 [1G Installing wikisnakker 0.9.1 [1G Fetching wikidata-client 0.0.12 [1G Installing wikidata-client 0.0.12 [1G Fetching http-cookie 1.0.3 [1G Installing http-cookie 1.0.3 [1G Fetching faraday-cookie_jar 0.0.6 [1G Installing faraday-cookie_jar 0.0.6 [1G Fetching rest-client 2.0.2 [1G Installing rest-client 2.0.2 [1G Fetching mediawiki_api 0.7.1 [1G Installing mediawiki_api 0.7.1 [1G Using scraped 0.6.2 from https://github.com/everypolitician/scraped.git (at master@7fd4391) [1G Using wikidata-fetcher 0.24.0 from https://github.com/everypolitician/wikidata-fetcher.git (at master@cb919d1) [1G Bundle complete! 9 Gemfile dependencies, 43 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Post-install message from rubocop: [1G Performance Cops will be removed from RuboCop 0.68. Use rubocop-performance gem instead. [1G Put this in your Gemfile. [1G gem 'rubocop-performance' [1G And then execute: [1G $ bundle install [1G Put this into your .rubocop.yml. [1G require: rubocop-performance [1G More information: https://github.com/rubocop-hq/rubocop-performance [1G Bundle completed (27.43s) [1G Cleaning up the bundler cache. [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.6). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G-----> Detecting rake tasks [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 18 times by cpf-sh

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (138 KB) Use the API

rows 10 / 483

statement id name constituency_id constituency party_id party start_date end_date term
Q10694-B687DEFD-F8B5-4639-BC38-BE6405DFA8BD
Q10694
Leanne Wood
Q7568764
South Wales Central
Q10691
Plaid Cymru
2003-05-01
2007-03-28
2
Q11001680-1FCDB500-FAAC-4327-A9C5-A449431E1686
Q11001680
Helen Mary Jones
Q6841063
Mid and West Wales
Q10691
Plaid Cymru
2003-05-01
2007-03-28
2
Q11001680-FCDF0DF3-55EA-4554-BB3C-A965FCA9977E
Q11001680
Helen Mary Jones
Q6661286
Llanelli
Q10691
Plaid Cymru
1999-05-06
2003-04-02
1
Q11162843-815E5E3F-C7F6-462D-8B43-F6A84C05A70E
Q11162843
Jonathan Morgan
Q7568764
South Wales Central
Q7981882
Welsh Conservative Party
1999-05-06
2003-04-02
1
Q11162843-F76B8E8E-AE6D-4C97-8908-A69766444150
Q11162843
Jonathan Morgan
Q7568764
South Wales Central
Q7981882
Welsh Conservative Party
2003-05-01
2007-03-28
2
Q111840-5FB260E6-E741-4102-9930-0DC8C5CE10F1
Q111840
Carwyn Jones
Q4966526
Bridgend
Q832685
Welsh Labour
1999-05-06
2003-04-02
1
Q111840-693F97BA-023D-440A-9151-977C7E96A7A4
Q111840
Carwyn Jones
Q4966526
Bridgend
Q832685
Welsh Labour
2003-05-01
2007-03-28
2
Q117720-DC0581E1-F475-4650-9A7A-1F7DC50AC5C3
Q117720
Gwenda Thomas
Q6984487
Neath
Q832685
Welsh Labour
1999-05-06
2003-04-02
1
Q117720-EE7D5B0A-9BE7-417A-9D91-6BAD08ADDBF6
Q117720
Gwenda Thomas
Q6984487
Neath
Q832685
Welsh Labour
2003-05-01
2007-03-28
2
Q13129493-C4AD1FE3-7081-4573-BC3F-B4478BB3B0F8
Q13129493
Laura Anne Jones
Q7568768
South Wales East
Q7981882
Welsh Conservative Party
2003-05-01
2007-03-28
2

Statistics

Average successful run time: half a minute

Total run time: about 8 hours

Total cpu time used: 19 minutes

Total disk space used: 156 KB

History

  • Manually ran revision 13c4e67f and completed successfully .
    483 records added in the database
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

welsh-assembly-p39s / scraper.rb