everypolitician-scrapers / nigeria-shineyoureye-positions

A scraper to extract person summarys and all their positions from the Pombola-based ShineYourEye

Contributors mhl

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Python app detected [1G-----> Installing python-2.7.12 [1G $ pip install -r requirements.txt [1G Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r requirements.txt (line 6)) [1G Cloning http://github.com/openaustralia/scraperwiki-python.git (to morph_defaults) to ./.heroku/src/scraperwiki [1G Collecting requests==2.13.0 (from -r requirements.txt (line 8)) [1G Downloading requests-2.13.0-py2.py3-none-any.whl (584kB) [1G Collecting dumptruck>=0.1.2 (from scraperwiki->-r requirements.txt (line 6)) [1G Downloading dumptruck-0.1.6.tar.gz [1G Installing collected packages: dumptruck, requests, scraperwiki [1G Running setup.py install for dumptruck: started [1G Running setup.py install for dumptruck: finished with status 'done' [1G Running setup.py develop for scraperwiki [1G Successfully installed dumptruck-0.1.6 requests-2.13.0 scraperwiki [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 44 times by mhl SmartVMDev

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (271 KB) Use the API

rows 10 / 659

person_summary person_name organization_name organization_id end_date membership_id organization_category person_id start_date role organization_classification
person_summary
person_name
BEN NNEBEDUMCHUKWU NWANKWO
organization_name
University of Nigeria
organization_id
core_organisation:375
end_date
membership_id
core_position:4344
organization_category
education
person_id
core_person:119
start_date
2005
role
Student
organization_classification
Educational Institution
person_summary
person_name
BEN NNEBEDUMCHUKWU NWANKWO
organization_name
Peoples Democratic Party
organization_id
core_organisation:129
end_date
membership_id
core_position:2941
organization_category
political
person_id
core_person:119
start_date
role
Member
organization_classification
Political Party
person_summary
person_name
BEN NNEBEDUMCHUKWU NWANKWO
organization_name
House of Representatives
organization_id
core_organisation:120
end_date
2015-05-29
membership_id
core_position:3260
organization_category
political
person_id
core_person:119
start_date
2011-05-29
role
Federal Representative
organization_classification
Political Institution
person_summary
person_name
BEN NNEBEDUMCHUKWU NWANKWO
organization_name
Capital Market & Institutions Committee (Reps)
organization_id
core_organisation:10
end_date
2015-05-29
membership_id
core_position:272
organization_category
political
person_id
core_person:119
start_date
role
Committee Member
organization_classification
Legislative Committee - Federal Reps
person_summary
person_name
BEN NNEBEDUMCHUKWU NWANKWO
organization_name
Foreign Affairs Committee (Reps)
organization_id
core_organisation:41
end_date
2015-05-29
membership_id
core_position:825
organization_category
political
person_id
core_person:119
start_date
role
Committee Member
organization_classification
Legislative Committee - Federal Reps
person_summary
person_name
BEN NNEBEDUMCHUKWU NWANKWO
organization_name
Human Rights Committee (Reps)
organization_id
core_organisation:50
end_date
2015-05-29
membership_id
core_position:986
organization_category
political
person_id
core_person:119
start_date
role
Committee Member
organization_classification
Legislative Committee - Federal Reps
person_summary
person_name
BEN NNEBEDUMCHUKWU NWANKWO
organization_name
National Security and Intelligence Committee (Senate)
organization_id
core_organisation:79
end_date
2015-05-29
membership_id
core_position:1388
organization_category
political
person_id
core_person:119
start_date
role
Committee Member
organization_classification
Legislative Committee - Senate
person_summary
person_name
BEN NNEBEDUMCHUKWU NWANKWO
organization_name
Police Affairs Committee (Reps)
organization_id
core_organisation:88
end_date
2015-05-29
membership_id
core_position:1567
organization_category
political
person_id
core_person:119
start_date
role
Committee Member
organization_classification
Legislative Committee - Federal Reps
person_summary
person_name
BEN NNEBEDUMCHUKWU NWANKWO
organization_name
Public Petitions Committee (Reps)
organization_id
core_organisation:95
end_date
2015-05-29
membership_id
core_position:1729
organization_category
political
person_id
core_person:119
start_date
role
Committee Member
organization_classification
Legislative Committee - Federal Reps
person_summary
person_name
BEN NNEBEDUMCHUKWU NWANKWO
organization_name
Emergency & Disaster Preparedness Committee (Reps)
organization_id
core_organisation:26
end_date
2015-05-29
membership_id
core_position:611
organization_category
political
person_id
core_person:119
start_date
role
Committee Member
organization_classification
Legislative Committee - Federal Reps

Statistics

Average successful run time: 1 minute

Total run time: 5 minutes

Total cpu time used: less than 5 seconds

Total disk space used: 294 KB

History

  • Manually ran revision 01d2d82b and completed successfully .
    nothing changed in the database
  • Manually ran revision 01d2d82b and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Manually ran revision 58f3230d and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Manually ran revision 5304f876 and failed .
    659 records added in the database
    3 pages scraped
  • Manually ran revision 6a99cdc3 and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Created on morph.io