ausmpcontact_details

A Morph scraper that grabs MP's details from APH.gov.au.

Contributors henare archoo

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Saving results from Representatives page Saving Hon Anthony Albanese MP Saving Hon Dr Anne Aly MP Saving Dr Michelle Ananda-Rajah MP Saving Hon Karen Andrews MP Saving Mrs Bridget Archer MP Saving Mr Adam Bandt MP Saving Mr Stephen Bates MP Saving Ms Angie Bell MP Saving Ms Jodie Belyea MP Saving Mr Sam Birrell MP Saving Hon Chris Bowen MP Saving Mr Colin Boyce MP /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize/http/agent.rb:304:in `fetch': 404 => Net::HTTPNotFound for https://www.aph.gov.au/Help/404?item=%2fsenators_and_members%2fparliamentarian_search_results%2fsenators_and_members%2fparliamentarian_search_results&user=extranet%5cAnonymous&site=website -- unhandled response (Mechanize::ResponseCodeError) from /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize/http/agent.rb:949:in `response_redirect' from /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize/http/agent.rb:299:in `fetch' from /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize/http/agent.rb:949:in `response_redirect' from /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize/http/agent.rb:299:in `fetch' from /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize.rb:407:in `get' from scraper.rb:56:in `<main>'

Data

Downloaded 7209 times by openaustralia everypolitician anupam82 tmtmtmtm ondenman mlandauer davewhiteland jamezpolley chrismytton otherchirps technicallynotdeaf henare archoo m-mac BestyAU cofiem tp12121212 paullenz dotnetnoobie maxious

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (182 KB) Use the API

rows 10 / 324

house aph_id full_name electorate party profile_page contact_page photo_url email facebook twitter website
senate
2L6
Senator Mark Bishop
Western Australia
Australian Labor Party
senator.bishop@aph.gov.au
senate
YE4
Senator the Hon Ronald Boswell
Queensland
The Nationals
senator.boswell@aph.gov.au
senate
H6V
Senator Sue Boyce
Queensland
Liberal Party of Australia
senate
4L6
Senator Alan Eggleston
Western Australia
Liberal Party of Australia
senator.eggleston@aph.gov.au
senate
I0P
Senator Mark Furner
Queensland
Australian Labor Party
senate
7L6
Senator the Hon John Hogg
Queensland
Australian Labor Party
senator.hogg@aph.gov.au
senate
G1N
Senator Helen Kroger
Victoria
Liberal Party of Australia
senate
00AOS
Senator the Hon Ursula Stephens
New South Wales
Australian Labor Party
senator.stephens@aph.gov.au
senate
183342
Senator the Hon Lin Thorp
Tasmania
Australian Labor Party
senator.thorp@aph.gov.au
senate
249499
Senator Mehmet Tillem
Victoria
Australian Labor Party

Statistics

Average successful run time: 5 minutes

Total run time: 6 days

Total cpu time used: about 3 hours

Total disk space used: 206 KB

History

  • Auto ran revision 38f22655 and failed .
    12 records added, 12 records removed in the database
  • Auto ran revision 38f22655 and failed .
    12 records added, 12 records removed in the database
  • Auto ran revision 38f22655 and failed .
    12 records added, 12 records removed in the database
  • Auto ran revision 38f22655 and failed .
    12 records added, 12 records removed in the database
  • Auto ran revision 38f22655 and failed .
    12 records added, 12 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

aus_mp_contact_details / scraper.rb