openaustralia / alaveteli_versions

Scrapes the version of every Alaveteli deployment

README.md

This is a scraper that runs on Morph.

To get started see the documentation

Development

Set up a local development copy of the scraper by running:

bash git clone https://github.com/openaustralia/alaveteli_versions cd alaveteli_versions bundle

Then run regression tests and audit the scraper style with:

bash bundle exec rake

Contributors henare auxesis

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Discovering deployments... Saving 0 records Done.

Data

Downloaded 52 times by gavinrozzi henare n-mouse tuttinator schlos mlandauer crowbot handelaar skylark1848 garethrees paullenz auxesis benrfairless

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (13 KB) Use the API

rows 10 / 36

alaveteli_version ruby_version visible_request_count alaveteli_git_commit confirmed_user_count name url version_url error visible_public_body_count visible_comment_count track_thing_count widget_vote_count public_body_change_request_count request_classification_count visible_followup_message_count date_checked
0.20.0.14
1.8.7
29
823e58dc69960c600230b10604a0051359173f85
50
Sobunakirwa
https://sobanukirwa.rw/
https://sobanukirwa.rw/version.json
0.20.0.14
1.9.3
17
48f07a68cb7373a9a032009ab760b5f4d156d6cd
39
Diritto Di Sapere
https://chiedi.dirittodisapere.it/
https://chiedi.dirittodisapere.it/version.json
Je Veux Savoir
http://www.jeveuxsavoir.org/
http://www.jeveuxsavoir.org/version.json
404 => Net::HTTPNotFound for http://www.nordouvert.ca/version.json/2015/06/15/je-veux-savoir-fin-d-une-belle-aventure.html -- unhandled response
0.19
1.8.7
991
d12c236fbd606fb38c01aebb39694a568740de06
939
Queremos Saber
http://queremossaber.org.br/
http://queremossaber.org.br/version.json
0.21.0.26
1.8.7
10
5e2f00176f73736929fde4e1ab09f594ba5252cf
4
Marsoum 41
http://www.marsoum41.org/en/
http://www.marsoum41.org/en/version.json
0.12
1.8.7
ad820340ad8bebffbe453ae337a4ec49dec6022f
Tu Derecho A Saber
http://tuderechoasaber.es/
http://tuderechoasaber.es/version.json
Da Zanamo Svi
http://daznamosvi.rs/sr/
http://daznamosvi.rs/sr/version.json
404 => Net::HTTPNotFound for http://daznamosvi.rs/sr/version.json -- unhandled response
Nós Queremos Saber
http://nosqueremossaber.org/
http://nosqueremossaber.org/version.json
Didn't get JSON from API.
Pravo Da Znam
http://www.pravodaznam.ba/
http://www.pravodaznam.ba/version.json
Net::HTTP::Persistent::Error: too many connection resets (due to Net::ReadTimeout - Net::ReadTimeout) after 0 requests on 47044091722280, last used 1531865782.47403 seconds ago
2018-07-17
RightToKnow
http://foi.sinarproject.org/
http://foi.sinarproject.org/version.json
Net::HTTP::Persistent::Error: too many connection resets (due to Net::ReadTimeout - Net::ReadTimeout) after 0 requests on 46942657109440, last used 1551708277.0665338 seconds ago
2019-03-04

Statistics

Average successful run time: 2 minutes

Total run time: about 1 month

Total cpu time used: about 1 hour

Total disk space used: 139 KB

History

  • Auto ran revision 4a0c1181 and completed successfully .
    nothing changed in the database
  • Auto ran revision 4a0c1181 and completed successfully .
    nothing changed in the database
  • Auto ran revision 4a0c1181 and completed successfully .
    nothing changed in the database
  • Auto ran revision 4a0c1181 and completed successfully .
    nothing changed in the database
  • Auto ran revision 4a0c1181 and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

alaveteli_versions / scraper.rb