openaustralia / alaveteli_versions

Scrapes the version of every Alaveteli deployment


[!WARNING] This project has been archived because we are not actively maintaining nor using it. It hasn't seen activity since October 2017 and may have known security vulnerabilities that have not been addressed. If you would like to move this work forward, please do! If we get enough interest, we might reconsider working on this again. You can always donate to provide us with more resources.

Note: I (@benrfairless) used AI to assist with the process of archiving this repository, however I reviewed the decision myself before taking action. This is a scraper that runs on Morph.

To get started see the documentation

Development

Set up a local development copy of the scraper by running:

bash git clone https://github.com/openaustralia/alaveteli_versions cd alaveteli_versions bundle

Then run regression tests and audit the scraper style with:

bash bundle exec rake

Contributors henare auxesis benrfairless

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Discovering deployments... Saving 0 records Done.

Data

Downloaded 52 times by gavinrozzi henare n-mouse tuttinator schlos handelaar mlandauer crowbot skylark1848 garethrees paullenz auxesis benrfairless

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (13 KB) Use the API

rows 10 / 36

alaveteli_version ruby_version visible_request_count alaveteli_git_commit confirmed_user_count name url version_url error visible_public_body_count visible_comment_count track_thing_count widget_vote_count public_body_change_request_count request_classification_count visible_followup_message_count date_checked
0.20.0.14
1.8.7
29
823e58dc69960c600230b10604a0051359173f85
50
Sobunakirwa
0.20.0.14
1.9.3
17
48f07a68cb7373a9a032009ab760b5f4d156d6cd
39
Diritto Di Sapere
Je Veux Savoir
404 => Net::HTTPNotFound for http://www.nordouvert.ca/version.json/2015/06/15/je-veux-savoir-fin-d-une-belle-aventure.html -- unhandled response
0.19
1.8.7
991
d12c236fbd606fb38c01aebb39694a568740de06
939
Queremos Saber
0.21.0.26
1.8.7
10
5e2f00176f73736929fde4e1ab09f594ba5252cf
4
Marsoum 41
0.12
1.8.7
ad820340ad8bebffbe453ae337a4ec49dec6022f
Tu Derecho A Saber
Da Zanamo Svi
404 => Net::HTTPNotFound for http://daznamosvi.rs/sr/version.json -- unhandled response
Nós Queremos Saber
Didn't get JSON from API.
Pravo Da Znam
Net::HTTP::Persistent::Error: too many connection resets (due to Net::ReadTimeout - Net::ReadTimeout) after 0 requests on 47044091722280, last used 1531865782.47403 seconds ago
2018-07-17
RightToKnow
Net::HTTP::Persistent::Error: too many connection resets (due to Net::ReadTimeout - Net::ReadTimeout) after 0 requests on 46942657109440, last used 1551708277.0665338 seconds ago
2019-03-04

Statistics

Average successful run time: 2 minutes

Total run time: about 1 month

Total cpu time used: about 1 hour

Total disk space used: 143 KB

History

  • Auto ran revision ee4eb4bf and completed successfully .
    nothing changed in the database
  • Auto ran revision ee4eb4bf and completed successfully .
    nothing changed in the database
  • Auto ran revision ee4eb4bf and completed successfully .
    nothing changed in the database
  • Auto ran revision ee4eb4bf and completed successfully .
    nothing changed in the database
  • Auto ran revision ee4eb4bf and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

alaveteli_versions / scraper.rb