ggoha / spider-steam

Scrapes store.steampowered.com and www.parliament.lk

Welcome to Steam

Contributors ggoha

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... /app/vendor/ruby-1.9.3/lib/ruby/1.9.1/open-uri.rb:216:in `open_loop': redirection forbidden: http://store.steampowered.com/search/?sort_by=Price_ASC&specials=1&page=0 -> https://store.steampowered.com/search/?sort_by=Price_ASC&specials=1&page=0 (RuntimeError) from /app/vendor/ruby-1.9.3/lib/ruby/1.9.1/open-uri.rb:146:in `open_uri' from /app/vendor/ruby-1.9.3/lib/ruby/1.9.1/open-uri.rb:678:in `open' from /app/vendor/ruby-1.9.3/lib/ruby/1.9.1/open-uri.rb:33:in `open' from scraper.rb:10:in `block in <main>' from scraper.rb:9:in `times' from scraper.rb:9:in `<main>'

Data

Downloaded 7 times by ggoha dvivarelli

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (740 KB) Use the API

rows 10 / 16915

id price
455470
$0.54
213312
$0.74
344480
$0.79
348430
$0.79
348440
$0.79
394250
$0.99
516470
$0.99
442260
$1.19
470470
$1.24
547730
$1.24

Statistics

Average successful run time: less than a minute

Total run time: about 5 hours

Total cpu time used: 16 minutes

Total disk space used: 820 KB

History

  • Auto ran revision 4399af80 and failed .
    nothing changed in the database
    252 pages scraped
  • Auto ran revision 4399af80 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 4399af80 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 4399af80 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 4399af80 and failed .
    nothing changed in the database
    1 page scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

spider-steam