willgk / simpledesktops_ripper

SimpleDesktops Ripper

README.textile

Scrapes images from simpledesktops.com and throws authors, names, sha1 hashes and some other stuff into a database.

Contributors willgk

Last run failed with status code 255.

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Python app detected [1G ! The latest version of Python 2 is python-2.7.14 (you are using python-2.7.6, which is unsupported). [1G ! We recommend upgrading by specifying the latest version (python-2.7.14). [1G Learn More: https://devcenter.heroku.com/articles/python-runtimes [1G-----> Installing python-2.7.6 [1G ! Requested runtime (python-2.7.6) is not available for this stack (cedar-14). [1G ! Aborting. More info: https://devcenter.heroku.com/articles/python-support

Data

Downloaded 3 times by MikeRalphson jonathankoek

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (221 KB) Use the API

rows 10 / 1328

id name hash author url accessed
id
1
name
Circles
hash
4576756a068f47981ebb17495a1f3041c1aee6d6
author
Tom Watson
url
http://simpledesktops.com/download/?desktop=5
accessed
2012-06-27T00:10:12.350982
id
2
name
Bam
hash
da536393e9dc1bfec68f7e10fde5b22796feef99
author
Tom Watson
url
http://simpledesktops.com/download/?desktop=3
accessed
2012-06-27T00:11:49.794583
id
3
name
Orbital
hash
551cee2517c52748c3ce0a28aea57cce09fd98ae
author
Eric Fisher
url
http://simpledesktops.com/download/?desktop=36
accessed
2012-06-27T00:11:51.490596
id
4
name
Polaroid Blue
hash
af186144b385af90a592fa0e570dad3cb4fb75c1
author
Dan Rubin
url
http://simpledesktops.com/download/?desktop=35
accessed
2012-06-27T00:11:58.171335
id
5
name
Hands
hash
1b375f32fd1633e6ca314e9c3357bc7e94b2aca2
author
Ben Barry
url
http://simpledesktops.com/download/?desktop=33
accessed
2012-06-27T00:11:59.336647
id
6
name
Nightfall
hash
0e5c42ba501f71dc2b207807ff14b2a8b23f6762
author
Alex Jordan
url
http://simpledesktops.com/download/?desktop=32
accessed
2012-06-27T00:12:01.961071
id
7
name
Autumn
hash
4e7b60b9641b6f7d1e80dbae0418f60b921de01b
author
Tom Watson
url
http://simpledesktops.com/download/?desktop=30
accessed
2012-06-27T00:12:03.875317
id
8
name
Atomic
hash
5e76b6c45235e76c5027c91d65a9e45ab13ffab1
author
Ben Barry
url
http://simpledesktops.com/download/?desktop=29
accessed
2012-06-27T00:12:04.932880
id
9
name
Even
hash
a32e7658c27c7f03c3c3fdd84776ef0dee4aa8a5
author
Jonathan Koch
url
http://simpledesktops.com/download/?desktop=28
accessed
2012-06-27T00:12:07.833517
id
10
name
Bow Tie
hash
9a804ded0ea8a1e537bd3e154063b4b58c8a4c3d
author
Alex Jordan
url
http://simpledesktops.com/download/?desktop=27
accessed
2012-06-27T00:12:09.001970

Statistics

Average successful run time: 4 minutes

Total run time: 4 minutes

Total cpu time used: less than 10 seconds

Total disk space used: 230 KB

History

  • Manually ran revision 86be4c0a and failed .
    nothing changed in the database
  • Manually ran and failed .
  • Manually ran revision 86be4c0a and completed successfully .
    241 records added, 1 record updated in the database
    756 pages scraped
  • Created on morph.io

Scraper code

Python

simpledesktops_ripper / scraper.py