noahzheutlin / metacritic_scraper

Metacritic Scraper


Contributors noahzheutlin

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Traceback (most recent call last): File "scraper.py", line 14, in <module> html = scraperwiki.scrape(url) File "/app/.heroku/src/scraperwiki/scraperwiki/utils.py", line 31, in scrape f = urllib2.urlopen(req) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 127, in urlopen return _opener.open(url, data, timeout) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 410, in open response = meth(req, response) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 523, in http_response 'http', request, response, code, msg, hdrs) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 448, in error return self._call_chain(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 382, in _call_chain result = func(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 531, in http_error_default raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) urllib2.HTTPError: HTTP Error 403: Forbidden

Data

Downloaded 3 times by csgnyc

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3.06 MB) Use the API

rows 10 / 16178

url date_scraped score type title
url
/movie/devil
date_scraped
2011-03-22T00:55:29.821784
score
44
type
dvds/release-date/new-releases
title
Devil
url
/movie/wall-street-money-never-sleeps
date_scraped
2011-03-22T00:55:29.855791
score
59
type
dvds/release-date/new-releases
title
Wall Street: Money Never Sleeps
url
/movie/salt
date_scraped
2011-03-22T00:55:29.896490
score
65
type
dvds/release-date/new-releases
title
Salt
url
/movie/easy-a
date_scraped
2011-03-22T00:55:29.904561
score
72
type
dvds/release-date/new-releases
title
Easy A
url
/movie/i-am-you
date_scraped
2011-03-22T00:55:36.096505
score
-1
type
movies/release-date/theaters
title
In Her Skin
url
/movie/orgasm-inc
date_scraped
2011-03-22T00:55:36.153386
score
67
type
movies/release-date/theaters
title
Orgasm Inc.
url
/movie/vidal-sassoon-the-movie
date_scraped
2011-03-22T00:55:36.271930
score
62
type
movies/release-date/theaters
title
Vidal Sassoon: The Movie
url
/movie/poetry
date_scraped
2011-03-22T00:55:36.333963
score
87
type
movies/release-date/theaters
title
Poetry
url
/movie/even-the-rain
date_scraped
2011-03-22T00:55:37.129292
score
68
type
movies/release-date/theaters
title
Even the Rain (Tambien la Lluvia)
url
/movie/cold-weather
date_scraped
2011-03-22T00:55:37.258478
score
63
type
movies/release-date/theaters
title
Cold Weather

Statistics

Total run time: less than 10 seconds

Total cpu time used: less than 5 seconds

Total disk space used: 3.08 MB

History

  • Manually ran revision f0b84e6f and failed .
    nothing changed in the database
  • Manually ran revision 884aafb6 and failed .
    nothing changed in the database
  • Created on morph.io

Scraper code

metacritic_scraper