NoEx1k / Scrapper

animals, tourist, food, clothes

README.md

This is a scraper that runs on Morph. To get started see the documentation

Contributors NoEx1k

Last run failed with status code 998.

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.0.0 [1G-----> Installing dependencies using bundler 1.15.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Fetching gem metadata from https://rubygems.org/...... [1G Fetching version metadata from https://rubygems.org/. [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Rubygems 2.0.14.1 is not threadsafe, so your gems will be installed one at a time. Upgrade to Rubygems 2.1.0 or higher to enable parallel gem installation. [1G Using bundler 1.15.2 [1G Fetching unf_ext 0.0.7.1 [1G Installing unf_ext 0.0.7.1 with native extensions [1G Fetching httpclient 2.6.0.1 [1G Installing httpclient 2.6.0.1 [1G Fetching mime-types 2.5 [1G Installing mime-types 2.5 [1G Fetching net-http-digest_auth 1.4 [1G Installing net-http-digest_auth 1.4 [1G Fetching net-http-persistent 2.9.4 [1G Installing net-http-persistent 2.9.4 [1G Fetching mini_portile 0.6.2 [1G Installing mini_portile 0.6.2 [1G Fetching ntlm-http 0.1.1 [1G Installing ntlm-http 0.1.1 [1G Fetching webrobots 0.1.1 [1G Installing webrobots 0.1.1 [1G Fetching sqlite3 1.3.10 [1G Installing sqlite3 1.3.10 with native extensions [1G Fetching unf 0.1.4 [1G Installing unf 0.1.4 [1G Fetching nokogiri 1.6.6.2 [1G Installing nokogiri 1.6.6.2 with native extensions [1G Fetching sqlite_magic 0.0.3 [1G Installing sqlite_magic 0.0.3 [1G Fetching domain_name 0.5.24 [1G Installing domain_name 0.5.24 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Fetching http-cookie 1.0.2 [1G Installing http-cookie 1.0.2 [1G Fetching mechanize 2.7.3 [1G Installing mechanize 2.7.3 [1G Bundle complete! 2 Gemfile dependencies, 17 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Bundle completed (12.13s) [1G Cleaning up the bundler cache. [1G-----> Detecting rake tasks [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... Scraper didn't create an SQLite database in your current working directory called data.sqlite. If you've just created your first scraper and not edited the code yet this is to be expected. To fix this make your scraper write to an SQLite database at data.sqlite.

Statistics

Total run time: half a minute

Total cpu time used: less than 5 seconds

Total disk space used: 7.38 KB

History

  • Manually ran revision 4d8e4bd7 and failed .
  • Created on morph.io

Scraper code

Ruby

Scrapper / scraper.rb