loren / mca_data

MCA trade leads from dgMarket


This is a scraper of MCA Trade Lead data from dgMarket that runs on Morph. It extracts country name, country code, deadline, and type from the multi-value attribute.

Contributors loren

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.2.5 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/...  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Using bundler 1.15.2  Fetching httpclient 2.6.0.1  Fetching sqlite3 1.3.10  Installing sqlite3 1.3.10 with native extensions  Installing httpclient 2.6.0.1  Fetching sqlite_magic 0.0.3  Installing sqlite_magic 0.0.3  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Bundle complete! 1 Gemfile dependency, 5 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (6.36s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... scraper.rb:28:in `parse_rss': undefined method `items' for nil:NilClass (NoMethodError) from scraper.rb:13:in `fetch_results' from scraper.rb:45:in `<main>'

Data

Downloaded 608 times by loren

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3.17 MB) Use the API

rows 0 / 0

Statistics

Average successful run time: half a minute

Total run time: 1 day

Total cpu time used: about 1 hour

Total disk space used: 3.2 MB

History

  • Auto ran revision 74670372 and failed .
    nothing changed in the database
  • Auto ran revision 74670372 and failed .
    nothing changed in the database
  • Auto ran revision 74670372 and failed .
    nothing changed in the database
  • Auto ran revision 74670372 and failed .
    nothing changed in the database
  • Auto ran revision 74670372 and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

mca_data / scraper.rb