loren / canada_data

Trade / procurement data from Canada

This is a scraper of Canada Trade Leads data that runs on Morph.

Contributors loren

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.2.5 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/...  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching httpclient  Using bundler 1.15.2  Fetching sqlite3 1.3.10  Installing sqlite3 1.3.10 with native extensions  Installing httpclient  Fetching sqlite_magic 0.0.3  Installing sqlite_magic 0.0.3  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Bundle complete! 1 Gemfile dependency, 5 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (5.96s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... /app/vendor/bundle/ruby/2.2.0/gems/sqlite3-1.3.10/lib/sqlite3/statement.rb:108:in `step': database disk image is malformed (SQLite3::CorruptException) from /app/vendor/bundle/ruby/2.2.0/gems/sqlite3-1.3.10/lib/sqlite3/statement.rb:108:in `block in each' from /app/vendor/bundle/ruby/2.2.0/gems/sqlite3-1.3.10/lib/sqlite3/statement.rb:107:in `loop' from /app/vendor/bundle/ruby/2.2.0/gems/sqlite3-1.3.10/lib/sqlite3/statement.rb:107:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/sqlite3-1.3.10/lib/sqlite3/database.rb:158:in `to_a' from /app/vendor/bundle/ruby/2.2.0/gems/sqlite3-1.3.10/lib/sqlite3/database.rb:158:in `block in execute' from /app/vendor/bundle/ruby/2.2.0/gems/sqlite3-1.3.10/lib/sqlite3/database.rb:95:in `prepare' from /app/vendor/bundle/ruby/2.2.0/gems/sqlite3-1.3.10/lib/sqlite3/database.rb:134:in `execute' from /app/vendor/bundle/ruby/2.2.0/gems/sqlite_magic-0.0.3/lib/sqlite_magic.rb:93:in `block in save_data' from /app/vendor/bundle/ruby/2.2.0/gems/sqlite_magic-0.0.3/lib/sqlite_magic.rb:88:in `each' from /app/vendor/bundle/ruby/2.2.0/gems/sqlite_magic-0.0.3/lib/sqlite_magic.rb:88:in `save_data' from /app/vendor/bundle/ruby/2.2.0/bundler/gems/scraperwiki-ruby-fc5017681250/lib/scraperwiki.rb:89:in `save_sqlite' from scraper.rb:17:in `block in fetch_results' from scraper.rb:15:in `each' from scraper.rb:15:in `fetch_results' from scraper.rb:41:in `<main>' {"language"=>"English", "title"=>"5-Year Corrosion Inspection (202200009/A)", "reference_number"=>"PW-22-00984000", "solicitation_number"=>"202200009/A", "amendment_number"=>"001", "publication_date"=>"2022-01-28", "date_closing"=>"2022-02-14 14:00 Eastern Standard Time (EST)", "amendment_date"=>"2022-01-28", "publishing_status"=>"Active", "gsin_unspsc"=>"JX1510C - Aircraft, Fixed Wing - Repair and Overhaul (Civilian)", "region_opportunity"=>"Canada", "region_delivery"=>"Canada", "notice_type"=>"DDP-RFP", "trade_agreement"=>"Canadian Free Trade Agreement (CFTA)", "tendering_procedure"=>"Solely Canadian content", "competitive_procurement_strategy"=>nil, "non_competitive_procurement_strategy"=>nil, "procurement_entity"=>"Royal Canadian Mounted Police", "end_user_entity"=>"Royal Canadian Mounted Police", "description"=>"The Royal Canadian Mounted Police (RCMP) Air Services Branch requires a 5-year corrosion inspection to be performed on the DeHavilland Twin Otter C-GMPJ, Serial Number 534 based in Goose Bay, Labrador. The period of the contract is from the date of award and ends 9 weeks later. All enquiries of a technical nature and all questions of a contractual nature, are to be submitted to the Contracting Authority: Anouk St-Aubin, 438-462-2984, or by e-mail at anouk.st-aubin@rcmp-grc.gc.ca Inquiries are to be made in writing and should be received not less than five (5) calendar days prior to the closing date to allow sufficient time to respond. There are security requirements associated with this requirement. Basis of selection: Highest Combined Rating of Technical Merit (60%) and Price (40%) To be declared responsive, a bid must: comply with all the requirements of the bid solicitation; and meet all mandatory criteria; and obtain the required minimum points specified for criteria numbers R1 and R2 for the technical evaluation, and obtain the required minimum of 4 points overall for the technical evaluation criteria which are subject to point rating. The rating is performed on a scale of 25 points. The requirement is limited to Canadian goods and/or services Tenders must be submitted to the RCMP Bid Receiving Unit at: Anouk.st-aubin@rcmp-grc.gc.ca Refer to the attached tender documents to obtain further information. Canada retains the right to negotiate with any supplier on any procurement. Documents may be submitted in either official language of Canada. Procuring Office: Anouk St-Aubin Procurement Specialist Procurement and Contracting Branch Royal Canadian Mounted Police 73 Leikin Dr, Mailstop 15 Ottawa, ON K1A 0R2 Anouk.st-aubin@rcmp-grc.gc.ca The RCMP has adopted the Integrity Regime administered by Public Services and Procurement Canada. As a result, the integrity provisions are being applied in RCMP contracting activities as outlined in this solicitation. Canada will make available Notices of Proposed Procurement (NPP), bid solicitations and related documents for download through the Government Electronic Tendering Service (GETS) at http://www.buyandsell.gc.ca/tenders . Canada is not responsible and will not assume any liabilities whatsoever for the information found on websites of third parties. In the event an NPP, bid solicitation or related documentation would be amended, Canada will not be sending notifications. Canada will post all amendments, including significant enquiries received and their replies, using GETS. It is the sole responsibility of the Bidder to regularly consult GETS for the most up-to-date information. Canada will not be liable for any oversight on the Bidder's part nor for notification services offered by a third party.", "access_terms_of_use"=>"Procurement data carries an \"Open Government Licence - Canada\" that governs its use. Please refer to the section about Commercial Reproduction in the Buyandsell.gc.ca \"Terms and Conditions\" for more information.", "contact"=>"St-Aubin, Anouk, anouk.st-aubin@rcmp-grc.gc.ca, 438-462-2984", "document"=>"https://buyandsell.gc.ca/cds/public/2022/01/28/44218736c9cb67e322acc86a0b0b3c46/202200009_rfp_en.pdf, https://buyandsell.gc.ca/cds/public/2022/01/28/157ed1c5ad65adff246622ac8f1cf2d0/202200009_ddp_fr.pdf", "attachment"=>""}


Downloaded 685 times by loren

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (9.72 MB) Use the API

rows 0 / 0


Average successful run time: 4 minutes

Total run time: 4 days

Total cpu time used: about 16 hours

Total disk space used: 9.74 MB


  • Auto ran revision e69f66c2 and failed .
    nothing changed in the database
  • Auto ran revision e69f66c2 and failed .
    nothing changed in the database
  • Auto ran revision e69f66c2 and failed .
    nothing changed in the database
  • Auto ran revision e69f66c2 and failed .
    nothing changed in the database
  • Auto ran revision e69f66c2 and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code


canada_data / scraper.rb