loren / state_data

Leads from the US Department of State BIDS (Business Information Database System)


Contributors loren

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.2.5 [1G-----> Installing dependencies using bundler 1.11.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G Fetching gem metadata from https://rubygems.org/............ [1G Fetching version metadata from https://rubygems.org/.. [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Installing multi_xml 0.5.5 [1G Installing json 1.8.3 with native extensions [1G Installing httpclient 2.6.0.1 [1G Installing sqlite3 1.3.10 with native extensions [1G Using bundler 1.11.2 [1G Installing sqlite_magic 0.0.3 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Installing httparty 0.13.7 [1G Bundle complete! 2 Gemfile dependencies, 8 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Post-install message from httparty: [1G When you HTTParty, you must party hard! [1G Bundle completed (9.45s) [1G Cleaning up the bundler cache. [1G Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... /app/vendor/bundle/ruby/2.2.0/gems/json-1.8.3/lib/json/common.rb:155:in `parse': 757: unexpected token at '<!DOCTYPE html> (JSON::ParserError) <html lang="en"> <head> <meta charset="utf-8"> <meta name="viewport" content="width=device-width, initial-scale=1.0, maximum-scale=1.0, user-scalable=no" /> <meta name="description" content=""> <meta name="author" content=""> <link rel="shortcut icon" href="../../assets/ico/favicon.png"> <title>BIDS</title> <script src="/bower_components/jquery/dist/jquery.min.js"></script> <script src="/bower_components/lodash/lodash.min.js"></script> <script src="/bower_components/select2/dist/js/select2.min.js"></script> <script src="/bower_components/jquery-validation/dist/jquery.validate.min.js"></script> <script src="/bower_components/datatables/media/js/jquery.dataTables.min.js"></script> <script src="/bower_components/datatables/media/js/dataTables.bootstrap.min.js"></script> <script src="/bower_components/nouislider/distribute/nouislider.min.js"></script> <script src="/bower_components/wnumb/wNumb.js"></script> <!--<script src="/bower_components/leaflet/dist/leaflet.js"></script>--> <!-- CSS dependencies --> <link rel="stylesheet" href="/bower_components/datatables/media/css/dataTables.bootstrap.min.css"> <!-- Bootstrap JS --> <script src="/bower_components/bootstrap/dist/js/bootstrap.min.js"></script> <script src="/bower_components/bootstrap-multiselect/dist/js/bootstrap-multiselect.js"></script> <!-- Bootstrap core CSS --> <link rel="stylesheet" href="/bower_components/bootstrap/dist/css/bootstrap.min.css"> <link rel="stylesheet" href="/bower_components/select2/dist/css/select2.min.css"> <link rel="stylesheet" href="/bower_components/select2/dist/css/select2.min.css"> <link rel="stylesheet" href="/bower_components/bootstrap-multiselect/dist/css/bootstrap-multiselect.css"> <link rel="stylesheet" href="/bower_components/nouislider/distribute/nouislider.min.css"> <!--<link rel="stylesheet" href="/bower_components/leaflet/dist/leaflet.css">--> <!-- Including Async await files --> <script src="/bower_components/async/dist/async.min.js"></script> <!-- <link rel="stylesheet" href="https://cdn.jsdelivr.net/flexboxgrid/6.3.0/flexboxgrid.min.css" type="text/css" > --> <!-- Custom styles for this template --> <link href="/css/bids-style.css" rel="stylesheet"> <link href="/css/app.css" rel="stylesheet"> <!-- Application javascript --> <script src="/scripts/bids.js"></script> <script src="/scripts/navbar.js"></script> <!--[if lt IE 9]><script src="../../docs-assets/js/ie8-responsive-file-warning.js"></script><![endif]--> <!-- HTML5 shim and Respond.js IE8 support of HTML5 elements and media queries --> <!--[if lt IE 9]> <script src="https://oss.maxcdn.com/libs/html5shiv/3.7.0/html5shiv.js"></script> <script src="https://oss.maxcdn.com/libs/respond.js/1.4.2/respond.min.js"></script> <![endif]--> </head> <body> <main class="main-container"> <nav id="navbar" class="navbar nav navbar-default section--navbar"> <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target=".navbar-collapse"> <span class="sr-only">Toggle navigation</span> <span class="icon-bar"></span> <span class="icon-bar"></span> <span class="icon-bar"></span> </button> <a class="navbar-brand bids-primary-text logo-display" href="/"> <img src="../../assets/img/logo.jpg" height="50"> </a> <div class="navbar-collapse collapse"> <div class="navbar-left"> </div> <ul id="nav-bar" class="nav navbar-nav navbar-right"> <li><a href="/subscribe">Subscribe</a></li> <li class="active"><a href="/map">Map</a></li> <li><a href="/faq">About</a></li> <li><a href="/feedback">Feedback</a></li> <li><a href="#" data-toggle="modal" data-target="#login-modal">Login</a></li> </ul> </div><!--/.nav-collapse --> </nav> <div class="alert alert-danger note map-alerts">Not Found</div> <div class="modal fade" id="login-modal" tabindex="-1" role="dialog" aria-labelledby="myModalLabel" aria-hidden="true" style="display: none;"> <div class="modal-dialog"> <div class="loginmodal-container"> <h1>Login to Your Account</h1><br> <form action="/login" method="post"> <input type="text" name="email" placeholder="Email"> <input type="password" name="password" placeholder="Password"> <input type="submit" name="login" class="login loginmodal-submit" value="Login"> </form> <div class="login-help"> <a href="#" data-toggle="modal" data-target="#signup-modal" data-dismiss="modal">Register</a> - <a href="#" data-toggle="modal" data-target="#notyet-modal" data-dismiss="modal">Forgot Password</a> </div> </div> </div> </div> <div class="modal fade" id="signup-modal" tabindex="-1" role="dialog" aria-labelledby="signupLabel" aria-hidden="true" style="display: none;"> <div class="modal-dialog"> <div class="signup-modal-container"> <!-- show any messages that come back with authentication --> <div class="alert alert-danger">Not Found</div> <h1>Create an Account</h1><br> <form action="/signup" method="post" id="signup-form"> <input type="text" name="email" placeholder="Email"> <input type="password" name="password" id="password" placeholder="Password"> <input type="password" name="password_again" id="password_again" placeholder="Re-type Password"> <input type="submit" name="signup" class="signup signup-modal-submit" value="Create Account"> </form> </div> </div> </div> <script> $("#signup-form").validate({ rules: { password: 'required', password_again: { required: true, equalTo: "#password" }, email: { required: true, email: true, govEmails: true } } }); </script> <div class="modal fade" id="notyet-modal" tabindex="-1" role="dialog" aria-labelledby="notyetLabel" aria-hidden="true" style="display: none;"> <div class="modal-dialog"> <div class="signup-modal-container"> <h1>Not Yet Implemented</h1><br> </div> </div> </div> <div class="container-fluid"> <div class="container section--error"> <h1 class="text-center">Not Found</h1> <br/> <div class="carousel slide" data-ride="carousel"> <div class="carousel-inner"> <div class="item active"> <img src="/images/error.jpg" class="img-thumbnail center-block error-image" alt="Error happened!"> <div class="carousel-caption"> <p class="error-full-message">Error: Not Found</p> </div> </div> </div> </div> </div> </div> </main> <footer> </footer> </body> </html> ' from /app/vendor/bundle/ruby/2.2.0/gems/json-1.8.3/lib/json/common.rb:155:in `parse' from scraper.rb:19:in `fetch_results' from scraper.rb:42:in `<main>'

Data

Downloaded 441 times by loren

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3.26 MB) Use the API

rows 0 / 0

Statistics

Average successful run time: half a minute

Total run time: 1 day

Total cpu time used: 3 minutes

Total disk space used: 3.28 MB

History

  • Manually ran revision bd5d4176 and failed .
    nothing changed in the database
  • Auto ran revision bd5d4176 and failed .
    nothing changed in the database
  • Auto ran revision bd5d4176 and failed .
    nothing changed in the database
  • Auto ran revision bd5d4176 and failed .
    nothing changed in the database
  • Auto ran revision bd5d4176 and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

state_data