Mraleksa / PlansOfProzorro

Scrapes public.api.openprocurement.org

Contributors Mraleksa

Last run failed with status code 137.

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Node.js app detected [1G [1G-----> Creating runtime environment [1G [1G NPM_CONFIG_LOGLEVEL=error [1G NPM_CONFIG_PRODUCTION=true [1G NPM_CONFIG_CAFILE=/etc/ssl/certs/ca-certificates.crt [1G NODE_VERBOSE=false [1G NODE_ENV=production [1G NODE_TLS_REJECT_UNAUTHORIZED=0 [1G NODE_MODULES_CACHE=true [1G [1G-----> Installing binaries [1G engines.node (package.json): unspecified [1G engines.npm (package.json): unspecified (use default) [1G [1G Resolving node version 6.x... [1G Downloading and installing node 6.12.2... [1G Using default npm version: 3.10.10 [1G [1G-----> Restoring cache [1G Skipping cache restore (not-found) [1G [1G-----> Building dependencies [1G Installing node modules (package.json) [1G [1G > sqlite3@3.1.13 install /tmp/build/node_modules/sqlite3 [1G > node-pre-gyp install --fallback-to-build [1G [1G [sqlite3] Success: "/tmp/build/node_modules/sqlite3/lib/binding/node-v48-linux-x64/node_sqlite3.node" is installed via remote [1G @0.0.1 /tmp/build [1G +-- d3@4.12.0 [1G | +-- d3-array@1.2.1 [1G | +-- d3-axis@1.0.8 [1G | +-- d3-brush@1.0.4 [1G | +-- d3-chord@1.0.4 [1G | +-- d3-collection@1.0.4 [1G | +-- d3-color@1.0.3 [1G | +-- d3-dispatch@1.0.3 [1G | +-- d3-drag@1.2.1 [1G | +-- d3-dsv@1.0.8 [1G | | +-- iconv-lite@0.4.19 [1G | | `-- rw@1.3.3 [1G | +-- d3-ease@1.0.3 [1G | +-- d3-force@1.1.0 [1G | +-- d3-format@1.2.1 [1G | +-- d3-geo@1.9.0 [1G | +-- d3-hierarchy@1.1.5 [1G | +-- d3-interpolate@1.1.6 [1G | +-- d3-path@1.0.5 [1G | +-- d3-polygon@1.0.3 [1G | +-- d3-quadtree@1.0.3 [1G | +-- d3-queue@3.0.7 [1G | +-- d3-random@1.1.0 [1G | +-- d3-request@1.0.6 [1G | | `-- xmlhttprequest@1.8.0 [1G | +-- d3-scale@1.0.7 [1G | +-- d3-selection@1.2.0 [1G | +-- d3-shape@1.2.0 [1G | +-- d3-time@1.0.8 [1G | +-- d3-time-format@2.1.1 [1G | +-- d3-timer@1.0.7 [1G | +-- d3-transition@1.1.1 [1G | +-- d3-voronoi@1.1.2 [1G | `-- d3-zoom@1.7.1 [1G +-- http-api-client@0.1.8 [1G | `-- promise@5.0.0 [1G | `-- asap@1.0.0 [1G +-- sqlite-json@1.0.1 [1G | +-- commander@2.12.2 [1G | `-- mkdirp@0.5.1 [1G | `-- minimist@0.0.8 [1G `-- sqlite3@3.1.13 [1G +-- nan@2.7.0 [1G `-- node-pre-gyp@0.6.38 [1G +-- hawk@3.1.3 [1G | +-- boom@2.10.1 [1G | +-- cryptiles@2.0.5 [1G | +-- hoek@2.16.3 [1G | `-- sntp@1.0.9 [1G +-- mkdirp@0.5.1 [1G | `-- minimist@0.0.8 [1G +-- nopt@4.0.1 [1G | +-- abbrev@1.1.1 [1G | `-- osenv@0.1.4 [1G | +-- os-homedir@1.0.2 [1G | `-- os-tmpdir@1.0.2 [1G +-- npmlog@4.1.2 [1G | +-- are-we-there-yet@1.1.4 [1G | | `-- delegates@1.0.0 [1G | +-- console-control-strings@1.1.0 [1G | +-- gauge@2.7.4 [1G | | +-- aproba@1.2.0 [1G | | +-- has-unicode@2.0.1 [1G | | +-- object-assign@4.1.1 [1G | | +-- signal-exit@3.0.2 [1G | | +-- string-width@1.0.2 [1G | | | +-- code-point-at@1.1.0 [1G | | | `-- is-fullwidth-code-point@1.0.0 [1G | | | `-- number-is-nan@1.0.1 [1G | | +-- strip-ansi@3.0.1 [1G | | | `-- ansi-regex@2.1.1 [1G | | `-- wide-align@1.1.2 [1G | `-- set-blocking@2.0.0 [1G +-- rc@1.2.1 [1G | +-- deep-extend@0.4.2 [1G | +-- ini@1.3.4 [1G | +-- minimist@1.2.0 [1G | `-- strip-json-comments@2.0.1 [1G +-- request@2.81.0 [1G | +-- aws-sign2@0.6.0 [1G | +-- aws4@1.6.0 [1G | +-- caseless@0.12.0 [1G | +-- combined-stream@1.0.5 [1G | | `-- delayed-stream@1.0.0 [1G | +-- extend@3.0.1 [1G | +-- forever-agent@0.6.1 [1G | +-- form-data@2.1.4 [1G | | `-- asynckit@0.4.0 [1G | +-- har-validator@4.2.1 [1G | | +-- ajv@4.11.8 [1G | | | +-- co@4.6.0 [1G | | | `-- json-stable-stringify@1.0.1 [1G | | | `-- jsonify@0.0.0 [1G | | `-- har-schema@1.0.5 [1G | +-- http-signature@1.1.1 [1G | | +-- assert-plus@0.2.0 [1G | | +-- jsprim@1.4.1 [1G | | | +-- assert-plus@1.0.0 [1G | | | +-- extsprintf@1.3.0 [1G | | | +-- json-schema@0.2.3 [1G | | | `-- verror@1.10.0 [1G | | | `-- assert-plus@1.0.0 [1G | | `-- sshpk@1.13.1 [1G | | +-- asn1@0.2.3 [1G | | +-- assert-plus@1.0.0 [1G | | +-- bcrypt-pbkdf@1.0.1 [1G | | +-- dashdash@1.14.1 [1G | | | `-- assert-plus@1.0.0 [1G | | +-- ecc-jsbn@0.1.1 [1G | | +-- getpass@0.1.7 [1G | | | `-- assert-plus@1.0.0 [1G | | +-- jsbn@0.1.1 [1G | | `-- tweetnacl@0.14.5 [1G | +-- is-typedarray@1.0.0 [1G | +-- isstream@0.1.2 [1G | +-- json-stringify-safe@5.0.1 [1G | +-- mime-types@2.1.17 [1G | | `-- mime-db@1.30.0 [1G | +-- oauth-sign@0.8.2 [1G | +-- performance-now@0.2.0 [1G | +-- qs@6.4.0 [1G | +-- safe-buffer@5.1.1 [1G | +-- stringstream@0.0.5 [1G | +-- tough-cookie@2.3.3 [1G | | `-- punycode@1.4.1 [1G | +-- tunnel-agent@0.6.0 [1G | `-- uuid@3.1.0 [1G +-- rimraf@2.6.2 [1G | `-- glob@7.1.2 [1G | +-- fs.realpath@1.0.0 [1G | +-- inflight@1.0.6 [1G | +-- minimatch@3.0.4 [1G | | `-- brace-expansion@1.1.8 [1G | | +-- balanced-match@1.0.0 [1G | | `-- concat-map@0.0.1 [1G | `-- path-is-absolute@1.0.1 [1G +-- semver@5.4.1 [1G +-- tar@2.2.1 [1G | +-- block-stream@0.0.9 [1G | +-- fstream@1.0.11 [1G | | `-- graceful-fs@4.1.11 [1G | `-- inherits@2.0.3 [1G `-- tar-pack@3.4.0 [1G +-- debug@2.6.9 [1G | `-- ms@2.0.0 [1G +-- fstream-ignore@1.0.5 [1G +-- once@1.4.0 [1G | `-- wrappy@1.0.2 [1G +-- readable-stream@2.3.3 [1G | +-- core-util-is@1.0.2 [1G | +-- isarray@1.0.0 [1G | +-- process-nextick-args@1.0.7 [1G | +-- string_decoder@1.0.3 [1G | `-- util-deprecate@1.0.2 [1G `-- uid-number@0.0.6 [1G [1G [1G-----> Caching build [1G Clearing previous node cache [1G Saving 2 cacheDirectories (default): [1G - node_modules [1G - bower_components (nothing to cache) [1G [1G-----> Build succeeded! [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... старт: 2017-09-21T15:35:59.091342+03:00 2017-09-21T15:41:06.124877+03:00 2017-09-21T15:47:57.378137+03:00 2017-09-21T15:54:04.040565+03:00 2017-09-21T16:00:07.086925+03:00 2017-09-21T16:04:34.060870+03:00 2017-09-21T16:09:44.375843+03:00 2017-09-21T16:16:05.668106+03:00 2017-09-21T16:20:49.696050+03:00 2017-09-21T16:24:50.291334+03:00 2017-09-21T16:33:02.111954+03:00 stop 1 2017-09-21T16:37:00.730087+03:00 2017-09-21T16:39:41.843648+03:00 2017-09-21T16:47:37.516956+03:00 2017-09-21T16:58:34.884043+03:00 2017-09-21T17:15:27.319125+03:00 2017-09-21T17:28:26.102091+03:00 2017-09-21T17:41:32.857074+03:00 2017-09-21T18:04:43.829709+03:00 2017-09-21T18:27:37.641494+03:00 2017-09-21T19:43:47.121174+03:00 stop 2 2017-09-21T21:51:39.563411+03:00 2017-09-22T07:49:36.805315+03:00 2017-09-22T08:29:07.901695+03:00 2017-09-22T08:45:03.611831+03:00 2017-09-22T08:56:29.494428+03:00 2017-09-22T09:06:34.583178+03:00 2017-09-22T09:17:12.625080+03:00 2017-09-22T09:27:56.682292+03:00 2017-09-22T09:34:47.816352+03:00 2017-09-22T09:44:00.432564+03:00 stop 3 2017-09-22T09:51:05.686058+03:00 2017-09-22T09:56:38.365387+03:00 2017-09-22T10:02:22.873341+03:00 2017-09-22T10:10:06.756903+03:00 2017-09-22T10:15:54.258663+03:00 2017-09-22T10:20:32.190100+03:00 2017-09-22T10:24:48.150387+03:00 2017-09-22T10:29:22.087337+03:00 2017-09-22T10:35:23.732756+03:00 2017-09-22T10:42:39.703776+03:00 stop 4 2017-09-22T10:46:31.245155+03:00 2017-09-22T10:52:50.918782+03:00 2017-09-22T10:58:29.816891+03:00 2017-09-22T11:04:09.743953+03:00 2017-09-22T11:08:23.785380+03:00 2017-09-22T11:10:24.085298+03:00 2017-09-22T11:13:56.134658+03:00 2017-09-22T11:16:23.566245+03:00 2017-09-22T11:23:18.048330+03:00 2017-09-22T11:30:32.462073+03:00 stop 5 2017-09-22T11:38:03.033033+03:00 2017-09-22T11:43:53.598042+03:00 2017-09-22T11:49:21.415149+03:00 2017-09-22T11:53:11.385036+03:00 2017-09-22T11:58:24.681062+03:00 2017-09-22T12:05:05.250067+03:00 2017-09-22T12:11:10.807644+03:00 2017-09-22T12:15:58.485265+03:00 2017-09-22T12:23:56.858294+03:00 2017-09-22T12:31:28.171531+03:00 stop 6 2017-09-22T12:34:40.366728+03:00 2017-09-22T12:40:32.401392+03:00 2017-09-22T12:48:34.372693+03:00 2017-09-22T12:52:59.681848+03:00 2017-09-22T12:53:29.716354+03:00 2017-09-22T12:58:18.515789+03:00 2017-09-22T13:06:42.800302+03:00 2017-09-22T13:14:53.331074+03:00 2017-09-22T13:25:05.258935+03:00 2017-09-22T13:32:32.397445+03:00 stop 7 2017-09-22T13:39:11.561285+03:00 2017-09-22T13:46:10.453198+03:00 2017-09-22T13:54:23.134245+03:00 2017-09-22T14:00:56.499108+03:00 2017-09-22T14:05:32.716715+03:00 2017-09-22T14:10:51.138705+03:00 2017-09-22T14:15:18.232877+03:00 2017-09-22T14:20:58.543556+03:00 2017-09-22T14:27:21.450047+03:00 2017-09-22T14:33:39.296101+03:00 stop 8 2017-09-22T14:35:36.871429+03:00 2017-09-22T14:39:19.307930+03:00 2017-09-22T14:44:06.876938+03:00 2017-09-22T14:46:04.846927+03:00 2017-09-22T14:51:14.850651+03:00 2017-09-22T14:55:29.129334+03:00 2017-09-22T15:00:28.807854+03:00 2017-09-22T15:06:17.339564+03:00 2017-09-22T15:12:14.172636+03:00 2017-09-22T15:18:44.775048+03:00 stop 9 2017-09-22T15:24:44.656241+03:00 2017-09-22T15:28:49.661724+03:00 2017-09-22T15:33:18.239655+03:00 2017-09-22T15:37:26.273429+03:00 2017-09-22T15:42:06.341531+03:00 2017-09-22T15:42:15.682859+03:00 2017-09-22T15:45:00.461642+03:00 2017-09-22T15:48:09.539313+03:00 2017-09-22T15:50:46.066199+03:00 2017-09-22T15:58:27.091426+03:00 stop 10 2017-09-22T16:05:08.012431+03:00 2017-09-22T16:12:03.342692+03:00 2017-09-22T16:19:00.313561+03:00 2017-09-22T16:25:07.471565+03:00 2017-09-22T16:33:18.941428+03:00 2017-09-22T16:43:02.155737+03:00 2017-09-22T16:45:11.368143+03:00 2017-09-22T16:50:22.065605+03:00 2017-09-22T16:56:34.319808+03:00 2017-09-22T17:06:59.227189+03:00 stop 11 2017-09-22T17:23:30.206747+03:00 2017-09-22T17:43:28.330434+03:00 2017-09-22T18:33:26.852250+03:00 2017-09-22T20:15:14.123757+03:00 2017-09-22T22:00:06.335396+03:00 2017-09-22T22:56:15.930347+03:00 2017-09-23T11:03:15.069095+03:00 2017-09-23T12:55:47.701227+03:00 2017-09-23T15:41:29.723137+03:00 2017-09-23T21:14:37.084932+03:00 stop 12 2017-09-24T12:01:41.082000+03:00 2017-09-24T20:40:25.536712+03:00 2017-09-25T08:24:42.874508+03:00 2017-09-25T08:49:51.169062+03:00

Data

Downloaded 138 times by Mraleksa

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (2.1 MB) Use the API

rows 10 / 12026

dateModified name id amount procurementMethod
2017-09-21T15:36:23.572980+03:00
адміністрація шевченківського району харківської міської ради
37459172
3293
2017-09-21T15:36:22.915660+03:00
українське державне проектне лісовпорядне виробниче об'єднання
00968167
15680
open
2017-09-21T15:38:35.605111+03:00
пришибський нвк
25457717
2795
2017-09-21T15:38:43.717980+03:00
державне підприємство "національний академічний український драматичний театр імені марії заньковецької"
02224614
9450
2017-09-21T15:38:42.879195+03:00
відділ освіти бориславської міської ради
02144714
15639
open
2017-09-21T15:35:59.091342+03:00
кз грр "городоцька центральна районна лікарня"
01997863
9960
2017-09-21T15:36:25.025285+03:00
комунальна установа "хорошівський психоневрологічний інтернат"
33920224
2634
2017-09-21T15:36:03.507277+03:00
районна адміністрація запорізької міської ради по комунарському району
37573541
7579
2017-09-21T15:36:05.226836+03:00
українське державне проектне лісовпорядне виробниче об'єднання
00968167
1600
open
2017-09-21T15:36:13.027956+03:00
українське державне проектне лісовпорядне виробниче об'єднання
00968167
3000
open

Statistics

Average successful run time: 27 minutes

Total run time: about 10 hours

Total cpu time used: about 1 hour

Total disk space used: 2.13 MB

History

  • Manually ran revision b19cdbe7 and failed .
    12026 records added in the database
    12424 pages scraped
  • Manually ran and failed .
  • Manually ran revision 3a95ece9 and completed successfully .
    195067 records added in the database
  • Manually ran revision 58bcb426 and completed successfully .
    198760 records added in the database
  • Manually ran revision 006b63c4 and completed successfully .
    49772 records added in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

PlansOfProzorro