ianheggie-oaf / perth

Perth Development Applications


This is a scraper that runs on Morph. To get started see the documentation

To run the scraper

bundle exec ruby scraper.rb

To run style and coding checks

bundle exec rubocop

Contributors mlandauer

Last run failed with status code 998.

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Installing bundler 2.3.10 [1G-----> Removing BUNDLED WITH version in the Gemfile.lock [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-3.2.2 [1G-----> Installing dependencies using bundler 2.3.10 [1G Running: BUNDLE_WITHOUT='development:test' BUNDLE_PATH=vendor/bundle BUNDLE_BIN=vendor/bundle/bin BUNDLE_DEPLOYMENT=1 bundle install -j4 [1G Fetching gem metadata from https://rubygems.org/......... [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Fetching public_suffix 6.0.2 [1G Fetching ast 2.4.3 [1G Fetching base64 0.3.0 [1G Using bundler 2.4.10 [1G Fetching connection_pool 2.5.3 [1G Installing base64 0.3.0 [1G Installing ast 2.4.3 [1G Installing connection_pool 2.5.3 [1G Installing public_suffix 6.0.2 [1G Fetching mutex_m 0.3.0 [1G Fetching domain_name 0.6.20240107 [1G Fetching json 2.12.2 [1G Installing mutex_m 0.3.0 [1G Fetching language_server-protocol 3.17.0.5 [1G Installing json 2.12.2 with native extensions [1G Installing domain_name 0.6.20240107 [1G Installing language_server-protocol 3.17.0.5 [1G Fetching lint_roller 1.1.0 [1G Installing lint_roller 1.1.0 [1G Fetching logger 1.7.0 [1G Fetching mime-types-data 3.2025.0603 [1G Installing logger 1.7.0 [1G Fetching net-http-digest_auth 1.4.1 [1G Installing net-http-digest_auth 1.4.1 [1G Installing mime-types-data 3.2025.0603 [1G Fetching racc 1.8.1 [1G Fetching webrick 1.9.1 [1G Installing racc 1.8.1 with native extensions [1G Installing webrick 1.9.1 [1G Fetching webrobots 0.1.2 [1G Installing webrobots 0.1.2 [1G Fetching parallel 1.27.0 [1G Fetching prism 1.4.0 [1G Installing parallel 1.27.0 [1G Fetching rainbow 3.1.1 [1G Installing rainbow 3.1.1 [1G Fetching regexp_parser 2.10.0 [1G Installing regexp_parser 2.10.0 [1G Installing prism 1.4.0 with native extensions [1G Fetching ruby-progressbar 1.13.0 [1G Installing ruby-progressbar 1.13.0 [1G Fetching unicode-emoji 4.0.4 [1G Installing unicode-emoji 4.0.4 [1G Fetching sqlite3 1.6.9 (x86_64-linux) [1G Fetching rubyntlm 0.6.5 [1G Installing sqlite3 1.6.9 (x86_64-linux) [1G Installing rubyntlm 0.6.5 [1G Fetching net-http-persistent 4.0.6 [1G Installing net-http-persistent 4.0.6 [1G Fetching httpclient 2.9.0 [1G Fetching addressable 2.8.7 [1G Installing addressable 2.8.7 [1G Installing httpclient 2.9.0 [1G Fetching http-cookie 1.0.8 [1G Installing http-cookie 1.0.8 [1G Fetching mime-types 3.7.0 [1G Fetching unicode-display_width 3.1.4 [1G Installing unicode-display_width 3.1.4 [1G Installing mime-types 3.7.0 [1G Fetching nokogiri 1.15.7 (x86_64-linux) [1G Fetching parser 3.3.8.0 [1G Installing parser 3.3.8.0 [1G Fetching sqlite_magic 0.0.6 [1G Installing sqlite_magic 0.0.6 [1G Installing nokogiri 1.15.7 (x86_64-linux) [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Fetching mechanize 2.8.5 [1G Installing mechanize 2.8.5 [1G Fetching rubocop-ast 1.45.0 [1G Installing rubocop-ast 1.45.0 [1G Fetching rubocop 1.76.0 [1G Installing rubocop 1.76.0 [1G Bundle complete! 5 Gemfile dependencies, 37 gems now installed. [1G Gems in the groups 'development' and 'test' were not installed. [1G Bundled gems are installed into `./vendor/bundle` [1G Bundle completed (20.32s) [1G Cleaning up the bundler cache. [1G Removing bundler (2.3.10) [1G-----> Detecting rake tasks [1G [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... Syntax Warning: May not be a PDF file (continuing anyway) Syntax Error (8): Illegal character <21> in hex string Syntax Error (10): Illegal character <4f> in hex string Syntax Error (12): Illegal character <54> in hex string Syntax Error (13): Illegal character <59> in hex string Syntax Error (14): Illegal character <50> in hex string Syntax Error (17): Illegal character <68> in hex string Syntax Error (18): Illegal character <74> in hex string Syntax Error (19): Illegal character <6d> in hex string Syntax Error (20): Illegal character <6c> in hex string Syntax Error (25): Illegal character <21> in hex string Syntax Error (26): Illegal character <2d> in hex string Syntax Error (27): Illegal character <2d> in hex string Syntax Error (28): Illegal character <5b> in hex string Syntax Error (29): Illegal character <69> in hex string Syntax Error (32): Illegal character <6c> in hex string Syntax Error (33): Illegal character <74> in hex string Syntax Error (35): Illegal character <49> in hex string Syntax Error (39): Illegal character <5d> in hex string Syntax Error (48): Illegal character <68> in hex string Syntax Error (49): Illegal character <74> in hex string Syntax Error (50): Illegal character <6d> in hex string Syntax Error (51): Illegal character <6c> in hex string Syntax Error (54): Illegal character <6c> in hex string Syntax Error (56): Illegal character <73> in hex string Syntax Error (57): Illegal character <73> in hex string Syntax Error (58): Illegal character <3d> in hex string Syntax Error (59): Illegal character <22> in hex string Syntax Error (60): Illegal character <6e> in hex string Syntax Error (61): Illegal character <6f> in hex string Syntax Error (62): Illegal character <2d> in hex string Syntax Error (63): Illegal character <6a> in hex string Syntax Error (64): Illegal character <73> in hex string Syntax Error (66): Illegal character <6c> in hex string Syntax Error (67): Illegal character <74> in hex string Syntax Error (68): Illegal character <2d> in hex string Syntax Error (69): Illegal character <69> in hex string Syntax Error (73): Illegal character <6c> in hex string Syntax Error (74): Illegal character <74> in hex string Syntax Error (75): Illegal character <2d> in hex string Syntax Error (76): Illegal character <69> in hex string Syntax Error (80): Illegal character <6c> in hex string Syntax Error (81): Illegal character <74> in hex string Syntax Error (82): Illegal character <2d> in hex string Syntax Error (83): Illegal character <69> in hex string Syntax Error (86): Illegal character <22> in hex string Syntax Error (90): Illegal character <21> in hex string Syntax Error (91): Illegal character <5b> in hex string Syntax Error (93): Illegal character <6e> in hex string Syntax Error (95): Illegal character <69> in hex string Syntax Error (97): Illegal character <5d> in hex string Syntax Error (98): Illegal character <2d> in hex string Syntax Error (99): Illegal character <2d> in hex string Syntax Error (104): Illegal character <21> in hex string Syntax Error (105): Illegal character <2d> in hex string Syntax Error (106): Illegal character <2d> in hex string Syntax Error (107): Illegal character <5b> in hex string Syntax Error (108): Illegal character <69> in hex string Syntax Error (111): Illegal character <49> in hex string Syntax Error (115): Illegal character <5d> in hex string Syntax Error (127): Illegal character <68> in hex string Syntax Error (128): Illegal character <74> in hex string Syntax Error (129): Illegal character <6d> in hex string Syntax Error (130): Illegal character <6c> in hex string Syntax Error (133): Illegal character <6c> in hex string Syntax Error (135): Illegal character <73> in hex string Syntax Error (136): Illegal character <73> in hex string Syntax Error (137): Illegal character <3d> in hex string Syntax Error (138): Illegal character <22> in hex string Syntax Error (139): Illegal character <6e> in hex string Syntax Error (140): Illegal character <6f> in hex string Syntax Error (141): Illegal character <2d> in hex string Syntax Error (142): Illegal character <6a> in hex string Syntax Error (143): Illegal character <73> in hex string Syntax Error (145): Illegal character <6c> in hex string Syntax Error (146): Illegal character <74> in hex string Syntax Error (147): Illegal character <2d> in hex string Syntax Error (148): Illegal character <69> in hex string Syntax Error (152): Illegal character <6c> in hex string Syntax Error (153): Illegal character <74> in hex string Syntax Error (154): Illegal character <2d> in hex string Syntax Error (155): Illegal character <69> in hex string Syntax Error (158): Illegal character <22> in hex string Syntax Error: Couldn't find trailer dictionary Syntax Error: Couldn't find trailer dictionary Syntax Error: Couldn't read xref table Syntax Warning: May not be a PDF file (continuing anyway) Syntax Error (8): Illegal character <21> in hex string Syntax Error (10): Illegal character <4f> in hex string Syntax Error (12): Illegal character <54> in hex string Syntax Error (13): Illegal character <59> in hex string Syntax Error (14): Illegal character <50> in hex string Syntax Error (17): Illegal character <68> in hex string Syntax Error (18): Illegal character <74> in hex string Syntax Error (19): Illegal character <6d> in hex string Syntax Error (20): Illegal character <6c> in hex string Syntax Error (25): Illegal character <21> in hex string Syntax Error (26): Illegal character <2d> in hex string Syntax Error (27): Illegal character <2d> in hex string Syntax Error (28): Illegal character <5b> in hex string Syntax Error (29): Illegal character <69> in hex string Syntax Error (32): Illegal character <6c> in hex string Syntax Error (33): Illegal character <74> in hex string Syntax Error (35): Illegal character <49> in hex string Syntax Error (39): Illegal character <5d> in hex string Syntax Error (48): Illegal character <68> in hex string Syntax Error (49): Illegal character <74> in hex string Syntax Error (50): Illegal character <6d> in hex string Syntax Error (51): Illegal character <6c> in hex string Syntax Error (54): Illegal character <6c> in hex string Syntax Error (56): Illegal character <73> in hex string Syntax Error (57): Illegal character <73> in hex string Syntax Error (58): Illegal character <3d> in hex string Syntax Error (59): Illegal character <22> in hex string Syntax Error (60): Illegal character <6e> in hex string Syntax Error (61): Illegal character <6f> in hex string Syntax Error (62): Illegal character <2d> in hex string Syntax Error (63): Illegal character <6a> in hex string Syntax Error (64): Illegal character <73> in hex string Syntax Error (66): Illegal character <6c> in hex string Syntax Error (67): Illegal character <74> in hex string Syntax Error (68): Illegal character <2d> in hex string Syntax Error (69): Illegal character <69> in hex string Syntax Error (73): Illegal character <6c> in hex string Syntax Error (74): Illegal character <74> in hex string Syntax Error (75): Illegal character <2d> in hex string Syntax Error (76): Illegal character <69> in hex string Syntax Error (80): Illegal character <6c> in hex string Syntax Error (81): Illegal character <74> in hex string Syntax Error (82): Illegal character <2d> in hex string Syntax Error (83): Illegal character <69> in hex string Syntax Error (86): Illegal character <22> in hex string Syntax Error (90): Illegal character <21> in hex string Syntax Error (91): Illegal character <5b> in hex string Syntax Error (93): Illegal character <6e> in hex string Syntax Error (95): Illegal character <69> in hex string Syntax Error (97): Illegal character <5d> in hex string Syntax Error (98): Illegal character <2d> in hex string Syntax Error (99): Illegal character <2d> in hex string Syntax Error (104): Illegal character <21> in hex string Syntax Error (105): Illegal character <2d> in hex string Syntax Error (106): Illegal character <2d> in hex string Syntax Error (107): Illegal character <5b> in hex string Syntax Error (108): Illegal character <69> in hex string Syntax Error (111): Illegal character <49> in hex string Syntax Error (115): Illegal character <5d> in hex string Syntax Error (127): Illegal character <68> in hex string Syntax Error (128): Illegal character <74> in hex string Syntax Error (129): Illegal character <6d> in hex string Syntax Error (130): Illegal character <6c> in hex string Syntax Error (133): Illegal character <6c> in hex string Syntax Error (135): Illegal character <73> in hex string Syntax Error (136): Illegal character <73> in hex string Syntax Error (137): Illegal character <3d> in hex string Syntax Error (138): Illegal character <22> in hex string Syntax Error (139): Illegal character <6e> in hex string Syntax Error (140): Illegal character <6f> in hex string Syntax Error (141): Illegal character <2d> in hex string Syntax Error (142): Illegal character <6a> in hex string Syntax Error (143): Illegal character <73> in hex string Syntax Error (145): Illegal character <6c> in hex string Syntax Error (146): Illegal character <74> in hex string Syntax Error (147): Illegal character <2d> in hex string Syntax Error (148): Illegal character <69> in hex string Syntax Error (152): Illegal character <6c> in hex string Syntax Error (153): Illegal character <74> in hex string Syntax Error (154): Illegal character <2d> in hex string Syntax Error (155): Illegal character <69> in hex string Syntax Error (158): Illegal character <22> in hex string Syntax Error: Couldn't find trailer dictionary Syntax Error: Couldn't find trailer dictionary Syntax Error: Couldn't read xref table Scraper didn't create an SQLite database in your current working directory called data.sqlite. If you've just created your first scraper and not edited the code yet this is to be expected. To fix this make your scraper write to an SQLite database at data.sqlite.

Statistics

Total run time: less than a minute

Total cpu time used: less than 5 seconds

Total disk space used: 18.3 KB

History

  • Manually ran revision ffede849 and failed .
  • Created on morph.io

Scraper code

Ruby

perth / scraper.rb