gooch / city_of_busselton_policy_manual

Busselton Policy Documents

Scrapes www.busselton.wa.gov.au

City of Busselton


Contributors gooch

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.3.1 [1G-----> Installing dependencies using bundler 1.15.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Fetching gem metadata from https://rubygems.org/........ [1G Fetching version metadata from https://rubygems.org/. [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Using bundler 1.15.2 [1G Fetching unf_ext 0.0.7.1 [1G Fetching httpclient 2.6.0.1 [1G Fetching mime-types 2.5 [1G Installing mime-types 2.5 [1G Installing httpclient 2.6.0.1 [1G Installing unf_ext 0.0.7.1 with native extensions [1G Fetching net-http-digest_auth 1.4 [1G Fetching net-http-persistent 2.9.4 [1G Installing net-http-digest_auth 1.4 [1G Installing net-http-persistent 2.9.4 [1G Fetching mini_portile 0.6.2 [1G Fetching ntlm-http 0.1.1 [1G Installing ntlm-http 0.1.1 [1G Fetching webrobots 0.1.1 [1G Installing webrobots 0.1.1 [1G Fetching sqlite3 1.3.10 [1G Installing mini_portile 0.6.2 [1G Installing sqlite3 1.3.10 with native extensions [1G Fetching nokogiri 1.6.6.2 [1G Installing nokogiri 1.6.6.2 with native extensions [1G Fetching unf 0.1.4 [1G Installing unf 0.1.4 [1G Fetching domain_name 0.5.24 [1G Installing domain_name 0.5.24 [1G Fetching http-cookie 1.0.2 [1G Installing http-cookie 1.0.2 [1G Fetching sqlite_magic 0.0.3 [1G Installing sqlite_magic 0.0.3 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Fetching mechanize 2.7.3 [1G Installing mechanize 2.7.3 [1G Bundle complete! 2 Gemfile dependencies, 17 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Bundle completed (31.55s) [1G Cleaning up the bundler cache. [1G-----> Detecting rake tasks [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... I, [2018-01-07T07:47:44.064623 #17] INFO -- : Could not find date in http://www.busselton.wa.gov.au/files/sharedassets/public/ecm/ceogov/communitypolicies/review_of_cp004_busselton_jetty_memorials_pand_l_180517.pdf using (?-mix:Last.updated.(\d{2})\/(\d{2})\/(\d{4})) I, [2018-01-07T07:47:44.091210 #17] INFO -- : Could not find date in http://www.busselton.wa.gov.au/files/sharedassets/public/ecm/ceogov/communitypolicies/review_of_cp004_busselton_jetty_memorials_pand_l_180517.pdf using (?-mix:Implemented (\d{2})\/(\d{2})\/(\d{4})) I, [2018-01-07T07:47:44.123394 #17] INFO -- : Could not find date in http://www.busselton.wa.gov.au/files/sharedassets/public/ecm/ceogov/communitypolicies/review_of_cp004_busselton_jetty_memorials_pand_l_180517.pdf using (?-mix:Last.updated.(.*)) E, [2018-01-07T07:47:44.123507 #17] ERROR -- : Could not find a date in http://www.busselton.wa.gov.au/files/sharedassets/public/ecm/ceogov/communitypolicies/review_of_cp004_busselton_jetty_memorials_pand_l_180517.pdf using any pattern I, [2018-01-07T07:47:44.123552 #17] INFO -- : {"title"=>"Council Policy : 004 - Busselton Jetty - Placement of Memorial Plaques (PDF, 26KB)", "document_url"=>"http://www.busselton.wa.gov.au/files/sharedassets/public/ecm/ceogov/communitypolicies/review_of_cp004_busselton_jetty_memorials_pand_l_180517.pdf", "id"=>"cp004"} Skipping already saved record cp004 I, [2018-01-07T07:47:46.016141 #17] INFO -- : Could not find date in http://www.busselton.wa.gov.au/files/sharedassets/public/ecm/ceogov/communitypolicies/review_of_cp006_mobile_vendors_jetty_pandl_180517cleanversion.pdf using (?-mix:Last.updated.(\d{2})\/(\d{2})\/(\d{4})) I, [2018-01-07T07:47:46.038843 #17] INFO -- : Could not find date in http://www.busselton.wa.gov.au/files/sharedassets/public/ecm/ceogov/communitypolicies/review_of_cp006_mobile_vendors_jetty_pandl_180517cleanversion.pdf using (?-mix:Implemented (\d{2})\/(\d{2})\/(\d{4})) I, [2018-01-07T07:47:46.069617 #17] INFO -- : Could not find date in http://www.busselton.wa.gov.au/files/sharedassets/public/ecm/ceogov/communitypolicies/review_of_cp006_mobile_vendors_jetty_pandl_180517cleanversion.pdf using (?-mix:Last.updated.(.*)) E, [2018-01-07T07:47:46.069778 #17] ERROR -- : Could not find a date in http://www.busselton.wa.gov.au/files/sharedassets/public/ecm/ceogov/communitypolicies/review_of_cp006_mobile_vendors_jetty_pandl_180517cleanversion.pdf using any pattern I, [2018-01-07T07:47:46.069869 #17] INFO -- : {"title"=>"Council Policy : 006 - Mobile Vendors on the Busselton Jetty (PDF, 108KB)", "document_url"=>"http://www.busselton.wa.gov.au/files/sharedassets/public/ecm/ceogov/communitypolicies/review_of_cp006_mobile_vendors_jetty_pandl_180517cleanversion.pdf", "id"=>"cp006"} I, [2018-01-07T07:47:46.078558 #17] INFO -- : Stored {"title"=>"Council Policy : 006 - Mobile Vendors on the Busselton Jetty (PDF, 108KB)", "document_url"=>"http://www.busselton.wa.gov.au/files/sharedassets/public/ecm/ceogov/communitypolicies/review_of_cp006_mobile_vendors_jetty_pandl_180517cleanversion.pdf", "id"=>"cp006"} I, [2018-01-07T07:47:48.130480 #17] INFO -- : {"title"=>"Council Policy : 010 - Asbestos Management  (PDF, 360KB)", "document_url"=>"http://www.busselton.wa.gov.au/files/sharedassets/public/ecm/ceogov/communitypolicies/cp010_asbestos_managementv2_-_adopted_13042016.pdf", "id"=>"cp010", "last_updated"=>"2016-04-13"} Skipping already saved record cp010 I, [2018-01-07T07:47:50.988857 #17] INFO -- : {"title"=>"Council Policy : 011 - Rails to Trails (PDF, 347KB)", "document_url"=>"http://www.busselton.wa.gov.au/files/sharedassets/public/ecm/ceogov/communitypolicies/cp011_rails_to_trailsv3_-_adopted_13042016.pdf", "id"=>"cp011", "last_updated"=>"2016-04-13"} Skipping already saved record cp011 E, [2018-01-07T07:47:50.989629 #17] ERROR -- : #<URI::HTTP http://www.busselton.wa.gov.au/files/sharedassets/public/ecm/ceogov/communitypolicies/policy_017_urban_art_2.pdf>

Data

Downloaded 2 times by gooch

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (21 KB) Use the API

rows 10 / 64

title document_url id last_updated
Council Policy - Access and Inclusion (PDF, 132KB)
cp235
2015-05-13
Council Policy - Applications for Exploration or Mining Licences for Coal within the City of Busselton  (PDF, 147KB)
cp043
2016-03-09
Council Policy - Asbestos Management  (PDF, 360KB)
cp010
2016-04-13
Council Policy - Building and Development Lists (PDF, 27KB)
cp039
2010-07-14
Council Policy - Busselton Jetty - Placement of Memorial Plaques (PDF, 46KB)
cp004
2012-02-22
Council Policy - Busselton Regional Airport - Statement of Intent  (PDF, 136KB)
cp124
2014-11-12
Council Policy - Closed Circuit Television Policy (CCTV) Busselton Jetty (PDF, 100KB)
cp028
Council Policy - Community Engagement and Consultation (PDF, 144KB)
cp023
2014-03-12
Council Policy - Community Facilities Bookings (PDF, 165KB)
cp027
2014-08-13
Council Policy - Council Property - Granting of Access to Public Venues (PDF, 28KB)
cp065

Statistics

Average successful run time: 1 minute

Total run time: 3 minutes

Total cpu time used: less than 10 seconds

Total disk space used: 46.9 KB

History

  • Manually ran revision fe0ec7c5 and completed successfully .
    1 record added in the database
    6 pages scraped
  • Manually ran revision fe0ec7c5 and completed successfully .
    57 records added in the database
    65 pages scraped
  • Manually ran revision 547604b3 and failed .
    6 records added in the database
    8 pages scraped
  • Created on morph.io