LoveMyData / cowra

Cowra Development Applications

README.md

Cowra Council scraper

  • System - myhorizon from solorient
  • Cookie tracking - Yes
  • Clearly defined data within a row - Yes
  • XML - Yes

Setup MORPH_PERIOD for data recovery, available options are

  • thisweek (default)
  • thismonth
  • lastmonth
  • year (eg: 2017, minimum is 1961)

Enjoy

Contributors LoveMyData mlandauer

Last run failed with status code 999.

Console output of last run

Please install the Morph Github App on LoveMyData so that Morph can access this repository on GitHub. Please go to https://github.com/apps/morph-io/installations/new/permissions?repository_ids%5B%5D=49949842&repository_ids%5B%5D=134056878&repository_ids%5B%5D=47324812&repository_ids%5B%5D=88161914&repository_ids%5B%5D=68444421&repository_ids%5B%5D=47314642&repository_ids%5B%5D=93590295&repository_ids%5B%5D=68878229&repository_ids%5B%5D=72811725&repository_ids%5B%5D=56903014&repository_ids%5B%5D=170608803&repository_ids%5B%5D=108057954&repository_ids%5B%5D=92110889&repository_ids%5B%5D=67974508&repository_ids%5B%5D=87934825&repository_ids%5B%5D=145681800&repository_ids%5B%5D=47260725&repository_ids%5B%5D=88051332&repository_ids%5B%5D=91232291&repository_ids%5B%5D=47496147&repository_ids%5B%5D=68881868&repository_ids%5B%5D=47331141&repository_ids%5B%5D=87817830&repository_ids%5B%5D=177515286&repository_ids%5B%5D=46924700&repository_ids%5B%5D=106624312&repository_ids%5B%5D=46796215&repository_ids%5B%5D=91168909&repository_ids%5B%5D=67973091&repository_ids%5B%5D=107615216&repository_ids%5B%5D=85133473&repository_ids%5B%5D=91752802&repository_ids%5B%5D=47815673&repository_ids%5B%5D=99768398&repository_ids%5B%5D=67903220&repository_ids%5B%5D=104952368&repository_ids%5B%5D=51361943&repository_ids%5B%5D=47970061&repository_ids%5B%5D=67978193&repository_ids%5B%5D=104017335&repository_ids%5B%5D=47314661&repository_ids%5B%5D=46924659&repository_ids%5B%5D=91053021&repository_ids%5B%5D=156531533&repository_ids%5B%5D=96767060&repository_ids%5B%5D=57299199&repository_ids%5B%5D=156799498&repository_ids%5B%5D=159443632&repository_ids%5B%5D=47876278&repository_ids%5B%5D=159422813&repository_ids%5B%5D=47313800&repository_ids%5B%5D=107520757&repository_ids%5B%5D=88119130&repository_ids%5B%5D=95849825&repository_ids%5B%5D=68373869&repository_ids%5B%5D=46966464&repository_ids%5B%5D=102549557&repository_ids%5B%5D=152169956&repository_ids%5B%5D=69199374&repository_ids%5B%5D=47871639&repository_ids%5B%5D=108206347&repository_ids%5B%5D=92701523&repository_ids%5B%5D=124995950&repository_ids%5B%5D=98845885&repository_ids%5B%5D=68511763&repository_ids%5B%5D=85155894&repository_ids%5B%5D=47400030&repository_ids%5B%5D=105615080&repository_ids%5B%5D=90943444&repository_ids%5B%5D=97595478&repository_ids%5B%5D=68342363&repository_ids%5B%5D=46921298&repository_ids%5B%5D=68098781&repository_ids%5B%5D=47917197&repository_ids%5B%5D=174301699&repository_ids%5B%5D=88171467&repository_ids%5B%5D=92243788&repository_ids%5B%5D=103522127&repository_ids%5B%5D=97825255&repository_ids%5B%5D=57381657&repository_ids%5B%5D=107633285&repository_ids%5B%5D=58468748&repository_ids%5B%5D=107853888&repository_ids%5B%5D=107861107&repository_ids%5B%5D=91777660&repository_ids%5B%5D=107852602&repository_ids%5B%5D=49410115&repository_ids%5B%5D=47873122&repository_ids%5B%5D=47874423&repository_ids%5B%5D=100552305&repository_ids%5B%5D=92278881&repository_ids%5B%5D=96265559&suggested_target_id=15683093 Why? See https://morph.io/documentation/github_app

Data

Downloaded 1563 times by LoveMyData dcalde

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.12 MB) Use the API

rows 10 / 3725

council_reference address description info_url comment_url date_scraped date_received
council_reference
DA 2017/149.1
address
Elouera Road COWRA 2794 NSW
description
New Building Rural Garage/Shed
info_url
http://myhorizon.solorient.com.au/Horizon/logonGuest.aw?domain=horizondap_cowra
comment_url
mailto:council@cowra.nsw.gov.au
date_scraped
2017-10-20
date_received
2017-10-13
council_reference
DA 2017/148.1
address
85-87 Lyall Street COWRA 2794 NSW
description
New Building Residential Dwelling
info_url
http://myhorizon.solorient.com.au/Horizon/logonGuest.aw?domain=horizondap_cowra
comment_url
mailto:council@cowra.nsw.gov.au
date_scraped
2017-10-20
date_received
2017-10-13
council_reference
DA 2017/147.1
address
102 Redfern Street COWRA 2794 NSW
description
New Building Residential Pergola/Awning/Patio
info_url
http://myhorizon.solorient.com.au/Horizon/logonGuest.aw?domain=horizondap_cowra
comment_url
mailto:council@cowra.nsw.gov.au
date_scraped
2017-10-20
date_received
2017-10-13
council_reference
DA 2017/146.1
address
36 Gower Hardy Circuit COWRA 2794 NSW
description
New Building Residential Garage/Shed
info_url
http://myhorizon.solorient.com.au/Horizon/logonGuest.aw?domain=horizondap_cowra
comment_url
mailto:council@cowra.nsw.gov.au
date_scraped
2017-10-20
date_received
2017-10-13
council_reference
DA 2017/145.1
address
75 Darling Street COWRA 2794 NSW
description
New Building Flats (Two or more residential units)
info_url
http://myhorizon.solorient.com.au/Horizon/logonGuest.aw?domain=horizondap_cowra
comment_url
mailto:council@cowra.nsw.gov.au
date_scraped
2017-10-20
date_received
2017-10-12
council_reference
DA 2017/144.1
address
18 Bank Street GOOLOOGONG 2805 NSW
description
New Building Rural Garage/Shed
info_url
http://myhorizon.solorient.com.au/Horizon/logonGuest.aw?domain=horizondap_cowra
comment_url
mailto:council@cowra.nsw.gov.au
date_scraped
2017-10-20
date_received
2017-10-12
council_reference
CDC 2017/39.1
address
603 Grenfell Road COWRA 2794 NSW
description
New Building Residential Swimming Pool
info_url
http://myhorizon.solorient.com.au/Horizon/logonGuest.aw?domain=horizondap_cowra
comment_url
mailto:council@cowra.nsw.gov.au
date_scraped
2017-10-20
date_received
2017-10-12
council_reference
DA 2017/143.1
address
Clements Road WOODSTOCK 2793 NSW
description
Dwelling
info_url
http://myhorizon.solorient.com.au/Horizon/logonGuest.aw?domain=horizondap_cowra
comment_url
mailto:council@cowra.nsw.gov.au
date_scraped
2017-10-20
date_received
2017-10-11
council_reference
CC 2017/143.1
address
Clements Road WOODSTOCK 2793 NSW
description
New Building Rural Dwelling
info_url
http://myhorizon.solorient.com.au/Horizon/logonGuest.aw?domain=horizondap_cowra
comment_url
mailto:council@cowra.nsw.gov.au
date_scraped
2017-10-20
date_received
2017-10-11
council_reference
CDC 2017/38.1
address
16 East Street WOODSTOCK 2793 NSW
description
New Building Residential Swimming Pool
info_url
http://myhorizon.solorient.com.au/Horizon/logonGuest.aw?domain=horizondap_cowra
comment_url
mailto:council@cowra.nsw.gov.au
date_scraped
2017-10-20
date_received
2017-10-11

Statistics

Average successful run time: less than a minute

Total run time: 1 day

Total cpu time used: 27 minutes

Total disk space used: 1.15 MB

History

  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

cowra / scraper.rb