LoveMyData / kuringgai

README.md

Ku-ring-gai Council scraper

  • Accept Terms - No
  • Cookie tracking - Yes
  • Request actual DA page for data - No
  • Clearly defined data within a row - No but reasonable
  • Limited to 10 pages only

Setup MORPH_PERIOD for data recovery, available options are

  • not set = thisweek (default)
  • thismonth
  • lastmonth

Contributors mlandauer LoveMyData

Last run failed with status code 999.

Console output of last run

Please install the Morph Github App on LoveMyData so that Morph can access this repository on GitHub. Please go to https://github.com/apps/morph-io/installations/new/permissions?repository_ids%5B%5D=49949842&repository_ids%5B%5D=134056878&repository_ids%5B%5D=47324812&repository_ids%5B%5D=88161914&repository_ids%5B%5D=68444421&repository_ids%5B%5D=47314642&repository_ids%5B%5D=93590295&repository_ids%5B%5D=68878229&repository_ids%5B%5D=72811725&repository_ids%5B%5D=56903014&repository_ids%5B%5D=170608803&repository_ids%5B%5D=108057954&repository_ids%5B%5D=92110889&repository_ids%5B%5D=67974508&repository_ids%5B%5D=87934825&repository_ids%5B%5D=145681800&repository_ids%5B%5D=47260725&repository_ids%5B%5D=88051332&repository_ids%5B%5D=91232291&repository_ids%5B%5D=47496147&repository_ids%5B%5D=68881868&repository_ids%5B%5D=47331141&repository_ids%5B%5D=87817830&repository_ids%5B%5D=177515286&repository_ids%5B%5D=46924700&repository_ids%5B%5D=106624312&repository_ids%5B%5D=46796215&repository_ids%5B%5D=91168909&repository_ids%5B%5D=67973091&repository_ids%5B%5D=107615216&repository_ids%5B%5D=85133473&repository_ids%5B%5D=91752802&repository_ids%5B%5D=47815673&repository_ids%5B%5D=99768398&repository_ids%5B%5D=67903220&repository_ids%5B%5D=104952368&repository_ids%5B%5D=51361943&repository_ids%5B%5D=47970061&repository_ids%5B%5D=67978193&repository_ids%5B%5D=104017335&repository_ids%5B%5D=47314661&repository_ids%5B%5D=46924659&repository_ids%5B%5D=91053021&repository_ids%5B%5D=156531533&repository_ids%5B%5D=96767060&repository_ids%5B%5D=57299199&repository_ids%5B%5D=156799498&repository_ids%5B%5D=159443632&repository_ids%5B%5D=47876278&repository_ids%5B%5D=159422813&repository_ids%5B%5D=47313800&repository_ids%5B%5D=107520757&repository_ids%5B%5D=88119130&repository_ids%5B%5D=95849825&repository_ids%5B%5D=68373869&repository_ids%5B%5D=46966464&repository_ids%5B%5D=102549557&repository_ids%5B%5D=152169956&repository_ids%5B%5D=69199374&repository_ids%5B%5D=47871639&repository_ids%5B%5D=108206347&repository_ids%5B%5D=92701523&repository_ids%5B%5D=124995950&repository_ids%5B%5D=98845885&repository_ids%5B%5D=68511763&repository_ids%5B%5D=85155894&repository_ids%5B%5D=47400030&repository_ids%5B%5D=105615080&repository_ids%5B%5D=90943444&repository_ids%5B%5D=97595478&repository_ids%5B%5D=68342363&repository_ids%5B%5D=46921298&repository_ids%5B%5D=68098781&repository_ids%5B%5D=47917197&repository_ids%5B%5D=174301699&repository_ids%5B%5D=88171467&repository_ids%5B%5D=92243788&repository_ids%5B%5D=103522127&repository_ids%5B%5D=97825255&repository_ids%5B%5D=57381657&repository_ids%5B%5D=107633285&repository_ids%5B%5D=58468748&repository_ids%5B%5D=107853888&repository_ids%5B%5D=107861107&repository_ids%5B%5D=91777660&repository_ids%5B%5D=107852602&repository_ids%5B%5D=49410115&repository_ids%5B%5D=47873122&repository_ids%5B%5D=47874423&repository_ids%5B%5D=100552305&repository_ids%5B%5D=92278881&repository_ids%5B%5D=96265559&suggested_target_id=15683093 Why? See https://morph.io/documentation/github_app

Data

Downloaded 1233 times by LoveMyData dcalde irwin-r jamsec12ty jacroft408 nadavalon2 odnagroup MichaelBone

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (2.16 MB) Use the API

rows 10 / 4959

info_url council_reference date_received description address date_scraped comment_url
https://eservices.kmc.nsw.gov.au/T1ePropertyProd/P1/eTrack/eTrackApplicationDetails.aspx?r=KC_WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=DA0512/18
DA0512/18
2018-11-08
Demolition of the existing dwelling and construction of a new dwelling with basement parking, swimming pool and landscaping.
3 Carlyle Road EAST LINDFIELD NSW 2070
2018-11-09
mailto:kmc@kmc.nsw.gov.au
https://eservices.kmc.nsw.gov.au/T1ePropertyProd/P1/eTrack/eTrackApplicationDetails.aspx?r=KC_WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=PCDC0456/18
PCDC0456/18
2018-11-08
CDC - Private Certifier - Internal Alterations to existing unit
7/30-32 Cowan Road ST IVES NSW 2075
2018-11-09
mailto:kmc@kmc.nsw.gov.au
https://eservices.kmc.nsw.gov.au/T1ePropertyProd/P1/eTrack/eTrackApplicationDetails.aspx?r=KC_WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=CCPCA0485/18
CCPCA0485/18
2018-11-08
Amended CC - MOD0147/18 - New dwelling, landscaping and associated works
3 Tobruk Avenue ST IVES CHASE NSW 2075
2018-11-09
mailto:kmc@kmc.nsw.gov.au
https://eservices.kmc.nsw.gov.au/T1ePropertyProd/P1/eTrack/eTrackApplicationDetails.aspx?r=KC_WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=DA0508/18
DA0508/18
2018-11-08
Construction of a new 2 and 3 storey building, including classrooms, staff facilities and canteen
87 Memorial Avenue ST IVES NSW 2075
2018-11-09
mailto:kmc@kmc.nsw.gov.au
https://eservices.kmc.nsw.gov.au/T1ePropertyProd/P1/eTrack/eTrackApplicationDetails.aspx?r=KC_WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=DA0507/18
DA0507/18
2018-11-08
Alts and adds to existing dwelling including additional living space, pool and car accommodation
6 Maytone Avenue KILLARA NSW 2071
2018-11-09
mailto:kmc@kmc.nsw.gov.au
https://eservices.kmc.nsw.gov.au/T1ePropertyProd/P1/eTrack/eTrackApplicationDetails.aspx?r=KC_WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=DA0506/18
DA0506/18
2018-11-08
Strata Subdivision of 6 lots into 103 lots
1454 Pacific Highway TURRAMURRA NSW 2074
2018-11-09
mailto:kmc@kmc.nsw.gov.au
https://eservices.kmc.nsw.gov.au/T1ePropertyProd/P1/eTrack/eTrackApplicationDetails.aspx?r=KC_WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=PCDC0457/18
PCDC0457/18
2018-11-08
CDC8039600 - Private Certifier - Demolition
3 Yeramba Street TURRAMURRA NSW 2074
2018-11-09
mailto:kmc@kmc.nsw.gov.au
https://eservices.kmc.nsw.gov.au/T1ePropertyProd/P1/eTrack/eTrackApplicationDetails.aspx?r=KC_WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=MOD0199/18
MOD0199/18
2018-11-08
Section 4.55(1) for DA0027/18 - Minor error with window frame colour. Please see attached revised Materials & Finishes Schedule.
26 Dudley Avenue ROSEVILLE NSW 2069
2018-11-09
mailto:kmc@kmc.nsw.gov.au
https://eservices.kmc.nsw.gov.au/T1ePropertyProd/P1/eTrack/eTrackApplicationDetails.aspx?r=KC_WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=DA0511/18
DA0511/18
2018-11-08
Proposed rear yard concrete swimming pool and associated works,
94A Livingstone Avenue PYMBLE NSW 2073
2018-11-09
mailto:kmc@kmc.nsw.gov.au
https://eservices.kmc.nsw.gov.au/T1ePropertyProd/P1/eTrack/eTrackApplicationDetails.aspx?r=KC_WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=DA0510/18
DA0510/18
2018-11-08
New rear yard concrete swimming pool, decking and associated works.
6 Boronga Avenue WEST PYMBLE NSW 2073
2018-11-09
mailto:kmc@kmc.nsw.gov.au

Statistics

Average successful run time: 1 minute

Total run time: 1 day

Total cpu time used: 22 minutes

Total disk space used: 2.19 MB

History

  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

kuringgai / scraper.rb