LoveMyData / sutherland

README.md

Sutherland Shire Council Scraper

This site is a typical .NET site involves the followings.

  • Cookie - No
  • Pagnation - Yes
  • Javascript - Yes
  • Structured HTML - Good

Setup MORPH_PERIOD for data recovery, available options are

  • thisweek (default)
  • thismonth
  • lastmonth

Enjoy

Contributors mlandauer LoveMyData

Last run failed with status code 999.

Console output of last run

Please install the Morph Github App on LoveMyData so that Morph can access this repository on GitHub. Please go to https://github.com/apps/morph-io/installations/new/permissions?repository_ids%5B%5D=49949842&repository_ids%5B%5D=134056878&repository_ids%5B%5D=47324812&repository_ids%5B%5D=88161914&repository_ids%5B%5D=68444421&repository_ids%5B%5D=47314642&repository_ids%5B%5D=93590295&repository_ids%5B%5D=68878229&repository_ids%5B%5D=72811725&repository_ids%5B%5D=56903014&repository_ids%5B%5D=170608803&repository_ids%5B%5D=108057954&repository_ids%5B%5D=92110889&repository_ids%5B%5D=67974508&repository_ids%5B%5D=87934825&repository_ids%5B%5D=145681800&repository_ids%5B%5D=47260725&repository_ids%5B%5D=88051332&repository_ids%5B%5D=91232291&repository_ids%5B%5D=47496147&repository_ids%5B%5D=68881868&repository_ids%5B%5D=47331141&repository_ids%5B%5D=87817830&repository_ids%5B%5D=177515286&repository_ids%5B%5D=46924700&repository_ids%5B%5D=106624312&repository_ids%5B%5D=46796215&repository_ids%5B%5D=91168909&repository_ids%5B%5D=67973091&repository_ids%5B%5D=107615216&repository_ids%5B%5D=85133473&repository_ids%5B%5D=91752802&repository_ids%5B%5D=47815673&repository_ids%5B%5D=99768398&repository_ids%5B%5D=67903220&repository_ids%5B%5D=104952368&repository_ids%5B%5D=51361943&repository_ids%5B%5D=47970061&repository_ids%5B%5D=67978193&repository_ids%5B%5D=104017335&repository_ids%5B%5D=47314661&repository_ids%5B%5D=46924659&repository_ids%5B%5D=91053021&repository_ids%5B%5D=156531533&repository_ids%5B%5D=96767060&repository_ids%5B%5D=57299199&repository_ids%5B%5D=156799498&repository_ids%5B%5D=159443632&repository_ids%5B%5D=47876278&repository_ids%5B%5D=159422813&repository_ids%5B%5D=47313800&repository_ids%5B%5D=107520757&repository_ids%5B%5D=88119130&repository_ids%5B%5D=95849825&repository_ids%5B%5D=68373869&repository_ids%5B%5D=46966464&repository_ids%5B%5D=102549557&repository_ids%5B%5D=152169956&repository_ids%5B%5D=69199374&repository_ids%5B%5D=47871639&repository_ids%5B%5D=108206347&repository_ids%5B%5D=92701523&repository_ids%5B%5D=124995950&repository_ids%5B%5D=98845885&repository_ids%5B%5D=68511763&repository_ids%5B%5D=85155894&repository_ids%5B%5D=47400030&repository_ids%5B%5D=105615080&repository_ids%5B%5D=90943444&repository_ids%5B%5D=97595478&repository_ids%5B%5D=68342363&repository_ids%5B%5D=46921298&repository_ids%5B%5D=68098781&repository_ids%5B%5D=47917197&repository_ids%5B%5D=174301699&repository_ids%5B%5D=88171467&repository_ids%5B%5D=92243788&repository_ids%5B%5D=103522127&repository_ids%5B%5D=97825255&repository_ids%5B%5D=57381657&repository_ids%5B%5D=107633285&repository_ids%5B%5D=58468748&repository_ids%5B%5D=107853888&repository_ids%5B%5D=107861107&repository_ids%5B%5D=91777660&repository_ids%5B%5D=107852602&repository_ids%5B%5D=49410115&repository_ids%5B%5D=47873122&repository_ids%5B%5D=47874423&repository_ids%5B%5D=100552305&repository_ids%5B%5D=92278881&repository_ids%5B%5D=96265559&suggested_target_id=15683093 Why? See https://morph.io/documentation/github_app

Data

Downloaded 1686 times by LoveMyData dcalde odnagroup

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (2.87 MB) Use the API

rows 10 / 6059

council_reference address description info_url comment_url date_scraped date_received on_notice_from on_notice_to
council_reference
DA17/0569
address
133 Fowler Rd ILLAWONG 2234
description
Construction & installation of shared jetty extending along the prolongation of the shared boundary & installation of ramp and pontoon
info_url
http://ecerts.ssc.nsw.gov.au/eproperty/P1/eTrack/eTrackApplicationDetails.aspx?r=SSC.P1.WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=DA17/0569
comment_url
mailto:ssc@ssc.nsw.gov.au
date_scraped
2017-05-25
date_received
2017-05-23
on_notice_from
2017-05-24
on_notice_to
2017-06-07
council_reference
DA17/0598
address
121 Linden St SUTHERLAND 2232
description
Construction of a cremator facility at Woronora Cemetary
info_url
http://ecerts.ssc.nsw.gov.au/eproperty/P1/eTrack/eTrackApplicationDetails.aspx?r=SSC.P1.WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=DA17/0598
comment_url
mailto:ssc@ssc.nsw.gov.au
date_scraped
2017-05-25
date_received
2017-05-22
on_notice_from
on_notice_to
council_reference
DA17/0600
address
description
Construction of new dwelling
info_url
http://ecerts.ssc.nsw.gov.au/eproperty/P1/eTrack/eTrackApplicationDetails.aspx?r=SSC.P1.WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=DA17/0600
comment_url
mailto:ssc@ssc.nsw.gov.au
date_scraped
2017-05-25
date_received
2017-05-22
on_notice_from
on_notice_to
council_reference
DA17/0601
address
12 Drummond Rd OYSTER BAY 2225
description
Construction of swimming pool, deck, retaining walls and pergola
info_url
http://ecerts.ssc.nsw.gov.au/eproperty/P1/eTrack/eTrackApplicationDetails.aspx?r=SSC.P1.WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=DA17/0601
comment_url
mailto:ssc@ssc.nsw.gov.au
date_scraped
2017-05-25
date_received
2017-05-22
on_notice_from
2017-05-26
on_notice_to
2017-06-09
council_reference
DA17/0602
address
468 Port Hacking Rd CARINGBAH 2229
description
Construction of 2 swimming pools in approved dual occupancy
info_url
http://ecerts.ssc.nsw.gov.au/eproperty/P1/eTrack/eTrackApplicationDetails.aspx?r=SSC.P1.WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=DA17/0602
comment_url
mailto:ssc@ssc.nsw.gov.au
date_scraped
2017-05-25
date_received
2017-05-23
on_notice_from
on_notice_to
council_reference
DA17/0603
address
description
Construction of new dwelling and retaining walls
info_url
http://ecerts.ssc.nsw.gov.au/eproperty/P1/eTrack/eTrackApplicationDetails.aspx?r=SSC.P1.WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=DA17/0603
comment_url
mailto:ssc@ssc.nsw.gov.au
date_scraped
2017-05-25
date_received
2017-05-23
on_notice_from
on_notice_to
council_reference
DA17/0604
address
117 Jannali Ave SUTHERLAND 2232
description
Two lot torrens title subdivision of approved dual occupancy
info_url
http://ecerts.ssc.nsw.gov.au/eproperty/P1/eTrack/eTrackApplicationDetails.aspx?r=SSC.P1.WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=DA17/0604
comment_url
mailto:ssc@ssc.nsw.gov.au
date_scraped
2017-05-25
date_received
2017-05-23
on_notice_from
on_notice_to
council_reference
DA17/0605
address
10 Warrangarree Dr WORONORA HEIGHTS 2233
description
Deck addition to existing residential dwelling
info_url
http://ecerts.ssc.nsw.gov.au/eproperty/P1/eTrack/eTrackApplicationDetails.aspx?r=SSC.P1.WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=DA17/0605
comment_url
mailto:ssc@ssc.nsw.gov.au
date_scraped
2017-05-25
date_received
2017-05-23
on_notice_from
on_notice_to
council_reference
DA17/0606
address
10 Wategos St GREENHILLS BEACH 2230
description
Construction of swimming pool
info_url
http://ecerts.ssc.nsw.gov.au/eproperty/P1/eTrack/eTrackApplicationDetails.aspx?r=SSC.P1.WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=DA17/0606
comment_url
mailto:ssc@ssc.nsw.gov.au
date_scraped
2017-05-25
date_received
2017-05-23
on_notice_from
on_notice_to
council_reference
DA17/0607
address
24 Stephen Rd ENGADINE 2233
description
Construction of retaining wall
info_url
http://ecerts.ssc.nsw.gov.au/eproperty/P1/eTrack/eTrackApplicationDetails.aspx?r=SSC.P1.WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=DA17/0607
comment_url
mailto:ssc@ssc.nsw.gov.au
date_scraped
2017-05-25
date_received
2017-05-23
on_notice_from
on_notice_to

Statistics

Average successful run time: 1 minute

Total run time: 1 day

Total cpu time used: 32 minutes

Total disk space used: 2.9 MB

History

  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

sutherland / scraper.rb