LoveMyData / sunshine_coast

Sunshine Coast Council Development Applications

README.md

Sunshine coast council scraper

This site is a typical .NET site involves the followings.

  • Cookie - No
  • JSON - Yes
  • Structured HTML - No (especially address is a nightmare)

Setup MORPH_PERIOD for data recovery, available options are

  • thisweek (default, last 14 days)
  • thismonth
  • lastmonth

Enjoy

Contributors LoveMyData

Last run failed with status code 999.

Console output of last run

Please install the Morph Github App on LoveMyData so that Morph can access this repository on GitHub. Please go to https://github.com/apps/morph-io/installations/new/permissions?repository_ids%5B%5D=49949842&repository_ids%5B%5D=134056878&repository_ids%5B%5D=47324812&repository_ids%5B%5D=88161914&repository_ids%5B%5D=68444421&repository_ids%5B%5D=47314642&repository_ids%5B%5D=93590295&repository_ids%5B%5D=68878229&repository_ids%5B%5D=72811725&repository_ids%5B%5D=56903014&repository_ids%5B%5D=170608803&repository_ids%5B%5D=108057954&repository_ids%5B%5D=92110889&repository_ids%5B%5D=67974508&repository_ids%5B%5D=87934825&repository_ids%5B%5D=145681800&repository_ids%5B%5D=47260725&repository_ids%5B%5D=88051332&repository_ids%5B%5D=91232291&repository_ids%5B%5D=47496147&repository_ids%5B%5D=68881868&repository_ids%5B%5D=47331141&repository_ids%5B%5D=87817830&repository_ids%5B%5D=177515286&repository_ids%5B%5D=46924700&repository_ids%5B%5D=106624312&repository_ids%5B%5D=46796215&repository_ids%5B%5D=91168909&repository_ids%5B%5D=67973091&repository_ids%5B%5D=107615216&repository_ids%5B%5D=85133473&repository_ids%5B%5D=91752802&repository_ids%5B%5D=47815673&repository_ids%5B%5D=99768398&repository_ids%5B%5D=67903220&repository_ids%5B%5D=104952368&repository_ids%5B%5D=51361943&repository_ids%5B%5D=47970061&repository_ids%5B%5D=67978193&repository_ids%5B%5D=104017335&repository_ids%5B%5D=47314661&repository_ids%5B%5D=46924659&repository_ids%5B%5D=91053021&repository_ids%5B%5D=156531533&repository_ids%5B%5D=96767060&repository_ids%5B%5D=57299199&repository_ids%5B%5D=156799498&repository_ids%5B%5D=159443632&repository_ids%5B%5D=47876278&repository_ids%5B%5D=159422813&repository_ids%5B%5D=47313800&repository_ids%5B%5D=107520757&repository_ids%5B%5D=88119130&repository_ids%5B%5D=95849825&repository_ids%5B%5D=68373869&repository_ids%5B%5D=46966464&repository_ids%5B%5D=102549557&repository_ids%5B%5D=152169956&repository_ids%5B%5D=69199374&repository_ids%5B%5D=47871639&repository_ids%5B%5D=108206347&repository_ids%5B%5D=92701523&repository_ids%5B%5D=124995950&repository_ids%5B%5D=98845885&repository_ids%5B%5D=68511763&repository_ids%5B%5D=85155894&repository_ids%5B%5D=47400030&repository_ids%5B%5D=105615080&repository_ids%5B%5D=90943444&repository_ids%5B%5D=97595478&repository_ids%5B%5D=68342363&repository_ids%5B%5D=46921298&repository_ids%5B%5D=68098781&repository_ids%5B%5D=47917197&repository_ids%5B%5D=174301699&repository_ids%5B%5D=88171467&repository_ids%5B%5D=92243788&repository_ids%5B%5D=103522127&repository_ids%5B%5D=97825255&repository_ids%5B%5D=57381657&repository_ids%5B%5D=107633285&repository_ids%5B%5D=58468748&repository_ids%5B%5D=107853888&repository_ids%5B%5D=107861107&repository_ids%5B%5D=91777660&repository_ids%5B%5D=107852602&repository_ids%5B%5D=49410115&repository_ids%5B%5D=47873122&repository_ids%5B%5D=47874423&repository_ids%5B%5D=100552305&repository_ids%5B%5D=92278881&repository_ids%5B%5D=96265559&suggested_target_id=15683093 Why? See https://morph.io/documentation/github_app

Data

Downloaded 603 times by dcalde MichaelBone EMBLAPROJECTS BrendanFrameless Jamestavs

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (2.52 MB) Use the API

rows 10 / 8036

council_reference address description info_url comment_url date_scraped date_received
council_reference
REC15/0004.01
address
110 North Maleny Rd NORTH MALENY
description
Generally In Accordance - Staged Reconfiguration of 1 Lot into 5 - Just Sheds
info_url
https://developmenti.sunshinecoast.qld.gov.au
comment_url
mail@sunshinecoast.qld.gov.au
date_scraped
2019-03-08
date_received
2019-02-04
council_reference
RAL18/0076.01
address
21 and 31 Coonowrin Rd GLASS HOUSE MOUNTAINS
description
Change to Development Approval - Reconfiguring 2 Lots into 24 Lots - Glasshouse Developments Pty Ltd - Innovative Planning Solutions
info_url
https://developmenti.sunshinecoast.qld.gov.au
comment_url
mail@sunshinecoast.qld.gov.au
date_scraped
2019-03-08
date_received
2019-02-04
council_reference
POS19/0030
address
183 Glenview Road Glenview
description
Survey Plan SP299300 (2 Lots) - DK & D Langdon - Subdivisions (Qld) Pty Ltd
info_url
https://developmenti.sunshinecoast.qld.gov.au
comment_url
mail@sunshinecoast.qld.gov.au
date_scraped
2019-03-08
date_received
2019-02-04
council_reference
POS19/0028
address
Habitat Palmwoods Stage 2
description
Abbotts Road Palmwoods - Survey Plan SP307684 (15 Lots, 14 created and balance Lot 500) - Sunshine Beach Constructions Pty Ltd
info_url
https://developmenti.sunshinecoast.qld.gov.au
comment_url
mail@sunshinecoast.qld.gov.au
date_scraped
2019-03-08
date_received
2019-02-04
council_reference
OPW19/0045
address
10 Donovan Pl MAROOCHY RIVER
description
Vegetation Clearing - Tree Fix
info_url
https://developmenti.sunshinecoast.qld.gov.au
comment_url
mail@sunshinecoast.qld.gov.au
date_scraped
2019-03-08
date_received
2019-02-04
council_reference
OPW19/0044
address
FAST TRACK 165 Oceanic Dve WARANA
description
Landscaping - Dual Occupancy - Shane and Laura Blake - Adams and Sparkes Town Planning and Development COMBINED MCU19/0019
info_url
https://developmenti.sunshinecoast.qld.gov.au
comment_url
mail@sunshinecoast.qld.gov.au
date_scraped
2019-03-08
date_received
2019-02-04
council_reference
OPW19/0043
address
Bruce Hwy PALMVIEW
description
Electrical and Street Lighting - AVID Residential Group Pty Ltd - Project Urban
info_url
https://developmenti.sunshinecoast.qld.gov.au
comment_url
mail@sunshinecoast.qld.gov.au
date_scraped
2019-03-08
date_received
2019-02-04
council_reference
OPW18/0620.01
address
21 and 31 Coonowrin Rd GLASS HOUSE MOUNTAINS
description
Change to Development Approval - Roadworks, Stormwater, Earthworks, Drainage Works and Landscaping - Glasshouse Developments Pty Ltd - Innovative Planning Solutions
info_url
https://developmenti.sunshinecoast.qld.gov.au
comment_url
mail@sunshinecoast.qld.gov.au
date_scraped
2019-03-08
date_received
2019-02-04
council_reference
MCU19/0021
address
1-47 Stringybark Rd BUDERIM
description
Educational Establishment - Matthew Flinders Anglican College - Adamson Town Planning
info_url
https://developmenti.sunshinecoast.qld.gov.au
comment_url
mail@sunshinecoast.qld.gov.au
date_scraped
2019-03-08
date_received
2019-02-04
council_reference
MCU19/0020
address
1-3 Claude Boyd Pde BELLS CREEK
description
Service Station and Shopping Complex - Westcon Construction and Development Pty Ltd - FMAAP
info_url
https://developmenti.sunshinecoast.qld.gov.au
comment_url
mail@sunshinecoast.qld.gov.au
date_scraped
2019-03-08
date_received
2019-02-04

Statistics

Average successful run time: 1 minute

Total run time: 1 day

Total cpu time used: 22 minutes

Total disk space used: 2.55 MB

History

  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

sunshine_coast / scraper.rb