LoveMyData / gold_coast

Gold Coast City Council Development Applications


City of Gold Coast Council Scraper

This Council involves the followings

  • Server - Masterview, ApplicationMaster
  • Cookie - Yes
  • Scrape detail page - No
  • Clearly defined data within a row - Yes
  • JavaScript - Yes - doPostBack

Setup MORPH_PERIOD for data recovery, available options are

  • thisweek (default)
  • thismonth
  • lastmonth

Enjoy

Contributors LoveMyData

Last run failed with status code 999.

Console output of last run

Please install the Morph Github App on LoveMyData so that Morph can access this repository on GitHub. Please go to https://github.com/apps/morph-io/installations/new/permissions?repository_ids%5B%5D=49949842&repository_ids%5B%5D=134056878&repository_ids%5B%5D=47324812&repository_ids%5B%5D=88161914&repository_ids%5B%5D=68444421&repository_ids%5B%5D=47314642&repository_ids%5B%5D=93590295&repository_ids%5B%5D=68878229&repository_ids%5B%5D=72811725&repository_ids%5B%5D=56903014&repository_ids%5B%5D=170608803&repository_ids%5B%5D=108057954&repository_ids%5B%5D=92110889&repository_ids%5B%5D=67974508&repository_ids%5B%5D=87934825&repository_ids%5B%5D=145681800&repository_ids%5B%5D=47260725&repository_ids%5B%5D=88051332&repository_ids%5B%5D=91232291&repository_ids%5B%5D=47496147&repository_ids%5B%5D=68881868&repository_ids%5B%5D=47331141&repository_ids%5B%5D=87817830&repository_ids%5B%5D=177515286&repository_ids%5B%5D=46924700&repository_ids%5B%5D=106624312&repository_ids%5B%5D=46796215&repository_ids%5B%5D=91168909&repository_ids%5B%5D=67973091&repository_ids%5B%5D=107615216&repository_ids%5B%5D=85133473&repository_ids%5B%5D=91752802&repository_ids%5B%5D=47815673&repository_ids%5B%5D=99768398&repository_ids%5B%5D=67903220&repository_ids%5B%5D=104952368&repository_ids%5B%5D=51361943&repository_ids%5B%5D=47970061&repository_ids%5B%5D=67978193&repository_ids%5B%5D=104017335&repository_ids%5B%5D=47314661&repository_ids%5B%5D=46924659&repository_ids%5B%5D=91053021&repository_ids%5B%5D=156531533&repository_ids%5B%5D=96767060&repository_ids%5B%5D=57299199&repository_ids%5B%5D=156799498&repository_ids%5B%5D=159443632&repository_ids%5B%5D=47876278&repository_ids%5B%5D=159422813&repository_ids%5B%5D=47313800&repository_ids%5B%5D=107520757&repository_ids%5B%5D=88119130&repository_ids%5B%5D=95849825&repository_ids%5B%5D=68373869&repository_ids%5B%5D=46966464&repository_ids%5B%5D=102549557&repository_ids%5B%5D=152169956&repository_ids%5B%5D=69199374&repository_ids%5B%5D=47871639&repository_ids%5B%5D=108206347&repository_ids%5B%5D=92701523&repository_ids%5B%5D=124995950&repository_ids%5B%5D=98845885&repository_ids%5B%5D=68511763&repository_ids%5B%5D=85155894&repository_ids%5B%5D=47400030&repository_ids%5B%5D=105615080&repository_ids%5B%5D=90943444&repository_ids%5B%5D=97595478&repository_ids%5B%5D=68342363&repository_ids%5B%5D=46921298&repository_ids%5B%5D=68098781&repository_ids%5B%5D=47917197&repository_ids%5B%5D=174301699&repository_ids%5B%5D=88171467&repository_ids%5B%5D=92243788&repository_ids%5B%5D=103522127&repository_ids%5B%5D=97825255&repository_ids%5B%5D=57381657&repository_ids%5B%5D=107633285&repository_ids%5B%5D=58468748&repository_ids%5B%5D=107853888&repository_ids%5B%5D=107861107&repository_ids%5B%5D=91777660&repository_ids%5B%5D=107852602&repository_ids%5B%5D=49410115&repository_ids%5B%5D=47873122&repository_ids%5B%5D=47874423&repository_ids%5B%5D=100552305&repository_ids%5B%5D=92278881&repository_ids%5B%5D=96265559&suggested_target_id=15683093 Why? See https://morph.io/documentation/github_app

Data

Downloaded 1396 times by LoveMyData TRAVISSTR SebMartinus dcalde yourneighbourhood nadavalon2 jordanmusk primin2 vietbaracon

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (5.19 MB) Use the API

rows 10 / 13947

council_reference address description info_url comment_url date_scraped date_received
council_reference
BLD201710139
address
30 TEEMANGUM STREET TUGUN 4224 QLD
description
Description: ADD TO EXISTING DWELLING Class: REFERRAL AGENCY ASSESSMENT Work Type: DESIGN AND SITING
info_url comment_url
mailto:gcccmail@goldcoast.qld.gov.au
date_scraped
2017-09-27
date_received
2017-08-04
council_reference
MCU201701193
address
28 TEEMANGUM STREET TUGUN 4224 QLD
description
Description: Class: CODE Work Type: OTHER
info_url comment_url
mailto:gcccmail@goldcoast.qld.gov.au
date_scraped
2017-09-27
date_received
2017-08-18
council_reference
BLD201711332
address
28 WINDERS AVENUE TUGUN 4224 QLD
description
Description: OP CARPORT/BALCONY/ROOF Class: REFERRAL AGENCY ASSESSMENT Work Type: DESIGN AND SITING
info_url comment_url
mailto:gcccmail@goldcoast.qld.gov.au
date_scraped
2017-09-27
date_received
2017-08-30
council_reference
BLD201710652
address
10 MURRABA STREET CURRUMBIN 4223 QLD
description
Description: SWIMMING POOL & FENCE Class: POOL/SPA Work Type: CONSTRUCT
info_url comment_url
mailto:gcccmail@goldcoast.qld.gov.au
date_scraped
2017-09-27
date_received
2017-08-16
council_reference
BLD201710510
address
34 BOB BARNARD DRIVE TUGUN 4224 QLD
description
Description: STORAGE AREA Class: OUTBUILDING Work Type: ADDITIONS
info_url comment_url
mailto:gcccmail@goldcoast.qld.gov.au
date_scraped
2017-09-27
date_received
2017-08-14
council_reference
OPW201702035
address
490 COOLANGATTA ROAD TUGUN 4224 QLD
description
Description: Class: ASSOCIATED BUILDING WORKS Work Type:
info_url comment_url
mailto:gcccmail@goldcoast.qld.gov.au
date_scraped
2017-09-27
date_received
2017-08-03
council_reference
OPW201702034
address
490 COOLANGATTA ROAD TUGUN 4224 QLD
description
Description: Class: CIVIL ENGINEERING Work Type:
info_url comment_url
mailto:gcccmail@goldcoast.qld.gov.au
date_scraped
2017-09-27
date_received
2017-08-03
council_reference
OPW201702033
address
490 COOLANGATTA ROAD TUGUN 4224 QLD
description
Description: Class: CHANGE TO GROUND LEVEL/CARPARKING Work Type:
info_url comment_url
mailto:gcccmail@goldcoast.qld.gov.au
date_scraped
2017-09-27
date_received
2017-08-03
council_reference
MCU201701211
address
2 CHERUB STREET TUGUN 4224 QLD
description
Description: DUAL OCCUPANCY Class: CODE Work Type:
info_url comment_url
mailto:gcccmail@goldcoast.qld.gov.au
date_scraped
2017-09-27
date_received
2017-08-22
council_reference
OPW201702141
address
412 COOLANGATTA ROAD TUGUN 4224 QLD
description
Description: Class: CIVIL ENGINEERING Work Type: EXTENSION OF APPROVAL
info_url comment_url
mailto:gcccmail@goldcoast.qld.gov.au
date_scraped
2017-09-27
date_received
2017-08-14

Statistics

Average successful run time: 2 minutes

Total run time: 1 day

Total cpu time used: 34 minutes

Total disk space used: 5.22 MB

History

  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

gold_coast / scraper.rb