LoveMyData / fairfield

Fairfield City Development Applications

README.md

Fairfield City Council Scraper

Fairfield City Council involves the followings

  • Server - .NET - ApplicationMaster
  • Accept Terms - Yes
  • Cookie tracking - Yes
  • Pagnation - Yes
  • Javascript - Yes
  • UserAgent - No
  • Request actual DA page for data - No
  • Clearly defined data within a row - Yes

Setup MORPH_PERIOD for data recovery, available options are

  • thisweek (default)
  • thismonth
  • lastmonth
  • custom = yyyy-mm (eg. 2017-01)

Enjoy

Contributors laihaiming henare LoveMyData

Last run failed with status code 999.

Console output of last run

Please install the Morph Github App on LoveMyData so that Morph can access this repository on GitHub. Please go to https://github.com/apps/morph-io/installations/new/permissions?repository_ids%5B%5D=49949842&repository_ids%5B%5D=134056878&repository_ids%5B%5D=47324812&repository_ids%5B%5D=88161914&repository_ids%5B%5D=68444421&repository_ids%5B%5D=47314642&repository_ids%5B%5D=93590295&repository_ids%5B%5D=68878229&repository_ids%5B%5D=72811725&repository_ids%5B%5D=56903014&repository_ids%5B%5D=170608803&repository_ids%5B%5D=108057954&repository_ids%5B%5D=92110889&repository_ids%5B%5D=67974508&repository_ids%5B%5D=87934825&repository_ids%5B%5D=145681800&repository_ids%5B%5D=47260725&repository_ids%5B%5D=88051332&repository_ids%5B%5D=91232291&repository_ids%5B%5D=47496147&repository_ids%5B%5D=68881868&repository_ids%5B%5D=47331141&repository_ids%5B%5D=87817830&repository_ids%5B%5D=177515286&repository_ids%5B%5D=46924700&repository_ids%5B%5D=106624312&repository_ids%5B%5D=46796215&repository_ids%5B%5D=91168909&repository_ids%5B%5D=67973091&repository_ids%5B%5D=107615216&repository_ids%5B%5D=85133473&repository_ids%5B%5D=91752802&repository_ids%5B%5D=47815673&repository_ids%5B%5D=99768398&repository_ids%5B%5D=67903220&repository_ids%5B%5D=104952368&repository_ids%5B%5D=51361943&repository_ids%5B%5D=47970061&repository_ids%5B%5D=67978193&repository_ids%5B%5D=104017335&repository_ids%5B%5D=47314661&repository_ids%5B%5D=46924659&repository_ids%5B%5D=91053021&repository_ids%5B%5D=156531533&repository_ids%5B%5D=96767060&repository_ids%5B%5D=57299199&repository_ids%5B%5D=156799498&repository_ids%5B%5D=159443632&repository_ids%5B%5D=47876278&repository_ids%5B%5D=159422813&repository_ids%5B%5D=47313800&repository_ids%5B%5D=107520757&repository_ids%5B%5D=88119130&repository_ids%5B%5D=95849825&repository_ids%5B%5D=68373869&repository_ids%5B%5D=46966464&repository_ids%5B%5D=102549557&repository_ids%5B%5D=152169956&repository_ids%5B%5D=69199374&repository_ids%5B%5D=47871639&repository_ids%5B%5D=108206347&repository_ids%5B%5D=92701523&repository_ids%5B%5D=124995950&repository_ids%5B%5D=98845885&repository_ids%5B%5D=68511763&repository_ids%5B%5D=85155894&repository_ids%5B%5D=47400030&repository_ids%5B%5D=105615080&repository_ids%5B%5D=90943444&repository_ids%5B%5D=97595478&repository_ids%5B%5D=68342363&repository_ids%5B%5D=46921298&repository_ids%5B%5D=68098781&repository_ids%5B%5D=47917197&repository_ids%5B%5D=174301699&repository_ids%5B%5D=88171467&repository_ids%5B%5D=92243788&repository_ids%5B%5D=103522127&repository_ids%5B%5D=97825255&repository_ids%5B%5D=57381657&repository_ids%5B%5D=107633285&repository_ids%5B%5D=58468748&repository_ids%5B%5D=107853888&repository_ids%5B%5D=107861107&repository_ids%5B%5D=91777660&repository_ids%5B%5D=107852602&repository_ids%5B%5D=49410115&repository_ids%5B%5D=47873122&repository_ids%5B%5D=47874423&repository_ids%5B%5D=100552305&repository_ids%5B%5D=92278881&repository_ids%5B%5D=96265559&suggested_target_id=15683093 Why? See https://morph.io/documentation/github_app

Data

Downloaded 2262 times by LoveMyData dcalde MikeRalphson jacroft408 MichaelBone odnagroup nusardel AnthonyKunz

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.36 MB) Use the API

rows 10 / 3541

id council_reference address description info_url comment_url date_scraped date_received
1
746.1/2015
188 Hamilton RD FAIRFIELD, NSW, Australia
Construction of a Detached Secondary Dwelling
http://openaccess.fairfieldcity.nsw.gov.au/OpenAccess/Modules/Applicationmaster/default.aspx?page=wrapper&key=010.2015.00000746.001
mailto:mail@fairfieldcity.nsw.gov.au?subject=Development Application Enquiry: 746.1/2015
2015-12-11
2015-11-02
2
747.1/2015
31 Kauri ST CABRAMATTA, NSW, Australia
Construction of a Timber Deck and Awning
http://openaccess.fairfieldcity.nsw.gov.au/OpenAccess/Modules/Applicationmaster/default.aspx?page=wrapper&key=010.2015.00000747.001
mailto:mail@fairfieldcity.nsw.gov.au?subject=Development Application Enquiry: 747.1/2015
2015-12-11
2015-11-02
3
748.1/2015
23 Lewis ST BONNYRIGG HEIGHTS, NSW, Australia
Detached Secondary Dwelling
http://openaccess.fairfieldcity.nsw.gov.au/OpenAccess/Modules/Applicationmaster/default.aspx?page=wrapper&key=010.2015.00000748.001
mailto:mail@fairfieldcity.nsw.gov.au?subject=Development Application Enquiry: 748.1/2015
2015-12-11
2015-11-02
4
749.1/2015
28 Mistral ST GREENFIELD PARK, NSW, Australia
Construction of a Detached Secondary Dwelling
http://openaccess.fairfieldcity.nsw.gov.au/OpenAccess/Modules/Applicationmaster/default.aspx?page=wrapper&key=010.2015.00000749.001
mailto:mail@fairfieldcity.nsw.gov.au?subject=Development Application Enquiry: 749.1/2015
2015-12-11
2015-11-02
5
750.1/2015
22 Cabramatta RDE CABRAMATTA, NSW, Australia
Construction of a Front Fence
http://openaccess.fairfieldcity.nsw.gov.au/OpenAccess/Modules/Applicationmaster/default.aspx?page=wrapper&key=010.2015.00000750.001
mailto:mail@fairfieldcity.nsw.gov.au?subject=Development Application Enquiry: 750.1/2015
2015-12-11
2015-11-02
6
751.1/2015
11-17 Arundel RD HORSLEY PARK, NSW, Australia
Construction of a Two Storey Dwelling with Attached Garage and Alfresc
http://openaccess.fairfieldcity.nsw.gov.au/OpenAccess/Modules/Applicationmaster/default.aspx?page=wrapper&key=010.2015.00000751.001
mailto:mail@fairfieldcity.nsw.gov.au?subject=Development Application Enquiry: 751.1/2015
2015-12-11
2015-11-03
7
752.1/2015
27-31 Fairfield ST OLD GUILDFORD, NSW, Australia
Use of Building for Detailed Water Manufacturing and Distribution
http://openaccess.fairfieldcity.nsw.gov.au/OpenAccess/Modules/Applicationmaster/default.aspx?page=wrapper&key=010.2015.00000752.001
mailto:mail@fairfieldcity.nsw.gov.au?subject=Development Application Enquiry: 752.1/2015
2015-12-11
2015-11-03
8
753.1/2015
9 Jensen ST FAIRFIELD WEST, NSW, Australia
Demolition of Carport
http://openaccess.fairfieldcity.nsw.gov.au/OpenAccess/Modules/Applicationmaster/default.aspx?page=wrapper&key=010.2015.00000753.001
mailto:mail@fairfieldcity.nsw.gov.au?subject=Development Application Enquiry: 753.1/2015
2015-12-11
2015-11-03
9
754.1/2015
7 McCrea CL EDENSOR PARK, NSW, Australia
Alterations and Additions to Existing Dwelling and Attached Secondary
http://openaccess.fairfieldcity.nsw.gov.au/OpenAccess/Modules/Applicationmaster/default.aspx?page=wrapper&key=010.2015.00000754.001
mailto:mail@fairfieldcity.nsw.gov.au?subject=Development Application Enquiry: 754.1/2015
2015-12-11
2015-11-04
10
755.1/2015
17 Prospect RD CANLEY VALE, NSW, Australia
Torrens Title Subdivision to Create Two (2) Residential Allotments
http://openaccess.fairfieldcity.nsw.gov.au/OpenAccess/Modules/Applicationmaster/default.aspx?page=wrapper&key=010.2015.00000755.001
mailto:mail@fairfieldcity.nsw.gov.au?subject=Development Application Enquiry: 755.1/2015
2015-12-11
2015-11-04

Statistics

Average successful run time: less than a minute

Total run time: 1 day

Total cpu time used: 27 minutes

Total disk space used: 1.5 MB

History

  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

fairfield / scraper.rb