Griffith City Council scraper

This site is a typical .NET site involves the followings. * Cookie - Yes * Pagnation - No, hardcoded to fetch up to 100 records * Javascript - No * Ajax - Yes * JSON - Yes

Setup MORPH_PERIOD for data recovery, available options are * thisweek (default, today - 10 days) * thismonth * lastmonth * custom = yyyy-mm ( eg. 2017-01 )

Enjoy

Contributors mlandauer LoveMyData

Last run failed with status code 999.

Console output of last run

Please install the Morph Github App on LoveMyData so that Morph can access this repository on GitHub. Please go to https://github.com/apps/morph-io/installations/new/permissions?repository_ids%5B%5D=49949842&repository_ids%5B%5D=134056878&repository_ids%5B%5D=47324812&repository_ids%5B%5D=88161914&repository_ids%5B%5D=68444421&repository_ids%5B%5D=47314642&repository_ids%5B%5D=93590295&repository_ids%5B%5D=68878229&repository_ids%5B%5D=72811725&repository_ids%5B%5D=56903014&repository_ids%5B%5D=170608803&repository_ids%5B%5D=108057954&repository_ids%5B%5D=92110889&repository_ids%5B%5D=67974508&repository_ids%5B%5D=87934825&repository_ids%5B%5D=145681800&repository_ids%5B%5D=47260725&repository_ids%5B%5D=88051332&repository_ids%5B%5D=91232291&repository_ids%5B%5D=47496147&repository_ids%5B%5D=68881868&repository_ids%5B%5D=47331141&repository_ids%5B%5D=87817830&repository_ids%5B%5D=177515286&repository_ids%5B%5D=46924700&repository_ids%5B%5D=106624312&repository_ids%5B%5D=46796215&repository_ids%5B%5D=91168909&repository_ids%5B%5D=67973091&repository_ids%5B%5D=107615216&repository_ids%5B%5D=85133473&repository_ids%5B%5D=91752802&repository_ids%5B%5D=47815673&repository_ids%5B%5D=99768398&repository_ids%5B%5D=67903220&repository_ids%5B%5D=104952368&repository_ids%5B%5D=51361943&repository_ids%5B%5D=47970061&repository_ids%5B%5D=67978193&repository_ids%5B%5D=104017335&repository_ids%5B%5D=47314661&repository_ids%5B%5D=46924659&repository_ids%5B%5D=91053021&repository_ids%5B%5D=156531533&repository_ids%5B%5D=96767060&repository_ids%5B%5D=57299199&repository_ids%5B%5D=156799498&repository_ids%5B%5D=159443632&repository_ids%5B%5D=47876278&repository_ids%5B%5D=159422813&repository_ids%5B%5D=47313800&repository_ids%5B%5D=107520757&repository_ids%5B%5D=88119130&repository_ids%5B%5D=95849825&repository_ids%5B%5D=68373869&repository_ids%5B%5D=46966464&repository_ids%5B%5D=102549557&repository_ids%5B%5D=152169956&repository_ids%5B%5D=69199374&repository_ids%5B%5D=47871639&repository_ids%5B%5D=108206347&repository_ids%5B%5D=92701523&repository_ids%5B%5D=124995950&repository_ids%5B%5D=98845885&repository_ids%5B%5D=68511763&repository_ids%5B%5D=85155894&repository_ids%5B%5D=47400030&repository_ids%5B%5D=105615080&repository_ids%5B%5D=90943444&repository_ids%5B%5D=97595478&repository_ids%5B%5D=68342363&repository_ids%5B%5D=46921298&repository_ids%5B%5D=68098781&repository_ids%5B%5D=47917197&repository_ids%5B%5D=174301699&repository_ids%5B%5D=88171467&repository_ids%5B%5D=92243788&repository_ids%5B%5D=103522127&repository_ids%5B%5D=97825255&repository_ids%5B%5D=57381657&repository_ids%5B%5D=107633285&repository_ids%5B%5D=58468748&repository_ids%5B%5D=107853888&repository_ids%5B%5D=107861107&repository_ids%5B%5D=91777660&repository_ids%5B%5D=107852602&repository_ids%5B%5D=49410115&repository_ids%5B%5D=47873122&repository_ids%5B%5D=47874423&repository_ids%5B%5D=100552305&repository_ids%5B%5D=92278881&repository_ids%5B%5D=96265559&suggested_target_id=15683093 Why? See https://morph.io/documentation/github_app

Data

Downloaded 1658 times by LoveMyData henare

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (378 KB) Use the API

rows 10 / 1326

id council_reference address description info_url comment_url date_scraped date_received
1
554/2016.1
68 Zirilli Av, Griffith 2680 NSW
Dwelling with attached garage
mailto:admin@griffith.nsw.gov.au
2016-09-12
2016-08-16
2
553/2016.1
21 Zirilli Av, Griffith 2680 NSW
Dwelling with attached garage
mailto:admin@griffith.nsw.gov.au
2016-09-12
2016-08-24
3
176/2016.1
220 Banna Av, Griffith 2680 NSW
Retail fitout for Australian Unity Client Centre
mailto:admin@griffith.nsw.gov.au
2016-09-12
2016-08-19
4
188/2016.1
62 Hyandra St, Griffith 2680 NSW
Shed
mailto:admin@griffith.nsw.gov.au
2016-09-12
2016-08-31
5
239/2015.1
20 Barellan St, Griffith 2680 NSW
Carport
mailto:admin@griffith.nsw.gov.au
2016-09-12
2016-08-30
6
179/2016.1
79 Spence Rd, Griffith 2680 NSW
Dwelling with attached garage
mailto:admin@griffith.nsw.gov.au
2016-09-12
2016-08-23
7
190/2016.1
54 Pilloni Rd, Yoogali 2680 NSW
New Shed/Awning
mailto:admin@griffith.nsw.gov.au
2016-09-12
2016-08-31
8
192/2016.1
38-40 Kidman Wy, Griffith 2680 NSW
Industrial shed for ancillary to existing trucking business
mailto:admin@griffith.nsw.gov.au
2016-09-12
2016-08-31
9
189/2016.1
7 Gordon Av, Griffith 2680 NSW
Shed
mailto:admin@griffith.nsw.gov.au
2016-09-12
2016-08-31
10
76/2016.1
Railway Pde, Yenda 2681 NSW
Patio
mailto:admin@griffith.nsw.gov.au
2016-09-12
2016-08-30

Statistics

Average successful run time: half a minute

Total run time: about 13 hours

Total cpu time used: 4 minutes

Total disk space used: 504 KB

History

  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

griffith / scraper.php