planningalerts-scrapers / spear

Streamlined Planning through Electronic Applications and Referrals Victoria


Contributors CloCkWeRX henare mlandauer archoo

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Getting applications for Alpine Resorts - Mt Buller... Getting applications for Alpine Shire Council - Bright Office... Saving S247429S... Saving S246056H... Getting applications for Ararat Rural City Council... Saving S247084J... Saving S221002T... Getting applications for Ballarat City Council... Saving S247093H... Saving S247091S... Saving S247085E... Saving S246731E... Saving S246745E... Saving S247019J... Saving S247005J... Saving S244641E... Saving S246951A... Saving S246836A... Saving S244968H... Saving S246541S... Saving S178181C... Saving S178190B... Saving S246361V... Getting applications for Banyule City Council... Saving S247504T... Saving S247374P... Saving S246761J... Saving S246114J... Saving S246574H... Saving S246665B... Saving S246629J... Saving S246376S... Saving S246433A... Getting applications for Bass Coast Shire Council... Saving S243988E... Saving S245765C... Saving S247403H... Saving S247343P... Saving S247298S... Saving S240341C... Saving S247202E... Saving S246993M... Saving S246667S... Saving S246839J... Saving S246088C... Saving S246518E... Saving S246492M... Saving S246328S... Getting applications for Baw Baw Shire Council... Saving S247601A... Saving S247409E... Saving S247302V... Saving S247255H... Saving S246612A... Saving S246466P... Saving S246469B... Saving S246319T... Getting applications for Bayside City Council... Saving S247323C... Saving S245637A... Saving S246652V... Saving S246356E... Saving S246816M... Getting applications for Benalla Rural City Council... Saving S246723C... Getting applications for Boroondara City Council... Saving S247330J... Saving S247124S... Saving S246979A... Saving S246762E... Saving S246610H... Saving S246387E... Saving S246323P... Saving S246320C... Getting applications for Borough of Queenscliffe... Getting applications for Brimbank City Council... Saving S247635J... Saving S247566T... Saving S247350V... Saving S247380B... Saving S247092M... Saving S246687C... Saving S246411V... Saving S246846S... Saving S244244C... Saving S245831H... Saving S246638H... Saving S246537V... Getting applications for Buloke Shire Council... Saving S246561C... Getting applications for Cardinia Shire Council... Saving S247721B... Saving S247545M... Saving S247544S... Saving S247662C... Saving S247577H... Saving S247574V... Saving S246680J... Saving S246685M... Saving S247499T... Saving S247498A... Saving S246619S... Saving S246617B... Saving S247224H... Saving S247219S... Saving S246269T... Saving S246268A... Getting applications for Casey City Council... Saving S246445H... Saving S247608S... Saving S247629A... Saving S247445V... Saving S247322H... Saving S247514M... Saving S247408J... Saving S247279B... Saving S247336H... Saving S247309P... Saving S247288A... Saving S247103J... Saving S247121E... Saving S246992S... Saving S246981C... Saving S246742T... Saving S246819A... Saving S246880S... Saving S246694J... Saving S245947P... Saving S246668M... Saving S246628P... Saving S246581P... Saving S246556M... Saving S246477C... Saving S246140H... Saving S246200B... Saving S246156A... Saving S246120V... Saving S246334C... Saving S246352A... Saving S246333H... Saving S246317C... Getting applications for Central Goldfields Shire Council... Getting applications for City of Greater Dandenong... Saving S247030M... Saving S245859H... Saving S246508M... Saving S245306B... Saving S246777B... Saving S246567B... Saving S246528A... Saving S246523V... Getting applications for City of Greater Geelong... Saving S247525B... Saving S247231P... Saving S247373T... Saving S247328E... Saving S246957V... Saving S247182J... Saving S247087V... Saving S246901H... Saving S246867A... Saving S244851E... Saving S246842J... Saving S246802M... Saving S246796S... Saving S246779S... Saving S246741A... Saving S246671M... Saving S246472B... Saving S243609H... Saving S246360B... Getting applications for City of Wodonga... Saving S247496H... Saving S247306C... Getting applications for Colac Otway Shire... Saving S246462H... Saving S247040E... Saving S246347H... Saving S246098V... Getting applications for Corangamite Shire Council... Saving S247520A... Saving S247225C... Getting applications for Darebin City Council... Saving S247414V... Saving S246693P... Saving S247044M... Saving S247045H... Saving S247072B... Saving S246978C... Saving S246744J... Saving S246602E... Saving S246430M... Saving S246375V... Getting applications for East Gippsland Shire Council... Saving S247221V... Saving S246554V... Saving S246769A... Saving S246740C... Saving S246197S... Saving S246194E... Getting applications for Frankston City Council... Saving S244875A... Saving S247127C... Saving S242864H... Saving S246919P... Saving S246914M... Saving S246146E... Saving S246968J... Saving S246861B... Saving S246661T... Saving S246557H... Saving S240409J... Saving S246190A... Getting applications for Gannawarra Shire Council... Getting applications for Glen Eira City Council... Saving S247470A... Saving S247167B... Saving S247398H... Saving S247386A... Saving S247303S... Saving S243897M... Saving S247326P... Saving S246849C... Saving S247318M... Saving S247299M... Saving S246494C... Saving S247198B... Saving S247095A... Saving S246952T... Saving S246916C... Saving S246899T... Saving S246809E... Saving S246754C... Saving S246692T... Saving S246682B... Saving S246618V... Saving S246563T... Saving S246527C... Saving S246468E... Saving S243324T... Saving S245906V... Getting applications for Glenelg Shire Council... Saving S246736H... Saving S246359S... Getting applications for Golden Plains Shire Council... Saving S247517A... Saving S247439J... Saving S247369A... Saving S247159A... Saving S246943V... Saving S240158H... Saving S243561M... Getting applications for Greater Bendigo City Council... Saving S247707M... Saving S247519P... Saving S247453A... Saving S246545A... Saving S244960T... Saving S247128A... Saving S246938E... Saving S246837T... Saving S246804C... Saving S246718M... Saving S246378H... Saving S245340B... Getting applications for Greater Shepparton City Council... Saving S247399C... Saving S247610V... Saving S247101T... Saving S247099E... Saving S246857E... Saving S246683V... Saving S246676P... Saving S246028T... Saving S246424B... Getting applications for Hepburn Shire Council... Saving S244326A... Saving S244316E... Saving S246531A... Getting applications for Hindmarsh Shire Council... Getting applications for Hobsons Bay City Council... Saving S247720E... Saving S245011T... Saving S247337C... Saving S246897C... Saving S247218V... Saving S247113C... Saving S247104E... Saving S243332V... Saving S247066P... Saving S247059H... Saving S246926V... Saving S246896H... Saving S246526H... Saving S246310J... Getting applications for Horsham Rural City Council... Saving S247317S... Saving S246443S... Getting applications for Hume City Council... Saving S246608C... Saving S247711H... Saving S247554J... Saving S247602T... Saving S247537J... Saving S247419A... Saving S247448H... Saving S247179J... Saving S247434H... Saving S247290C... Saving S247215J... Saving S247189C... Saving S247125M... Saving S246946H... Saving S246791P... Saving S246794B... Saving S246627T... Saving S246621V... Saving S234518S... Saving S246512H... Saving S246426S... Saving S246354P... Saving S246273P... Getting applications for Indigo Shire Council... Getting applications for Kingston City Council... Saving S247547C... Saving S247516C... Saving S247160H... Saving S247316V... Saving S246079E... Saving S246840T... Saving S247250E... Saving S247212A... Saving S246949T... Saving S246738A... Saving S246876V... Saving S246739T... Saving S246534J... Saving S246570B... Saving S246536B... Saving S246296M... Getting applications for Knox City Council... Saving S247594H... Saving S247459V... Saving S247077C... Saving S245576J... Saving S246760P... Saving S246832S... Saving S246820H... Saving S246496T... Saving S246220M... Saving S246093T... Getting applications for Latrobe City Council... Saving S247220B... Saving S247423T... Saving S247364V... Saving S247164P... Saving S246977H... Saving S247026S... Saving S246637M... Saving S246605S... Saving S246546T... Getting applications for Loddon Shire Council... Getting applications for Macedon Ranges Shire Council... Saving S246452P... Saving S246218H... Saving S246565J... Saving S246438B... Saving S246372J... Saving S245085C... Saving S246339E... Saving S246335A... Getting applications for Manningham City Council... Saving S247500M... Saving S247480S... Saving S246187A... Saving S247184B... Saving S247058M... Saving S246826E... Saving S246651B... Saving S246577T... Saving S246501T... Saving S245874S... Saving S246358V... Getting applications for Mansfield Shire Council... Saving S246768C... Saving S246403T... Getting applications for Maribyrnong City Council... Saving S247705V... Saving S247461B... Saving S247061M... Saving S240744C... Saving S246815S... Saving S246780B... Saving S246697V... Saving S246383A... Getting applications for Maroondah City Council... Saving S247660M... Saving S247587B... Saving S247568J... Saving S247383M... Saving S247325T... Saving S247304M... Saving S247199V... Saving S247034T... Saving S246525M... Saving S246783M... Saving S246580T... Saving S246436J... Saving S246165V... Saving S218703J... Saving S246350H... Getting applications for Melbourne City Council... Saving S247814J... Saving S246679B... Saving S247513S... Saving S247076H... Saving S247086B... Saving S246905P... Saving S247046C... Saving S246772A... Getting applications for Melton City Council... Saving S247771S... Saving S247732P... Saving S247239C... Saving S247270S... Saving S247245P... Saving S246487V... Saving S246489M... Saving S246490V... Saving S245864A... Saving S247155S... Saving S247054E... Saving S247039V... Saving S247000H... Saving S246566E... Saving S242165S... Saving S246677J... Saving S245669T... Saving S246485E... Saving S246500A... Saving S246442V... Saving S246163E... Getting applications for Merri-Bek City Council... Saving S247555E... Saving S247518T... Saving S247436A... Saving S247300E... Saving S247244T... Saving S247048T... Saving S247015C... Saving S247004P... Saving S246925B... Saving S246805A... Saving S246630T... Saving S246614P... Saving S246604V... Saving S246584B... Saving S246569S... Saving S246503J... Saving S246407B... Getting applications for Mildura Rural City Council... Saving S247558S... Saving S247533C... Saving S247526V... Saving S247441P... Saving S247351S... Saving S247346B... Saving S247230T... Saving S247151J... Saving S247150P... Saving S247147P... Saving S246329M... Saving S246823T... Saving S246480C... Saving S246459H... Getting applications for Minister for Planning - Others... Getting applications for Minister for Planning - Social Housing... Getting applications for Mitchell Shire Council... Saving S247282B... Saving S240317V... Getting applications for Moira Shire Council... Saving S247295E... Saving S247136B... Saving S245654A... Getting applications for Monash City Council... Saving S247588V... Saving S247502C... Saving S247437T... Saving S247427B... Saving S247355A... Saving S247263J... Saving S247257A... Saving S247181P... Saving S242013T... Saving S246141C... Saving S246990B... Saving S246947C... Saving S246828V... Saving S246792J... Saving S246655H... Saving S246588H... Getting applications for Moonee Valley City Council... Saving S247281E... Saving S247658H... Saving S247107S... Saving S246423E... Saving S247038B... Saving S246730J... Saving S245701M... Saving S246991V... Saving S246810P... Saving S241018H... Saving S246272T... Saving S246010M... Saving S246464A... Saving S244309A... Getting applications for Moorabool Shire Council... Saving S247611S... Getting applications for Mornington Peninsula Shire Council... Saving S247068E... Saving S247536P... Saving S247444B... Saving S247277J... Saving S247293P... Saving S247331E... Saving S241856S... Saving S246371P... Saving S246890J... Saving S246550P... Saving S246775J... Saving S246615J... Saving S246719H... Saving S246483P... Saving S246620B... Saving S246597E... Saving S246370T... Saving S246364H... Getting applications for Mount Alexander Shire Council... Saving S243850V... Saving S247359E... Saving S246851H... Saving S246751S... Saving S246491S... Getting applications for Moyne Shire Council... Saving S246514A... Saving S246374B... Getting applications for Murrindindi Shire Council... Saving S246342E... Getting applications for Nillumbik Shire Council... Saving S247196J... Saving S246675T... Saving S246633E... Getting applications for Northern Grampians Shire Council... Saving S247703E... Saving S246538S... Saving S246576A... Getting applications for Port Phillip City Council... Saving S247396S... Saving S247311T... Saving S247367H... Saving S246474S... Saving S247021P... Saving S246384T... Getting applications for Pyrenees Shire Council... Saving S247365S... Saving S247014H... Saving S247010B... Getting applications for Rural City of Wangaratta... Saving S246586S... Saving S246892B... Saving S244609V... Saving S245289S... Saving S245540H... Getting applications for Shire of Campaspe... Saving S247240M... Saving S247237M... Saving S247235V... Saving S247177T... Getting applications for South Gippsland Shire Council... Saving S247210H... Saving S247227T... Saving S247236S... Saving S247238H... Saving S246784H... Saving S247258T... Saving S246366A... Saving S242688T... Saving S246824P... Saving S246573M... Getting applications for Southern Grampians Shire Council... Saving S246942B... Getting applications for SPEAR Test Council... SubmittedDate is empty for S096692H. So, skipping. Getting applications for Stonnington City Council... Saving S247222S... Saving S247586E... Saving S247301B... Saving S246985J... Saving S247385C... Saving S247041B... Saving S247028H... Saving S246020E... Getting applications for Strathbogie Shire Council... Saving S246909V... Saving S246595P... Saving S246594T... Getting applications for Surf Coast Shire Council... Saving S247080C... Saving S247089M... Getting applications for Swan Hill Rural City Council... Saving S247291A... Saving S247289T... Saving S247283V... Saving S247023E... Saving S246755A... Getting applications for Towong Shire Council... Getting applications for Warrnambool City Council... Saving S247503A... Saving S241548S... Saving S247262P... Saving S247261T... Saving S246781V... Saving S247206M... Saving S230807V... Saving S246511M... Saving S233535C... Getting applications for Wellington Shire Council... Saving S247233E... Saving S247615A... Saving S245419V... Saving S247082T... Saving S246983T... Saving S246907E... Saving S246859V... Saving S246722H... Saving S246543H... Saving S246507S... Saving S246488S... Saving S246394M... Getting applications for West Wimmera Shire Council... Saving S246535E... Getting applications for Whitehorse City Council... Saving S247552T... Saving S247451H... Saving S247415S... Saving S247053J... Saving S246852C... Saving S246773T... Saving S246380M... Saving S246104S... Getting applications for Whittlesea City Council... Saving S247389J... Saving S247216E... Saving S247694A... Saving S247564C... Saving S247538E... Saving S247397M... Saving S247335M... Saving S247241H... Saving S247186S... Saving S247154V... Saving S247013M... Saving S246250S... Saving S246486B... Saving S245804P... Saving S246044A... Saving S246318A... Saving S246313V... Getting applications for Wyndham City Council... Saving S246179V... Saving S247334S... Saving S247327J... Saving S246974V... Saving S246969E... Saving S246750V... Saving S246681E... Saving S246600P... Saving S246286T... Saving S245524C... Saving S245523H... Saving S246427M... Getting applications for Yarra City Council... Saving S247032C... Saving S246632J... Saving S246444M... Saving S246185H... Getting applications for Yarra Ranges Shire Council... Saving S238173P... Saving S239752S... Saving S242903T... Saving S246332M... Saving S247126H... Saving S246939B... Saving S246770H... Saving S246656C... Saving S246642C... Saving S246493H... Saving S246322T... Saving S246338J... Getting applications for Yarriambiack Shire Council... Saving S244596H... Saving S247180T... Saving S246972E... Saving S246721M... Saving S244825H...

Data

Downloaded 82985 times by slav123 openaustralia LoveMyData dcalde mlandauer DevAppProject jesse-a-reilly repose-lecture GitHubMLee TheZepto srsmonty AriesXIX parsaie TornMarketing cankei NicMeg planningalerts-scrapers odnagroup ponynoble Elliehancock Jedwards157 AndreM101 93399339

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (52.6 MB) Use the API

rows 10 / 138958

date_scraped description info_url date_received council_reference address comment_url
2012-09-17
2012-08-13
S026214J
33 DEACON AVENUE, BRIGHT VIC 3741
2012-09-17
2 lot resubdivision
2012-06-20
S024425C
15 DELANY AVENUE, BRIGHT VIC 3741
2012-09-17
2012-07-16
S025191P
MILL ROAD MOUNT BEAUTY 3699
2012-09-17
2010-12-02
S010773J
2/29A BAKERS GULLY ROAD, BRIGHT VIC 3741
2012-09-17
2011-11-07
S018317C
73 STATION STREET, POREPUNKAH VIC 3740
2012-09-17
2011-04-08
S013074J
51 DELANY AVENUE, BRIGHT VIC 3741
2012-09-17
2011-09-08
S016718J
7 THE TRACK, BRIGHT VIC 3741
2012-09-17
2012-05-14
S023304S
6 DIGGINGS ROAD, TAWONGA VIC 3697
2012-09-17
2012-02-24
S021086C
137 SCHOOL ROAD, WANDILIGONG VIC 3744
2012-09-17
Two lot resubdivision
2012-06-05
S023932B
8 TYNTYNDER LANE, BRIGHT VIC 3741

Statistics

Average successful run time: 15 minutes

Total run time: about 1 month

Total cpu time used: about 9 hours

Total disk space used: 52.7 MB

History

  • Auto ran revision b640683c and completed successfully .
    621 records added, 621 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    622 records added, 622 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    624 records added, 624 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    648 records added, 647 records removed in the database
  • Auto ran revision b640683c and failed .
    672 records added, 630 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

spear / scraper.rb