planningalerts-scrapers / spear

Streamlined Planning through Electronic Applications and Referrals Victoria

README.md

SPEAR - Streamlined Planning through Electronic Applications and Referrals, Victoria Scraper

  • Cookie tracking - No
  • Pagnation - yes, start row based via API
  • Javascript - No
  • Clearly defined data within a row - Partial - some data is found via details page

This is a scraper that runs on Morph. To get started see the documentation

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

To run the scraper

bundle exec ruby scraper.rb

Optionally set MORPH_AUTHORITIES to a comma seperated list of Authorities to examine to speed up development.

Scraper pauses between requests to be nice to the server.

Expected output

Injecting configuration and compiling...
Injecting scraper and running...
Getting list of Authorities...
Authenticating with SPEAR API...
Found 81 authorities...

Getting applications for Alpine Shire Council - Bright Office...
Getting applications for Bass Coast Shire Council...
Saving S262573E - 16 HAZELWOOD ROAD, SAN REMO VIC 3925 ...
Saving S262397S - 45 RUTTLE LANE, INVERLOCH VIC 3996 ...
Saving S262141V - HESLOP ROAD, NORTH WONTHAGGI VIC 3995 ...
Saving S262019P - 7 MARION COURT, INVERLOCH VIC 3996 ...
Saving S261931S - 15 STANLEY ROAD, GRANTVILLE VIC 3984 ...
Getting applications for Baw Baw Shire Council...
Saving S262533H - 409 COPELANDS ROAD, WARRAGUL VIC 3820 ...
Saving S261836C - 65 ROLLO STREET, YARRAGON VIC 3823 ...
Getting applications for Benalla Rural City Council...
WARNING: nothing found between 28 and 60 ago! previous SPEAR record dated 2025-11-26
...

Count  Authority
-----  --------------------------------------
    0  Alpine Shire Council - Bright Office
    5  Bass Coast Shire Council
    2  Baw Baw Shire Council
       Benalla Rural City Council [Not in use since 2025-11-26]
    ...

Finished!

Execution time: 20 to 30 minutes

To run style and coding checks

bundle exec rubocop

To check for security updates

gem install bundler-audit
bundle-audit

Contributors CloCkWeRX henare mlandauer archoo benrfairless ianheggie-oaf jamasalbertastash

The scraper is running. It was queued automatically .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Getting list of Authorities... Authenticating with SPEAR API... Found 82 authorities... Getting applications for Alpine Shire Council - Bright Office... Saving S276943E - 27 BAKERS GULLY ROAD, BRIGHT VIC 3741 Saving S276612H - 82 STATION STREET, POREPUNKAH VIC 3740 Getting applications for Ararat Rural City Council... Getting applications for Ballarat City Council... Saving S277087E - NICHOLSON STREET, BLACK HILL VIC 3350 Saving S277002H - 1114 HAVELOCK STREET, BALLARAT NORTH VIC 3350 Saving S276670B - 120 WEBSTER STREET, LAKE WENDOUREE VIC 3350 Saving S276453T - 13 CYPRESS ROAD, BROWN HILL VIC 3350 Saving S276503T - 601 RIPON STREET, REDAN VIC 3350 Getting applications for Banyule City Council... Saving S277709M - 138 HAWDON STREET, HEIDELBERG VIC 3084 Saving S277416V - 12 ORANGE COURT, BELLFIELD (GREATER MELBOURNE) VIC 3081 Saving S276907P - 5 ERICA COURT, BELLFIELD (GREATER MELBOURNE) VIC 3081 Saving S277029M - 69 JELLICOE STREET, IVANHOE VIC 3079 Saving S276481H - 204 WATERDALE ROAD, IVANHOE VIC 3079 Saving S276698B - 29 TIMOR PARADE, HEIDELBERG WEST VIC 3081 Saving S276695P - 1 KENMARE STREET, WATSONIA VIC 3087 Saving S276646T - 8 BAMFIELD ROAD, HEIDELBERG HEIGHTS VIC 3081 Saving S276561M - 87 LOCKSLEY ROAD, IVANHOE VIC 3079 Saving S275624C - 1 CARLSBERG ROAD, EAGLEMONT VIC 3084 Getting applications for Bass Coast Shire Council... Saving S277836V - 68 HAGELTHORN STREET, WONTHAGGI VIC 3995 Saving S277921S - 10 CAPRI PLACE, INVERLOCH VIC 3996 Saving S277880P - 16 BENETTI ROAD, WONTHAGGI VIC 3995 Saving S277662M - 41 THE ESPLANADE, INVERLOCH VIC 3996 Saving S277022T - 26 GRANDVIEW GROVE, COWES VIC 3922 Saving S276938P - 1 WOODLAND HEATH DRIVE, INVERLOCH VIC 3996 Getting applications for Baw Baw Shire Council... Saving S277751P - 5 MELANIE DRIVE, WARRAGUL VIC 3820 Saving S277661S - 207 MAIN NEERIM ROAD, NEERIM SOUTH VIC 3831 Saving S277508J - 100 BULN BULN ROAD, DROUIN VIC 3818 Saving S277102A - 32 ASHBY STREET, TRAFALGAR VIC 3824 Saving S275443M - MILLS ROAD, WARRAGUL VIC 3820 Getting applications for Bayside City Council... Saving S277701A - 15-17 BAY ROAD, SANDRINGHAM VIC 3191 Saving S277295P - 19 ROSE STREET, HIGHETT VIC 3190 Saving S277186B - 1 ESPERANCE AVENUE, BRIGHTON VIC 3186 Saving S277046M - 87 HIGHETT ROAD, HAMPTON VIC 3188 Saving S276892J - 35 SOUTH ROAD, BRIGHTON VIC 3186 Saving S276872A - 1 GRAY COURT, BEAUMARIS VIC 3193 Saving S276671V - 16 NEWBAY CRESCENT, BRIGHTON VIC 3186 Saving S276406P - 46 BEAUMARIS PARADE, HIGHETT VIC 3190 Saving S276650P - 23 HOYT STREET, HAMPTON VIC 3188 Saving S276031C - 122 WEATHERALL ROAD, CHELTENHAM VIC 3192 Getting applications for Benalla Rural City Council... Saving S277609V - WINTON-LURG ROAD, LURG VIC 3673 Saving S277327T - 20 GRANT DRIVE, BENALLA VIC 3672 Getting applications for Boroondara City Council... Saving S277714C - 1/30 ABERCROMBIE STREET, DEEPDENE VIC 3103 Saving S277665A - 922 TOORAK ROAD, CAMBERWELL VIC 3124 Saving S277008E - 28 ELM GROVE, KEW EAST VIC 3102 Saving S276947M - 1/41 ROBINSON ROAD, HAWTHORN VIC 3122 Saving S276927B - 10 FULLER AVENUE, GLEN IRIS VIC 3146 Saving S276669S - 3 LINDA CRESCENT, HAWTHORN VIC 3122 Getting applications for Borough of Queenscliffe... Saving S277458J - 33 MERCER STREET, QUEENSCLIFF VIC 3225 Getting applications for Brimbank City Council... Saving S277976J - 15 RALPH STREET, SUNSHINE WEST VIC 3020 Saving S277916B - 370 MAIN ROAD W, ST ALBANS VIC 3021 Saving S277816J - 80 WALMER AVENUE, ST ALBANS VIC 3021 Saving S277730H - 14 LEONARD STREET, SUNSHINE VIC 3020 Saving S277540T - 15 CRANBOURNE AVENUE, SUNSHINE NORTH VIC 3020 Saving S277345P - 38 DUNKELD AVENUE, SUNSHINE NORTH VIC 3020 Saving S277334B - 11A VALENTINE CRESCENT, SUNSHINE WEST VIC 3020 Saving S277297E - 245A DUKE STREET, SUNSHINE NORTH VIC 3020 Saving S276908J - 6A THORPE STREET, SUNSHINE VIC 3020 Saving S276723M - 20 COLLINSON STREET, KEILOR PARK VIC 3042 Saving S276184V - 1/39 ST ALBANS ROAD, ST ALBANS VIC 3021 Saving S276628A - 5 MAXWELTON CIRCUIT, DERRIMUT VIC 3026 Getting applications for Buloke Shire Council... Saving S277253B - 40 MCCRACKEN AVENUE, DONALD VIC 3480 Saving S277195A - 885 NULLAWIL LALBERT ROAD, KALPIENUNG VIC 3529 Getting applications for Cardinia Shire Council... Saving S277828T - 45 AXIS BOULEVARD, OFFICER SOUTH VIC 3809 Saving S277827A - 45 AXIS BOULEVARD, OFFICER SOUTH VIC 3809 Saving S277600M - 1 BRENNAN AVENUE, BEACONSFIELD UPPER VIC 3808 Saving S277478V - 18 MEEKING DRIVE, PAKENHAM VIC 3810 Saving S277250P - TIVENDALE ROAD, OFFICER VIC 3809 Saving S277248J - TIVENDALE ROAD, OFFICER VIC 3809 Saving S277164A - 8 BALE STREET, PAKENHAM VIC 3810 Saving S277161M - 8 BALE STREET, PAKENHAM VIC 3810 Saving S277178A - 14 TRADE PLACE, PAKENHAM VIC 3810 Saving S277177C - 14 TRADE PLACE, PAKENHAM VIC 3810 Saving S277115C - 1092 KOO WEE RUP ROAD, PAKENHAM VIC 3810 Saving S276956J - 90 AHERN ROAD, PAKENHAM VIC 3810 Saving S276712A - 50 RAILWAY AVENUE, GARFIELD VIC 3814 Saving S276990J - 50 RAILWAY AVENUE, GARFIELD VIC 3814 Saving S276849M - 4 ROPERS STREET, NAR NAR GOON VIC 3812 Saving S276788A - 46 TIVENDALE ROAD, OFFICER VIC 3809 Saving S276802V - 28 BAYVIEW ROAD, OFFICER VIC 3809 Saving S276797V - 28 BAYVIEW ROAD, OFFICER VIC 3809 Saving S275823P - 55 HAREWOOD PARK ROAD, GEMBROOK VIC 3783 Saving S275748M - 210 BREW ROAD, TYNONG NORTH VIC 3813 Getting applications for Casey City Council... Saving S277719E - 12281/933 Saving S277868S - 14 SLINGSBY AVENUE, BEACONSFIELD VIC 3807 Saving S277859T - 64 CLYDE ROAD, BERWICK VIC 3806 Saving S277249E - 11612/384 Saving S277810M - OP126493G s193 Saving S277039E - OP126493G (part) Saving S277232T - 11612/386 Saving S277230C - 11612/383 Saving S277693M - 64 CLYDE ROAD, BERWICK VIC 3806 Saving S277688V - 64 CLYDE ROAD, BERWICK VIC 3806 Saving S277715A - 81 HALLAM SOUTH ROAD, HALLAM VIC 3803 Saving S277562V - 11612/384 Saving S277313T - 11592/841 Saving S277653P - 2 DETTIFOSS COURT, CLYDE VIC 3978 Saving S276489V - 51 CENTRAL ROAD, HAMPTON PARK VIC 3976 Saving S277546S - 2602387 LX Saving S276714P - 3 DEBLIN DRIVE, NARRE WARREN VIC 3805 Saving S277357A - 468S PATTERSONS ROAD, CLYDE VIC 3978 Saving S275403P - 70S SMITHS LANE, CLYDE NORTH VIC 3978 Saving S276239A - 29 HARMER ROAD, HALLAM VIC 3803 Saving S276981M - 71 GIRVAN CIRCUIT, ENDEAVOUR HILLS VIC 3802 Saving S276897M - 23 ALBERT ROAD, HALLAM VIC 3803 Saving S276845E - 121 BELLAVITA AVENUE, CLYDE VIC 3978 Saving S276808T - 150 ERNSTBROOK DRIVE, CLYDE VIC 3978 Saving S276729J - 31 ALBERT ROAD, HALLAM VIC 3803 Saving S275742P - 23-25 LANGMORE LANE, BERWICK VIC 3806 Saving S276583P - 71 CHEVIOT AVENUE, BERWICK VIC 3806 Saving S276465C - 1450 THOMPSONS ROAD, CRANBOURNE EAST VIC 3977 Saving S276433H - 10 ENCORE BOULEVARD, CRANBOURNE SOUTH VIC 3977 Saving S276407J - 126 PAPERBARK STREET, DOVETON VIC 3177 Getting applications for Central Goldfields Shire Council... Saving S276565T - 23 CURRAGH MOOR ROAD, CARISBROOK VIC 3464 Getting applications for City of Greater Dandenong... Saving S277072J - 10 RICHARD STREET, SPRINGVALE SOUTH VIC 3172 Saving S277173V - 11 GWENDA STREET, DANDENONG VIC 3175 Saving S276757A - 20 LALOR COURT, SPRINGVALE SOUTH VIC 3172 Saving S276535P - 182 MONASH DRIVE, DANDENONG SOUTH VIC 3175 Saving S276463M - 56 MOLLISON STREET, DANDENONG NORTH VIC 3175 Getting applications for City of Greater Geelong... Saving S277871S - 56 SPROAT STREET, PORTARLINGTON VIC 3223 Saving S276567J - 3 HIGH RIDGE DRIVE, CLIFTON SPRINGS VIC 3222 Saving S277622P - 38 VERMONT AVENUE, CORIO VIC 3214 Saving S277517H - 98 MCCLELLAND AVENUE, LARA VIC 3212 Saving S277358T - 12-14 BENNETT STREET, DRYSDALE VIC 3222 Saving S277276A - 38 WILLANA AVENUE, HAMLYN HEIGHTS VIC 3215 Saving S276854C - 38-42 CITYVIEW DRIVE, WANDANA HEIGHTS VIC 3216 Saving S263349E - 28 NAGLE DRIVE, BELMONT VIC 3216 Saving S277153J - 379 BARWARRE ROAD, CHARLEMONT VIC 3217 Saving S277143S - 86-100 RESERVE ROAD, CHARLEMONT VIC 3217 Saving S277089V - 60 FOREST ROAD N, LARA VIC 3212 Saving S277024J - 78 DONNYBROOK ROAD, NORLANE VIC 3214 Saving S277012B - 4 VALDA CRESCENT, OCEAN GROVE VIC 3226 Saving S276940T - 1 KEVIAN PARK DRIVE, WALLINGTON VIC 3222 Saving S276904C - 185 BLUESTONE BRIDGE ROAD, LOVELY BANKS VIC 3213 Saving S276807A - 8 FAGG STREET, THOMSON (GEELONG) VIC 3219 Saving S276648J - 6 THORN STREET, BARWON HEADS VIC 3227 Saving S276620J - 10 BARTAIL WAY, ST LEONARDS VIC 3223 Saving S276569B - 3-5 STINTON AVENUE, NEWTOWN (GEELONG) VIC 3220 Saving S276613C - 1 PRIORY COURT, MARSHALL VIC 3216 Authenticating with SPEAR API... Saving S276538B - 14 WISTERIA GROVE, NORLANE VIC 3214 Saving S276534T - 119 FYANS STREET, SOUTH GEELONG VIC 3220 Saving S276443B - 12 DAXTER COURT, LEOPOLD VIC 3224 Getting applications for City of Wodonga... Saving S277803E - 109 ROCHE DRIVE, BARNAWARTHA NORTH VIC 3691 Saving S277214A - 4 INSULARE STREET, LENEVA VIC 3691 Saving S270162M - 64 BOATHAVEN ROAD, EBDEN VIC 3691 Saving S276610S - 74 WESTACOTT CRESCENT, BARANDUDA VIC 3691 Saving S275965T - 6 SILKY OAK AVENUE, WODONGA VIC 3690 Saving S266863P - 51 SOUTH STREET, WODONGA VIC 3690 Getting applications for Colac Otway Shire... Saving S276859E - BOTANIC STREET, ELLIMINYT VIC 3250 Saving S276876E - 67 MOORE STREET, COLAC VIC 3250 Saving S276614A - 17 YARIMA ROAD, CRESSY VIC 3322 Getting applications for Corangamite Shire Council... Saving S277842H - 34 CHURCH STREET, CAMPERDOWN VIC 3260 Saving S276822H - 30 LLOYD STREET, DERRINALLUM VIC 3325 Getting applications for Darebin City Council... Saving S277936M - 99 BARRY STREET, RESERVOIR VIC 3073 Saving S277781T - 78 PINE STREET, RESERVOIR VIC 3073 Saving S277703P - 59 DAREBIN ROAD, THORNBURY VIC 3071 Saving S277534H - 29 BARRY STREET, RESERVOIR VIC 3073 Saving S277484H - 136 PURINUAN ROAD, RESERVOIR VIC 3073 Saving S277482S - 145 RATHCOWN ROAD, RESERVOIR VIC 3073 Saving S277476E - 2 JOHNSON STREET, RESERVOIR VIC 3073 Saving S277194C - 13 MARY STREET, PRESTON VIC 3072 Saving S277023P - 27 FORDHAM ROAD, RESERVOIR VIC 3073 Saving S277163C - 38 WILLOW STREET, PRESTON VIC 3072 Saving S276902M - 149 COLLINS STREET, THORNBURY VIC 3071 Saving S277158M - 3 EISENHOWER STREET, RESERVOIR VIC 3073 Saving S277137E - 6 ARMADALE STREET, THORNBURY VIC 3071 Saving S276953A - 92 WHITELAW STREET, RESERVOIR VIC 3073 Saving S276856T - 15 BUTLER STREET, PRESTON VIC 3072 Saving S276853H - 215 ROSSMOYNE STREET, THORNBURY VIC 3071 Saving S276815B - 9 TAYLOR AVENUE, RESERVOIR VIC 3073 Saving S276759P - 86 FYFFE STREET, THORNBURY VIC 3071 Saving S276385A - 139 DUNDAS STREET, PRESTON VIC 3072 Saving S276557S - 65 ST VIGEONS ROAD, RESERVOIR VIC 3073 Saving S276665J - 15 DEAN STREET, PRESTON VIC 3072 Saving S276541B - 14 MIRANDA ROAD, RESERVOIR VIC 3073 Saving S276444V - 39 BEATRICE STREET, PRESTON VIC 3072 Getting applications for East Gippsland Shire Council...

Data

Downloaded 96650 times by slav123 openaustralia dcalde LoveMyData mlandauer DevAppProject jesse-a-reilly AthleticoPrawn tkrikke repose-lecture kouzi-sys vlp-cmd GitHubMLee Shawnyu0217 TheZepto tcassell94 davidyu37 qs4v8thvrq-boop srsmonty AriesXIX parsaie Manasaanand cankei NicMeg 538digital Joel-Tan_valocity TornMarketing Jedwards157 ken-guo1 AndreM101 93399339 planningalerts-scrapers odnagroup ponynoble Elliehancock

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (529 KB) Use the API

rows 10 / 1439

date_scraped description info_url date_received council_reference address comment_url
2026-09-17
To remove easement E-2 generally in accordance with the accompanying plan
https://www.spear.land.vic.gov.au/spear/app/public/applications/274670/summary
2026-08-20
S274627B
2 KINANE STREET, BRIGHTON VIC 3186
2026-09-17
Certification of a Plan under the Subdivision Act. Dealing Type Section 35(8) (Sub of land vested or reg in auth) (PS939694B) 1 lot
https://www.spear.land.vic.gov.au/spear/app/public/applications/274690/summary
2026-08-20
S274647M
270 CARDINIA ROAD, OFFICER SOUTH VIC 3809
2026-09-17
2-lot subdivision in accordance with the Planning Permit (PA25-0322) and it's endorsed plans.
https://www.spear.land.vic.gov.au/spear/app/public/applications/274732/summary
2026-08-20
S274689B
37 HARRY STREET, CRANBOURNE VIC 3977
2026-09-17
Certification of a Plan under the Subdivision Act. Dealing Type Section 22 (Consolidation) (PC383101T) 1 lot
https://www.spear.land.vic.gov.au/spear/app/public/applications/274702/summary
2026-08-20
S274659V
2-18I LAMB STREET, CRANBOURNE VIC 3977
2026-09-17
Certification of a Plan under the Subdivision Act. Dealing Type Section 22 (Subdivision) (PS937490E) 51 lots
https://www.spear.land.vic.gov.au/spear/app/public/applications/274662/summary
2026-08-20
S274619A
50 MORISON ROAD, CLYDE VIC 3978
2026-09-17
Certification of a Plan under the Subdivision Act. Dealing Type Section 22 (Subdivision) (PS937489N) 54 lots
https://www.spear.land.vic.gov.au/spear/app/public/applications/274598/summary
2026-08-20
S274555A
50 MORISON ROAD, CLYDE VIC 3978
2026-09-17
Boundary realignment/re-subdivision and removal of an easement (carriageway). Refer to planning report for details.
https://www.spear.land.vic.gov.au/spear/app/public/applications/273536/summary
2026-08-20
S273493B
577 WHOROULY RIVER ROAD, WHOROULY EAST VIC 3735
2026-09-17
Application for Crown Survey Plan submitted to the Surveyor-General
https://www.spear.land.vic.gov.au/spear/app/public/applications/276243/summary
2026-09-16
S276200J
WIGG ROAD, GIRGARRE VIC 3624
2026-09-17
Application for Crown Survey Plan submitted to the Surveyor-General
https://www.spear.land.vic.gov.au/spear/app/public/applications/276240/summary
2026-09-16
S276197B
WIGG ROAD, GIRGARRE VIC 3624
2026-09-17
Application for Crown Survey Plan submitted to the Surveyor-General
https://www.spear.land.vic.gov.au/spear/app/public/applications/276212/summary
2026-09-16
S276169M
TONKIN ROAD, LOCKINGTON VIC 3563

Statistics

Average successful run time: 17 minutes

Total run time: about 2 months

Total cpu time used: about 10 hours

Total disk space used: 641 KB

History

  • Auto ran revision 3bc2d9a5 and failed .
    154 records added, 154 records removed in the database
  • Auto ran revision 3bc2d9a5 and completed successfully .
    593 records added, 630 records removed in the database
  • Auto ran revision 3bc2d9a5 and completed successfully .
    629 records added, 647 records removed in the database
  • Auto ran revision 3bc2d9a5 and completed successfully .
    639 records added, 602 records removed in the database
  • Auto ran revision 3bc2d9a5 and completed successfully .
    606 records added, 572 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

spear / scraper.rb