planningalerts-scrapers / saplanningportal

South Australia Development Applications - SA Planning Portal

README.md

South Australia (SA) Planning Portal scraper

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

  • Server - .NET
  • Cookie tracking - No
  • Pagnation - Yes
  • Javascript - No
  • Ajax - Yes
  • Clearly defined data within a record - Yes
  • Scrape detail page - No

Enjoy

Contributors LoveMyData MichaelBone mlandauer benrfairless ianheggie-oaf Br3nda

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Using user agent: Ruby/3.2.2 PlanningAlerts scraper for SA Planning Portal/2.0 (https://www.planningalerts.org.au/about) Visiting html page to set cookies: https://plan.sa.gov.au/have_your_say/notified_developments/current_notified_developments ... Delaying for 22.89s to avoid 429 Too Many Requests errors /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Got 200 response from https://cdn.plan.sa.gov.au/public-notifications/getpublicnoticessummary Found 113 applications to process in random order with 15.0...25.0 seconds between requests. Reusing comment email and authority from existing record: 25033709 Saving record 25033709, 16 DUNE CT WEST LAKES SHORE SA 5020 Reusing comment email and authority from existing record: 25013329 Saving record 25013329, 31 VICTORIA RD MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 25031055 Saving record 25031055, 71 TOWER ST N NORTH ADELAIDE SA 5006 Reusing comment email and authority from existing record: 25026416 Saving record 25026416, 280 MAIN SOUTH RD MORPHETT VALE SA 5162 Reusing comment email and authority from existing record: 25012451 Saving record 25012451, 383 -401 LINCOLN HWY BOSTON SA 5607 Reusing comment email and authority from existing record: 25033416 Saving record 25033416, 77 -87 WEBB ST PORT ADELAIDE SA 5015 Reusing comment email and authority from existing record: 25014834 Saving record 25014834, 2 LANDRACE RD MULLAQUANA SA 5608 Reusing comment email and authority from existing record: 25033069 Saving record 25033069, 18 BRIAR AV MEDINDIE SA 5081 Reusing comment email and authority from existing record: 25033734 Saving record 25033734, 27 VALETTA RD KIDMAN PARK SA 5025 Reusing comment email and authority from existing record: 25005541 Saving record 25005541, 175 MAIN SOUTH RD YANKALILLA SA 5203 Reusing comment email and authority from existing record: 25029400 Saving record 25029400, 36 FLINDERS DR STREAKY BAY SA 5680 Reusing comment email and authority from existing record: 25001474 Saving record 25001474, 269 -273 KENSINGTON RD KENSINGTON PARK SA 5068 Reusing comment email and authority from existing record: 25028411 Saving record 25028411, 26 TOBRUK AV KENSINGTON PARK SA 5068 Reusing comment email and authority from existing record: 25013916 Saving record 25013916, 90 FARRANT ST PROSPECT SA 5082 Reusing comment email and authority from existing record: 25013548 Saving record 25013548, 872 OLD BULL CREEK RD PARIS CREEK SA 5201 Reusing comment email and authority from existing record: 25029453 Saving record 25029453, 66 -70 MAGILL RD NORWOOD SA 5067 Reusing comment email and authority from existing record: 25010864 Saving record 25010864, 9 -11 HOLDER AV RICHMOND SA 5033 Reusing comment email and authority from existing record: 25031425 Saving record 25031425, 25 CYGNET CT GLENELG NORTH SA 5045 Reusing comment email and authority from existing record: 25021099 Saving record 25021099, 44 PALMERSTON RD UNLEY SA 5061 Reusing comment email and authority from existing record: 25022155 Saving record 25022155, LOT 107 ARNO BAY RD CLEVE SA 5640 Reusing comment email and authority from existing record: 25030642 Saving record 25030642, LOT 101 ASHFIELD RD ELIZABETH SA 5112 Reusing comment email and authority from existing record: 25019253 Saving record 25019253, 6 BRIENS RD NORTHFIELD SA 5085 Reusing comment email and authority from existing record: 25030371 Saving record 25030371, 131 -133 WATERPORT RD PORT ELLIOT SA 5212 Reusing comment email and authority from existing record: 25033320 Saving record 25033320, LOT 4 BAGSTER RD SALISBURY NORTH SA 5108 Reusing comment email and authority from existing record: 25035189 Saving record 25035189, 20A BOANDIK TCE MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 25022401 Saving record 25022401, LOT 78 CLEARWATER DR STREAKY BAY SA 5680 Reusing comment email and authority from existing record: 25026849 Saving record 25026849, 177 FISHER ST MALVERN SA 5061 Reusing comment email and authority from existing record: 25034042 Saving record 25034042, 21 JENKINS AV WHYALLA NORRIE SA 5608 Reusing comment email and authority from existing record: 25028102 Saving record 25028102, LOT 441 TRURO RD KOONUNGA SA 5373 Reusing comment email and authority from existing record: 25031006 Saving record 25031006, 25 NINTH AV ST PETERS SA 5069 Reusing comment email and authority from existing record: 25032728 Saving record 25032728, UNIT 5 344 MILITARY RD LARGS BAY SA 5016 Reusing comment email and authority from existing record: 25034348 Saving record 25034348, 56 -58 FREDERICK ST MAYLANDS SA 5069 Reusing comment email and authority from existing record: 25028927 Saving record 25028927, 622 GREENHILL RD BURNSIDE SA 5066 Reusing comment email and authority from existing record: 25026397 Saving record 25026397, 182 SALISBURY HWY SALISBURY SA 5108 Reusing comment email and authority from existing record: 25028487 Saving record 25028487, 15 -15A BEACH RD CHRISTIES BEACH SA 5165 Reusing comment email and authority from existing record: 25032933 Saving record 25032933, 755 MAIN NORTH RD POORAKA SA 5095 Reusing comment email and authority from existing record: 25032638 Saving record 25032638, 42 HILLCREST DR EDEN HILLS SA 5050 Reusing comment email and authority from existing record: 25025379 Saving record 25025379, 137 LOCHSIDE DR WEST LAKES SA 5021 Reusing comment email and authority from existing record: 25018478 Saving record 25018478, 367 HALIFAX ST ADELAIDE SA 5000 Reusing comment email and authority from existing record: 24032740 Saving record 24032740, 15 BROUGHAM PL ALBERTON SA 5014 Reusing comment email and authority from existing record: 25032109 Saving record 25032109, 35 HEWITT AV ROSE PARK SA 5067 Reusing comment email and authority from existing record: 25028099 Saving record 25028099, 38 MARBLE QUARRY RD KOONUNGA SA 5373 Reusing comment email and authority from existing record: 25027976 Saving record 25027976, 1365 NORTH EAST RD TEA TREE GULLY SA 5091 Reusing comment email and authority from existing record: 25033409 Saving record 25033409, 51 BARKER AV FLINDERS PARK SA 5025 Reusing comment email and authority from existing record: 24004855 Saving record 24004855, 124 FREDERICK ST WELLAND SA 5007 Reusing comment email and authority from existing record: 25022259 Saving record 25022259, LOT 66 ESPLANADE FOWLERS BAY SA 5690 Reusing comment email and authority from existing record: 25023494 Saving record 25023494, 10 -14 TOORONGA AV EDWARDSTOWN SA 5039 Reusing comment email and authority from existing record: 25031152 Saving record 25031152, 56 MITCHELL ST E SEATON SA 5023 Reusing comment email and authority from existing record: 25032529 Saving record 25032529, 4 ANDERSON WALK SMITHFIELD SA 5114 Reusing comment email and authority from existing record: 25033227 Saving record 25033227, UNIT 1 10 HERBERT ST MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 25030200 Saving record 25030200, 151 ESPLANADE HENLEY BEACH SOUTH SA 5022 Reusing comment email and authority from existing record: 25032219 Saving record 25032219, 13 -15 PENRICE RD NURIOOTPA SA 5355 Reusing comment email and authority from existing record: 25031539 Saving record 25031539, 20A SOUTH AUSTRALIA ONE DR NORTH HAVEN SA 5018 Reusing comment email and authority from existing record: 25009171 Saving record 25009171, LOT 5000 COMMERCIAL RD SEAFORD RISE SA 5169 Reusing comment email and authority from existing record: 25003688 Saving record 25003688, 10 ELINOR TCE GLEN OSMOND SA 5064 Reusing comment email and authority from existing record: 25026313 Saving record 25026313, 45 TREVARRICK RD SPRING GULLY SA 5453 Reusing comment email and authority from existing record: 25014826 Saving record 25014826, 212 MIDWAY RD ELIZABETH DOWNS SA 5113 Reusing comment email and authority from existing record: 25029582 Saving record 25029582, LOT 24 KENNEDY RD STREAKY BAY SA 5680 Reusing comment email and authority from existing record: 25021269 Saving record 25021269, 14992 GOYDER HWY OVERLAND CORNER SA 5330 Reusing comment email and authority from existing record: 25023034 Saving record 25023034, 6 WINDANA MEWS GLANDORE SA 5037 Reusing comment email and authority from existing record: 25030768 Saving record 25030768, 78 PULSFORD RD PROSPECT SA 5082 Reusing comment email and authority from existing record: 25026323 Saving record 25026323, 11 BRAESIDE RD STIRLING SA 5152 Reusing comment email and authority from existing record: 25024758 Saving record 25024758, 10 THIRD AV ST PETERS SA 5069 Reusing comment email and authority from existing record: 25028577 Saving record 25028577, 931 REEDY CREEK RD MOUNT MCINTYRE SA 5279 Reusing comment email and authority from existing record: 25032376 Saving record 25032376, 1303 BAROSSA VALLEY WAY LYNDOCH SA 5351 Reusing comment email and authority from existing record: 25034742 Saving record 25034742, 48 PICK AV MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 25009885 Saving record 25009885, 8 HANCHANT RD PORT LINCOLN SA 5606 Reusing comment email and authority from existing record: 25018635 Saving record 25018635, 12 HIGHLANDS CT WOODFORDE SA 5072 Reusing comment email and authority from existing record: 25031794 Saving record 25031794, LOT 32 GOODWOOD RD PANORAMA SA 5041 Reusing comment email and authority from existing record: 25031172 Saving record 25031172, 1B FIEDLER ST BERRI SA 5343 Reusing comment email and authority from existing record: 25014516 Saving record 25014516, 43 LOWER HERMITAGE RD LOWER HERMITAGE SA 5131 Reusing comment email and authority from existing record: 25032235 Saving record 25032235, 13 -21 WASHINGTON ST ANGASTON SA 5353 Reusing comment email and authority from existing record: 25021936 Saving record 25021936, 36 TWELFTH ST RENMARK SA 5341 Reusing comment email and authority from existing record: 25032021 Saving record 25032021, 25 MOUNT OSMOND RD MOUNT OSMOND SA 5064 Reusing comment email and authority from existing record: 25027514 Saving record 25027514, 11 VASEY RD WAIKERIE SA 5330 Reusing comment email and authority from existing record: 24001439 Saving record 24001439, LOT 22 SAMUELS RD CALLINGTON SA 5254 Reusing comment email and authority from existing record: 25019587 Saving record 25019587, 11 GLENBURNIE TCE PLYMPTON SA 5038 Reusing comment email and authority from existing record: 25035349 Saving record 25035349, 1 BERRIMA RD SHEIDOW PARK SA 5158 Reusing comment email and authority from existing record: 25029837 Saving record 25029837, 13 -15 MCINTYRE RD PARA HILLS WEST SA 5096 Reusing comment email and authority from existing record: 25030598 Saving record 25030598, 66 WARD ST NORTH ADELAIDE SA 5006 Reusing comment email and authority from existing record: 25014828 Saving record 25014828, 108 SOUTH RD TORRENSVILLE SA 5031 Reusing comment email and authority from existing record: 25020523 Saving record 25020523, 2 MICHELE ST NORTH BEACH SA 5556 Reusing comment email and authority from existing record: 24033686 Saving record 24033686, 33 EIGHTH ST GAWLER SOUTH SA 5118 Reusing comment email and authority from existing record: 25030561 Saving record 25030561, 2 LANCASTER AV FULHAM GARDENS SA 5024 Reusing comment email and authority from existing record: 25032184 Saving record 25032184, 3092 EMU FLAT RD SHERWOOD SA 5267 Reusing comment email and authority from existing record: 25030315 Saving record 25030315, 80 ROBERT ST WEST CROYDON SA 5008 Reusing comment email and authority from existing record: 25030545 Saving record 25030545, 56 THIRD AV FORESTVILLE SA 5035 Reusing comment email and authority from existing record: 25025802 Saving record 25025802, 18 BOOTH AV MORPHETT VALE SA 5162 Reusing comment email and authority from existing record: 25025164 Saving record 25025164, LOT 1 CALLINGTON RD CALLINGTON SA 5254 Reusing comment email and authority from existing record: 25031233 Saving record 25031233, 34 STAMFORD ST PARKSIDE SA 5063 Reusing comment email and authority from existing record: 23020152 Saving record 23020152, 405 CRAIGMORE RD ULEYBURY SA 5114 Reusing comment email and authority from existing record: 25030816 Saving record 25030816, 37 OLD KAPUNDA RD NURIOOTPA SA 5355 Reusing comment email and authority from existing record: 25027337 Saving record 25027337, 72 MARY ST UNLEY SA 5061 Reusing comment email and authority from existing record: 25021372 Saving record 25021372, 48 MYALL AV KENSINGTON GARDENS SA 5068 Reusing comment email and authority from existing record: 25022886 Saving record 25022886, 515 MAGILL RD TRANMERE SA 5073 Reusing comment email and authority from existing record: 25027497 Saving record 25027497, 12 BELLEVUE PL UNLEY PARK SA 5061 Reusing comment email and authority from existing record: 25029440 Saving record 25029440, 22A HUGHES ST UNLEY SA 5061 Reusing comment email and authority from existing record: 25022939 Saving record 25022939, 33 RIVERVIEW DR BERRI SA 5343 Reusing comment email and authority from existing record: 25030928 Saving record 25030928, 22 MORNINGTON RD UNLEY SA 5061 Reusing comment email and authority from existing record: 25029283 Saving record 25029283, 32 -34 O'LOUGHLIN TCE CEDUNA SA 5690 Reusing comment email and authority from existing record: 25031634 Saving record 25031634, 15 FLORENCE ST FULLARTON SA 5063 Reusing comment email and authority from existing record: 25028440 Saving record 25028440, 11 MANSTON ST ELIZABETH SOUTH SA 5112 Reusing comment email and authority from existing record: 25021084 Saving record 25021084, 596 THE PARADE AULDANA SA 5072 Reusing comment email and authority from existing record: 25025201 Saving record 25025201, LOT 141 STAMFORD ST PARKSIDE SA 5063 Reusing comment email and authority from existing record: 25029256 Saving record 25029256, LOT 837 EAST TCE KINGSTON SE SA 5275 Reusing comment email and authority from existing record: 25026275 Saving record 25026275, 83 GODFREY TCE ERINDALE SA 5066 Reusing comment email and authority from existing record: 24028929 Saving record 24028929, 22 WAHROONGA AV WATTLE PARK SA 5066 Reusing comment email and authority from existing record: 25004496 Saving record 25004496, 110 -118 ADELAIDE RD MURRAY BRIDGE SA 5253 Reusing comment email and authority from existing record: 25029802 Saving record 25029802, 32 COLLEGE RD KENT TOWN SA 5067 Reusing comment email and authority from existing record: 25021378 Saving record 25021378, 34 GLENEAGLES RD MOUNT OSMOND SA 5064 Reusing comment email and authority from existing record: 25030001 Saving record 25030001, 333 MARION RD NORTH PLYMPTON SA 5037 Reusing comment email and authority from existing record: 25009774 Saving record 25009774, LOT 2 HOG BAY RD BROWN BEACH SA 5222 Reusing comment email and authority from existing record: 25031251 Saving record 25031251, 26 BOSANQUET BVD CEDUNA WATERS SA 5690 First Application data retrieved: {"publicNotificationID"=>12197, "applicationID"=>25032728, "applicationDocumentStorageMetadataID"=>0, "propertyAddress"=>"UNIT 5 344 MILITARY RD LARGS BAY SA 5016", "developmentDescription"=>"Change of use from dwelling to tourist accommodation", "closingDate"=>"12/9/2025 12:00:00 AM", "decisionAuthority"=>"City of Port Adelaide Enfield", "relevantAuthority"=>"City of Port Adelaide Enfield", "locationCouncil"=>"CITY OF PORT ADELAIDE ENFIELD", "notificationChannel"=>"DAP", "publicConsultationUrl"=>"", "applicants"=>[{"interestedPartyId"=>1002599, "applicationId"=>25032728, "contactName"=>"Julian Midwinter ", "address"=>"11 Edith Street Gawler East 5118"}]} Found 113 applications that were already in the database, and added 0 new applications. Added 22.89 seconds total delay over 1 requests so server doesn't complain! Count Authority ----- ------------------ 3 Adelaide Hills Council 2 Alexandrina Council 3 City of Adelaide 11 City of Burnside 1 City of Campbelltown 9 City of Charles Sturt 1 City of Holdfast Bay 3 City of Marion 2 City of Mitcham 3 City of Mt Gambier 5 City of Norwood, Payneham and St. Peters 4 City of Onkaparinga 5 City of Playford 5 City of Port Adelaide Enfield 2 City of Prospect 4 City of Salisbury 1 City of Tea Tree Gully 10 City of Unley 4 City of West Torrens 2 City of Whyalla 1 Clare and Gilbert Valleys Council 1 Copper Coast Council 2 District Council of Ceduna 1 District Council of Cleve 1 District Council of Kingston 1 District Council of Loxton Waikerie 3 District Council of Streaky Bay 1 District Council of Yankalilla 2 Light Regional Council 1 Lower Eyre Council 3 Mount Barker District Council 1 Renmark Paringa Council 1 Rural City of Murray Bridge 4 State Planning Commission 1 Tatiara District Council 4 The Barossa Council 2 The Berri Barmera Council 1 The Corporation of the Town of Walkerville 1 Town of Gawler 1 Wattle Range Council

Data

Downloaded 4105 times by openaustralia mlandauer dcalde jesse-a-reilly repose-lecture tkrikke DevAppProject softgrow odnagroup ianheggie-oaf MichaelBone 93399339 eucodepy seegolovemee tobiasoberrauch Jedwards157

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (25.3 MB) Use the API

rows 10 / 73718

id council_reference address description info_url comment_url date_scraped date_received on_notice_to comment_email comment_authority on_notice_from
1
252/D341/17
Wattle Street Brompton, SA
Boundary Realignment. Torrens Title division. 2 semi-detached dwellings. 1 detached dwelling.
http://www.saplanningportal.sa.gov.au/public_register#view-59720-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-15
2
040/D295/17
17-23 Ashburton Street Blair Athol, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59714-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
3
145/D202/17
Valley View Drive McLaren Vale, SA
1 in to 2 land division
http://www.saplanningportal.sa.gov.au/public_register#view-59712-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
4
170/D195/17
Andrea Avenue Newton, SA
Torrens Title land division. One allotment into three. Existing dwelling to be demolished.
http://www.saplanningportal.sa.gov.au/public_register#view-59628-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
5
170/D196/17
8-10 Gilbert Street NEWTON, SA
1 into 4 Torrens division
http://www.saplanningportal.sa.gov.au/public_register#view-59717-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
6
211/D172/17
37 and 39 Malurus Avenue Lockleys, SA
division of land to create 3 new allotments from the existing two.
http://www.saplanningportal.sa.gov.au/public_register#view-59713-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
7
361/D188/17
19 Uranbo Street Salisbury North, SA
Torrens Land Division. One Allotment into Two Allotments.
http://www.saplanningportal.sa.gov.au/public_register#view-59715-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
8
361/D189/17
7 Gilbert Street Ingle Farm, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59719-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
9
100/D241/17
9 Rosedale Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59699-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12
10
100/D242/17
19 Lawson Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59700-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12

Statistics

Average successful run time: 3 minutes

Total run time: 3 days

Total cpu time used: about 1 hour

Total disk space used: 25.4 MB

History

  • Auto ran revision b38f71b9 and completed successfully .
    113 records added, 113 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    113 records added, 108 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    118 records added, 105 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    116 records added, 116 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    116 records added, 116 records removed, 1 record updated in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

saplanningportal / scraper.rb