planningalerts-scrapers / saplanningportal

South Australia Development Applications - SA Planning Portal

README.md

South Australia (SA) Planning Portal scraper

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

  • Server - .NET
  • Cookie tracking - No
  • Pagnation - Yes
  • Javascript - No
  • Ajax - Yes
  • Clearly defined data within a record - Yes
  • Scrape detail page - No

Enjoy

Contributors LoveMyData MichaelBone mlandauer benrfairless ianheggie-oaf Br3nda

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Using user agent: Ruby/3.2.2 PlanningAlerts scraper for SA Planning Portal/2.0 (https://www.planningalerts.org.au/about) Visiting html page to set cookies: https://plan.sa.gov.au/have_your_say/notified_developments/current_notified_developments ... Delaying for 18.92s to avoid 429 Too Many Requests errors Got 200 response from https://cdn.plan.sa.gov.au/public-notifications/getpublicnoticessummary Found 107 applications to process in random order with 15.0...25.0 seconds between requests. Reusing comment email and authority from existing record: 25036469 Saving record 25036469, 63 MONMOUTH RD WESTBOURNE PARK SA 5041 Reusing comment email and authority from existing record: 26029876 Saving record 26029876, 15 BEASLEY ST MARDEN SA 5070 Reusing comment email and authority from existing record: 26028061 Saving record 26028061, 2A CHAPMAN CR GLEN OSMOND SA 5064 Reusing comment email and authority from existing record: 26029247 Saving record 26029247, 35A FERRERS ST MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 26012140 Saving record 26012140, 12 NETHERBY AV NETHERBY SA 5062 Reusing comment email and authority from existing record: 25032364 Saving record 25032364, 130 RICHMOND AV MELROSE PARK SA 5039 Reusing comment email and authority from existing record: 26031311 Saving record 26031311, LOT 500 NORTH WEST TCE BEACHPORT SA 5280 Reusing comment email and authority from existing record: 26029799 Saving record 26029799, 42 HOLLY RISE HACKHAM WEST SA 5163 Reusing comment email and authority from existing record: 26031546 Saving record 26031546, LOT 13 COPPER COAST HWY SOUTH HUMMOCKS SA 5550 Reusing comment email and authority from existing record: 26027789 Saving record 26027789, 67 DAVENPORT ST ROBE SA 5276 Reusing comment email and authority from existing record: 26029188 Saving record 26029188, 37 WILLIAM ST HAWTHORN SA 5062 Reusing comment email and authority from existing record: 26013778 Saving record 26013778, LOT 2000 HEYSEN BVD MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26030062 Saving record 26030062, LOT 17 MAIN SOUTH RD ALDINGA SA 5173 Reusing comment email and authority from existing record: 26029377 Saving record 26029377, 109 ALMOND GROVE RD WHITES VALLEY SA 5172 Reusing comment email and authority from existing record: 26004305 Saving record 26004305, 8 MATSON TCE VENUS BAY SA 5607 Reusing comment email and authority from existing record: 26030379 Saving record 26030379, 74 HILL ST MITCHAM SA 5062 Reusing comment email and authority from existing record: 26030501 Saving record 26030501, UNIT 1 40 PARNKALLA AV PORT LINCOLN SA 5606 Reusing comment email and authority from existing record: 26001790 Saving record 26001790, 967 SECTUS TANKS RD BARNA SA 5641 Reusing comment email and authority from existing record: 26011184 Saving record 26011184, 234 PORT RD ALBERTON SA 5014 Reusing comment email and authority from existing record: 26028689 Saving record 26028689, 14 ANNESLEY AV TRINITY GARDENS SA 5068 Reusing comment email and authority from existing record: 26027160 Saving record 26027160, 6 MOUNTBATTEN GR WEST BEACH SA 5024 Reusing comment email and authority from existing record: 26025614 Saving record 26025614, 14 DULWICH AV DULWICH SA 5065 Reusing comment email and authority from existing record: 26008896 Saving record 26008896, 91 ALAWOONA AV MITCHELL PARK SA 5043 Reusing comment email and authority from existing record: 26028052 Saving record 26028052, UNIT 1 67 PORTER ST PARKSIDE SA 5063 Reusing comment email and authority from existing record: 26029999 Saving record 26029999, 118 THOMAS RD MASLIN BEACH SA 5170 Reusing comment email and authority from existing record: 26011336 Saving record 26011336, 3201 OLD PRINCES HWY MONARTO SA 5254 Reusing comment email and authority from existing record: 23028686 Saving record 23028686, 7 GREENWOOD CR GLENALTA SA 5052 Reusing comment email and authority from existing record: 26031179 Saving record 26031179, 49 BASKET RANGE RD URAIDLA SA 5142 Reusing comment email and authority from existing record: 26030658 Saving record 26030658, 410 -412 PAYNEHAM RD GLYNDE SA 5070 Reusing comment email and authority from existing record: 26031059 Saving record 26031059, 32 ROSEMARY CT ENCOUNTER BAY SA 5211 Reusing comment email and authority from existing record: 26030365 Saving record 26030365, 20 CHARLICK RD CRAFERS WEST SA 5152 Reusing comment email and authority from existing record: 26028184 Saving record 26028184, 29 MAYFLOWER CR HALLETT COVE SA 5158 Reusing comment email and authority from existing record: 26029311 Saving record 26029311, 36 GROSSER ST MILLICENT SA 5280 Reusing comment email and authority from existing record: 26028961 Saving record 26028961, LOT 1 FARM BEACH RD COULTA SA 5607 Reusing comment email and authority from existing record: 25002250 Saving record 25002250, 383 ALDINGA RD WHITES VALLEY SA 5172 Reusing comment email and authority from existing record: 26029295 Saving record 26029295, 8 STOTT PL STIRLING SA 5152 Reusing comment email and authority from existing record: 26025040 Saving record 26025040, 7 EDWARD ST EVANDALE SA 5069 Reusing comment email and authority from existing record: 26028099 Saving record 26028099, LOT 344 NORTHBRI AV SALISBURY EAST SA 5109 Reusing comment email and authority from existing record: 26024862 Saving record 26024862, 730 -732 PORT WAKEFIELD RD PARAFIELD GARDENS SA 5107 Reusing comment email and authority from existing record: 26016619 Saving record 26016619, 134 CRABB RD LOWER LIGHT SA 5501 Reusing comment email and authority from existing record: 26023536 Saving record 26023536, LOT 3&4 WATERPORT RD HINDMARSH VALLEY SA 5211 Reusing comment email and authority from existing record: 26027966 Saving record 26027966, 17 ALBERT ST DULWICH SA 5065 Reusing comment email and authority from existing record: 26030966 Saving record 26030966, LOT 180 WILKIN RD MURRAY BRIDGE NORTH SA 5253 Reusing comment email and authority from existing record: 26027740 Saving record 26027740, 2 GEORGE ST CEDUNA SA 5690 Reusing comment email and authority from existing record: 26014236 Saving record 26014236, 29 GALWAY AV SEACOMBE HEIGHTS SA 5047 Reusing comment email and authority from existing record: 26007018 Saving record 26007018, 23 WEHL ST S MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 26033131 Saving record 26033131, 16 EDMUND ST NORWOOD SA 5067 Reusing comment email and authority from existing record: 26031631 Saving record 26031631, 72 KINGSTON RD KINGSTON ON MURRAY SA 5331 Reusing comment email and authority from existing record: 26013171 Saving record 26013171, 248 CALIFORNIA RD TATACHILLA SA 5171 Reusing comment email and authority from existing record: 26028876 Saving record 26028876, 1 OSBORNE RD NORTH HAVEN SA 5018 Reusing comment email and authority from existing record: 26012596 Saving record 26012596, 285 ESPLANADE HENLEY BEACH SA 5022 Reusing comment email and authority from existing record: 26025455 Saving record 26025455, 38 FLINDERS ST KENT TOWN SA 5067 Reusing comment email and authority from existing record: 26018268 Saving record 26018268, 8 PINKS BEACH RD PINKS BEACH SA 5275 Reusing comment email and authority from existing record: 26026709 Saving record 26026709, 478 USHER RD GIFFORD HILL SA 5253 Reusing comment email and authority from existing record: 26019171 Saving record 26019171, 3 CIRCUIT DR HENDON SA 5014 Reusing comment email and authority from existing record: 25014614 Saving record 25014614, 804 MOUNT BARKER RD VERDUN SA 5245 Reusing comment email and authority from existing record: 26005269 Saving record 26005269, 277 SPRINGHEAD RD MOUNT TORRENS SA 5244 Reusing comment email and authority from existing record: 26029573 Saving record 26029573, 344 WATERLOO RD WATERLOO SA 5413 Reusing comment email and authority from existing record: 26019612 Saving record 26019612, 97 PRESSER RD TANUNDA SA 5352 Reusing comment email and authority from existing record: 26026807 Saving record 26026807, LOT 514 PENRICE RD NURIOOTPA SA 5355 Reusing comment email and authority from existing record: 26028539 Saving record 26028539, 118 THOMAS RD MASLIN BEACH SA 5170 Reusing comment email and authority from existing record: 25030958 Saving record 25030958, 112 BAKEWELL DR MCLAREN VALE SA 5171 Reusing comment email and authority from existing record: 25031450 Saving record 25031450, LOT 23 HEYSEN BVD MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26031026 Saving record 26031026, UNIT 1-3 500 CHURCHILL RD KILBURN SA 5084 Reusing comment email and authority from existing record: 26029932 Saving record 26029932, 33 MUIRKIRK ST JAMESTOWN SA 5491 Reusing comment email and authority from existing record: 26014029 Saving record 26014029, 33 CUTTING CT WORROLONG SA 5291 Reusing comment email and authority from existing record: 26027825 Saving record 26027825, 214 -216 STURT ST ADELAIDE SA 5000 Reusing comment email and authority from existing record: 26025716 Saving record 26025716, 525 WINTON RD GUMERACHA SA 5233 Reusing comment email and authority from existing record: 26001776 Saving record 26001776, 4004 COWELL-KIMBA RD MILTALIE SA 5602 Reusing comment email and authority from existing record: 26000032 Saving record 26000032, 398 MOUNT BARKER RD BRIDGEWATER SA 5155 Reusing comment email and authority from existing record: 26026940 Saving record 26026940, UNIT 2 52A LEICESTER ST PARKSIDE SA 5063 Reusing comment email and authority from existing record: 26030816 Saving record 26030816, LOT 100 RICHARDSON PL ROXBY DOWNS SA 5725 Reusing comment email and authority from existing record: 26030871 Saving record 26030871, 14 RICHARD CT HINDMARSH ISLAND SA 5214 Reusing comment email and authority from existing record: 26024894 Saving record 26024894, 3680 OLD PRINCES HWY MONARTO SOUTH SA 5254 Reusing comment email and authority from existing record: 26027305 Saving record 26027305, 54 GLENWOOD DR BELLEVUE HEIGHTS SA 5050 Reusing comment email and authority from existing record: 26022693 Saving record 26022693, 2223 MAITLAND RD ARDROSSAN SA 5571 Reusing comment email and authority from existing record: 26028085 Saving record 26028085, 39 ADDISON RD PENNINGTON SA 5013 Reusing comment email and authority from existing record: 26028267 Saving record 26028267, 21 TRIMMER TCE UNLEY SA 5061 Reusing comment email and authority from existing record: 26028259 Saving record 26028259, 11 CLARKE RD OB FLAT SA 5291 Reusing comment email and authority from existing record: 26013047 Saving record 26013047, LOT 128 CASSINI RD CASSINI SA 5223 Reusing comment email and authority from existing record: 26011733 Saving record 26011733, 360 OLD NORTON SUMMIT RD HORSNELL GULLY SA 5141 Reusing comment email and authority from existing record: 26003412 Saving record 26003412, 131 CROSS RD HAWTHORN SA 5062 Reusing comment email and authority from existing record: 26025565 Saving record 26025565, 46 GELTWOOD DR BEACHPORT SA 5280 Reusing comment email and authority from existing record: 26026409 Saving record 26026409, 32 ARTHUR ST SEACLIFF PARK SA 5049 Reusing comment email and authority from existing record: 26028377 Saving record 26028377, 14 WEST TCE COWELL SA 5602 Reusing comment email and authority from existing record: 26027610 Saving record 26027610, 2 MANRESA CT ATHELSTONE SA 5076 Reusing comment email and authority from existing record: 26031405 Saving record 26031405, 16 SIDDALL RD ELIZABETH VALE SA 5112 Reusing comment email and authority from existing record: 26025773 Saving record 26025773, 77 PALMER PL NORTH ADELAIDE SA 5006 Reusing comment email and authority from existing record: 26022695 Saving record 26022695, 23 PONY RIDGE RD BELAIR SA 5052 Reusing comment email and authority from existing record: 26030568 Saving record 26030568, LOT 100 NAUTILUS RD ELIZABETH EAST SA 5112 Reusing comment email and authority from existing record: 26016582 Saving record 26016582, 10 FRY LANE FOREST RANGE SA 5139 Reusing comment email and authority from existing record: 26014319 Saving record 26014319, 7 YALANDA ST EDEN HILLS SA 5050 Reusing comment email and authority from existing record: 26031560 Saving record 26031560, 134 -144 NELSON RD PARA VISTA SA 5093 Reusing comment email and authority from existing record: 26030467 Saving record 26030467, 2 -10 SURREY FARM DR GOLDEN GROVE SA 5125 Reusing comment email and authority from existing record: 23026239 Saving record 23026239, 63 ONTARIO ST RENMARK WEST SA 5341 Reusing comment email and authority from existing record: 26030665 Saving record 26030665, 14 SCOTT ST BEULAH PARK SA 5067 Reusing comment email and authority from existing record: 26028627 Saving record 26028627, 21 JENNIFER AV RIDGEHAVEN SA 5097 Reusing comment email and authority from existing record: 26026834 Saving record 26026834, 21 LASCELLES AV BEAUMONT SA 5066 Reusing comment email and authority from existing record: 26031988 Saving record 26031988, 10 CLARK ST WAYVILLE SA 5034 Reusing comment email and authority from existing record: 26026985 Saving record 26026985, LOT 11 MEMFORD WAY FLAGSTAFF HILL SA 5159 Reusing comment email and authority from existing record: 26031003 Saving record 26031003, 92 GOLD COAST DR CARRICKALINGA SA 5204 Reusing comment email and authority from existing record: 26009829 Saving record 26009829, 4 ANTHONY ST MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 26029014 Saving record 26029014, 100 CHURCHETT RD PARACOMBE SA 5132 Reusing comment email and authority from existing record: 26027497 Saving record 26027497, 36 NEPEAN ESP NEPEAN BAY SA 5223 Reusing comment email and authority from existing record: 26001778 Saving record 26001778, 2777 COWELL-KIMBA RD MILTALIE SA 5602 Reusing comment email and authority from existing record: 26030236 Saving record 26030236, 8 CEDAR AV UNLEY PARK SA 5061 Reusing comment email and authority from existing record: 26028979 Saving record 26028979, 13 WINDERMERE AV NOVAR GARDENS SA 5040 First Application data retrieved: {"publicNotificationID"=>14162, "applicationID"=>23026239, "applicationDocumentStorageMetadataID"=>0, "propertyAddress"=>"63 ONTARIO ST RENMARK WEST SA 5341", "developmentDescription"=>"Land Division (1-into-30 residential allotments and associated road and infrastructure).", "closingDate"=>"11/12/2026 12:00:00 AM", "decisionAuthority"=>"State Planning Commission", "relevantAuthority"=>"Renmark Paringa Council", "locationCouncil"=>"Renmark Paringa", "notificationChannel"=>"DAP", "publicConsultationUrl"=>"", "applicants"=>[{"interestedPartyId"=>558908, "applicationId"=>23026239, "contactName"=>"Craig Patty ", "address"=>"63 ONTARIO STREET RENMARK WEST 5341"}]} Found 107 applications that were already in the database, and added 0 new applications. Added 18.92 seconds total delay over 1 requests so server doesn't complain! Count Authority ----- ------------------ 9 Adelaide Hills Council 1 Adelaide Plains Council 1 Alexandrina Council 1 Barunga West Council 2 City of Adelaide 5 City of Burnside 1 City of Campbelltown 3 City of Charles Sturt 1 City of Holdfast Bay 2 City of Marion 10 City of Mitcham 3 City of Mt Gambier 6 City of Norwood, Payneham and St. Peters 9 City of Onkaparinga 2 City of Playford 3 City of Port Adelaide Enfield 1 City of Port Lincoln 3 City of Salisbury 3 City of Tea Tree Gully 5 City of Unley 1 City of Victor Harbor 2 City of West Torrens 1 Clare and Gilbert Valleys Council 1 District Council of Ceduna 1 District Council of Elliston 3 District Council of Franklin Harbour 1 District Council of Kimba 1 District Council of Loxton Waikerie 1 District Council of Robe 1 District Council of Yankalilla 1 Kangaroo Island Council 1 Light Regional Council 2 Mount Barker District Council 1 Municipal Council of Roxby Downs 1 Northern Areas Council 4 Rural City of Murray Bridge 2 Southern Limestone Coast Council 6 State Planning Commission 1 The Barossa Council 3 Wattle Range Council 1 Yorke Peninsula Council

Data

Downloaded 5086 times by openaustralia mlandauer dcalde jesse-a-reilly Manasaanand tkrikke repose-lecture AthleticoPrawn DevAppProject softgrow qs4v8thvrq-boop odnagroup ianheggie-oaf 538digital MichaelBone 93399339 eucodepy seegolovemee tobiasoberrauch Jedwards157

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (26.4 MB) Use the API

rows 10 / 75272

id council_reference address description info_url comment_url date_scraped date_received on_notice_to comment_email comment_authority on_notice_from
1
252/D341/17
Wattle Street Brompton, SA
Boundary Realignment. Torrens Title division. 2 semi-detached dwellings. 1 detached dwelling.
http://www.saplanningportal.sa.gov.au/public_register#view-59720-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-15
2
040/D295/17
17-23 Ashburton Street Blair Athol, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59714-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
3
145/D202/17
Valley View Drive McLaren Vale, SA
1 in to 2 land division
http://www.saplanningportal.sa.gov.au/public_register#view-59712-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
4
170/D195/17
Andrea Avenue Newton, SA
Torrens Title land division. One allotment into three. Existing dwelling to be demolished.
http://www.saplanningportal.sa.gov.au/public_register#view-59628-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
5
170/D196/17
8-10 Gilbert Street NEWTON, SA
1 into 4 Torrens division
http://www.saplanningportal.sa.gov.au/public_register#view-59717-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
6
211/D172/17
37 and 39 Malurus Avenue Lockleys, SA
division of land to create 3 new allotments from the existing two.
http://www.saplanningportal.sa.gov.au/public_register#view-59713-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
7
361/D188/17
19 Uranbo Street Salisbury North, SA
Torrens Land Division. One Allotment into Two Allotments.
http://www.saplanningportal.sa.gov.au/public_register#view-59715-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
8
361/D189/17
7 Gilbert Street Ingle Farm, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59719-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
9
100/D241/17
9 Rosedale Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59699-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12
10
100/D242/17
19 Lawson Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59700-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12

Statistics

Average successful run time: 3 minutes

Total run time: 4 days

Total cpu time used: about 1 hour

Total disk space used: 26.5 MB

History

  • Auto ran revision 5a25f2a3 and completed successfully .
    107 records added, 107 records removed, 1 record updated in the database
  • Auto ran revision 5a25f2a3 and completed successfully .
    107 records added, 107 records removed, 1 record updated in the database
  • Auto ran revision 5a25f2a3 and completed successfully .
    107 records added, 99 records removed, 1 record updated in the database
  • Auto ran revision 5a25f2a3 and completed successfully .
    109 records added, 109 records removed, 1 record updated in the database
  • Auto ran revision 5a25f2a3 and completed successfully .
    109 records added, 97 records removed, 1 record updated in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

saplanningportal / scraper.rb