planningalerts-scrapers / saplanningportal

South Australia Development Applications - SA Planning Portal

README.md

South Australia (SA) Planning Portal scraper

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

  • Server - .NET
  • Cookie tracking - No
  • Pagnation - Yes
  • Javascript - No
  • Ajax - Yes
  • Clearly defined data within a record - Yes
  • Scrape detail page - No

Enjoy

Contributors LoveMyData MichaelBone mlandauer benrfairless ianheggie-oaf Br3nda

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Using user agent: Ruby/3.2.2 PlanningAlerts scraper for SA Planning Portal/2.0 (https://www.planningalerts.org.au/about) Visiting html page to set cookies: https://plan.sa.gov.au/have_your_say/notified_developments/current_notified_developments ... Delaying for 19.62s to avoid 429 Too Many Requests errors /app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated. Got 200 response from https://cdn.plan.sa.gov.au/public-notifications/getpublicnoticessummary Found 84 applications to process in random order with 15.0...25.0 seconds between requests. Reusing comment email and authority from existing record: 26005334 Saving record 26005334, 1 MONMOUTH RD WESTBOURNE PARK SA 5041 Reusing comment email and authority from existing record: 24040700 Saving record 24040700, 14 TEMPLE CT OTTOWAY SA 5013 Reusing comment email and authority from existing record: 26004631 Saving record 26004631, 1A HERBERT ST NORMANVILLE SA 5204 Reusing comment email and authority from existing record: 25035754 Saving record 25035754, 25 LAURA ST STEPNEY SA 5069 Reusing comment email and authority from existing record: 26002654 Saving record 26002654, 39 RIDGE RD LOBETHAL SA 5241 Reusing comment email and authority from existing record: 26003478 Saving record 26003478, 100 ESPLANADE COFFIN BAY SA 5607 Reusing comment email and authority from existing record: 26006782 Saving record 26006782, 10 ALBERT LANE CUMMINS SA 5631 Reusing comment email and authority from existing record: 26000652 Saving record 26000652, 38 BEADNALL TCE GLENGOWRIE SA 5044 Reusing comment email and authority from existing record: 26005585 Saving record 26005585, 18 HEREFORD AV TRINITY GARDENS SA 5068 Reusing comment email and authority from existing record: 26003462 Saving record 26003462, 21 -31 SHEFFIELD ST WOODVILLE NORTH SA 5012 Reusing comment email and authority from existing record: 26004581 Saving record 26004581, LOT 21 CHARTERIS ST PORT ELLIOT SA 5212 Reusing comment email and authority from existing record: 26002742 Saving record 26002742, 54 MURRAY ST ALBERT PARK SA 5014 Reusing comment email and authority from existing record: 25031879 Saving record 25031879, 355 RANGE RD N UPPER HERMITAGE SA 5131 Reusing comment email and authority from existing record: 26000709 Saving record 26000709, 27 VENABLES ST MACCLESFIELD SA 5153 Reusing comment email and authority from existing record: 26000479 Saving record 26000479, 44 GLEBE DR LITTLEHAMPTON SA 5250 Reusing comment email and authority from existing record: 24040054 Saving record 24040054, 26 ADELAIDE RD TUNGKILLO SA 5236 Reusing comment email and authority from existing record: 26005004 Saving record 26005004, 249 COMMERCIAL ST W MOUNT GAMBIER SA 5290 Reusing comment email and authority from existing record: 26006139 Saving record 26006139, 56 WEMBLEY AV BRIDGEWATER SA 5155 Reusing comment email and authority from existing record: 23034304 Saving record 23034304, East Front Road Reusing comment email and authority from existing record: 25033392 Saving record 25033392, 15 WOODLAND WAY TERINGIE SA 5072 Reusing comment email and authority from existing record: 26000658 Saving record 26000658, 41 MCINTYRE RD WHYALLA BARSON SA 5601 Reusing comment email and authority from existing record: 26004866 Saving record 26004866, 3A ROSELLA AV GLENALTA SA 5052 Reusing comment email and authority from existing record: 25032646 Saving record 25032646, UNIT 1 317 ESPLANADE HENLEY BEACH SA 5022 Reusing comment email and authority from existing record: 25034717 Saving record 25034717, LOT 379 STOCK ROUTE RD POINT PASS SA 5374 Reusing comment email and authority from existing record: 26002211 Saving record 26002211, 596 TORRENS RD WOODVILLE NORTH SA 5012 Reusing comment email and authority from existing record: 25038192 Saving record 25038192, 44 TRUMARA RD MARINO SA 5049 Reusing comment email and authority from existing record: 25040577 Saving record 25040577, 6 VOHR ST JAMESTOWN SA 5491 Reusing comment email and authority from existing record: 26002661 Saving record 26002661, 183 LONGWOOD RD HEATHFIELD SA 5153 Reusing comment email and authority from existing record: 26007001 Saving record 26007001, 846 GRAND JUNCTION RD GILLES PLAINS SA 5086 Reusing comment email and authority from existing record: 25040508 Saving record 25040508, 42 GLEBE DR LITTLEHAMPTON SA 5250 Reusing comment email and authority from existing record: 26002546 Saving record 26002546, 22 LAVINIA ST ATHOL PARK SA 5012 Reusing comment email and authority from existing record: 25011833 Saving record 25011833, 68 WOODLAND WAY TERINGIE SA 5072 Reusing comment email and authority from existing record: 25024151 Saving record 25024151, 18 ROSS ST TORRENSVILLE SA 5031 Reusing comment email and authority from existing record: 25035661 Saving record 25035661, 14 NUNN CT GOLDEN GROVE SA 5125 Reusing comment email and authority from existing record: 26007781 Saving record 26007781, LOT 2 SOUTH TCE SALISBURY SA 5108 Reusing comment email and authority from existing record: 26000097 Saving record 26000097, 32 DUNREATH RD STRATHALBYN SA 5255 Reusing comment email and authority from existing record: 25035081 Saving record 25035081, 34 COKE ST NORWOOD SA 5067 Reusing comment email and authority from existing record: 26000750 Saving record 26000750, 29 PRINCES HWY LITTLEHAMPTON SA 5250 Reusing comment email and authority from existing record: 26004828 Saving record 26004828, 2 WAKEFIELD RD LEASINGHAM SA 5452 Reusing comment email and authority from existing record: 25035111 Saving record 25035111, 347 RIVERVIEW DR BERRI SA 5343 Reusing comment email and authority from existing record: 26005771 Saving record 26005771, 309 ESPLANADE HENLEY BEACH SA 5022 Reusing comment email and authority from existing record: 26004747 Saving record 26004747, 4 ALLANDALE AV GLEN OSMOND SA 5064 Reusing comment email and authority from existing record: 25038853 Saving record 25038853, 40 -44 WATERFALL GULLY RD BURNSIDE SA 5066 Reusing comment email and authority from existing record: 25039151 Saving record 25039151, 30 MALURUS AV LOCKLEYS SA 5032 Reusing comment email and authority from existing record: 25037002 Saving record 25037002, 54 FARROW CCT SEAFORD SA 5169 Reusing comment email and authority from existing record: 26001849 Saving record 26001849, 61 SPRIGG RD CRAFERS SA 5152 Reusing comment email and authority from existing record: 26004901 Saving record 26004901, 353 HULL RD LITTLE DOUGLAS SA 5607 Reusing comment email and authority from existing record: 25035121 Saving record 25035121, 76 FREDERICK ST WELLAND SA 5007 Reusing comment email and authority from existing record: 25028003 Saving record 25028003, 54 MEYER ST TORRENSVILLE SA 5031 Reusing comment email and authority from existing record: 26003100 Saving record 26003100, 25 FOSTER ST PARKSIDE SA 5063 Reusing comment email and authority from existing record: 26001512 Saving record 26001512, 58 DALMORE DR STRATHALBYN SA 5255 Reusing comment email and authority from existing record: 25029444 Saving record 25029444, LOT 692 BUTE RD KADINA SA 5554 Reusing comment email and authority from existing record: 26006871 Saving record 26006871, 25 WHEATON RD STEPNEY SA 5069 Reusing comment email and authority from existing record: 25040629 Saving record 25040629, 94 FIRST AV ST PETERS SA 5069 Reusing comment email and authority from existing record: 25003084 Saving record 25003084, SHOP 1-8 1 -3 KINGFISHER DR HEWETT SA 5118 Reusing comment email and authority from existing record: 25026598 Saving record 25026598, 100 GLYNBURN RD HECTORVILLE SA 5073 Reusing comment email and authority from existing record: 26004843 Saving record 26004843, LOT 200 SUNSET STRP ATHELSTONE SA 5076 Reusing comment email and authority from existing record: 25027980 Saving record 25027980, 71 ALBERT ST PROSPECT SA 5082 Reusing comment email and authority from existing record: 25037337 Saving record 25037337, LOT 42 RESERVE TCE ALDGATE SA 5154 Reusing comment email and authority from existing record: 26003728 Saving record 26003728, 25 THE ANNIE WATT CCT WEST LAKES SHORE SA 5020 Reusing comment email and authority from existing record: 26000491 Saving record 26000491, 480 HEYSEN BVD MOUNT BARKER SA 5251 Reusing comment email and authority from existing record: 26000364 Saving record 26000364, 469 RIVERVIEW DR BERRI SA 5343 Reusing comment email and authority from existing record: 25030115 Saving record 25030115, LOT 84 BLOCKS RD RIVERTON SA 5412 Reusing comment email and authority from existing record: 26005482 Saving record 26005482, 48 SIXTH AV ST PETERS SA 5069 Reusing comment email and authority from existing record: 26006511 Saving record 26006511, 191 -195 TORRENS RD RIDLEYTON SA 5008 Reusing comment email and authority from existing record: 26006316 Saving record 26006316, 445 OLD COACH RD ALDINGA SA 5173 Reusing comment email and authority from existing record: 25038256 Saving record 25038256, 9 WOODSIDE RD NAIRNE SA 5252 Reusing comment email and authority from existing record: 25008932 Saving record 25008932, LOT 71 GULLY RD CAREY GULLY SA 5144 Reusing comment email and authority from existing record: 26004823 Saving record 26004823, 17 FAWCETT ST LITTLEHAMPTON SA 5250 Reusing comment email and authority from existing record: 25034908 Saving record 25034908, LOT 60 ROTHALLS RD CAPE JAFFA SA 5275 Reusing comment email and authority from existing record: 25019356 Saving record 25019356, 19 QUARRY RD WILLUNGA SOUTH SA 5172 Reusing comment email and authority from existing record: 25037907 Saving record 25037907, 15 MATHEWS CCT WOODLANE SA 5254 Reusing comment email and authority from existing record: 26002853 Saving record 26002853, 1 JANE ST SMITHFIELD SA 5114 Reusing comment email and authority from existing record: 26005528 Saving record 26005528, 58 CARLTON PDE TORRENSVILLE SA 5031 Reusing comment email and authority from existing record: 26003810 Saving record 26003810, UNIT 1 60 PORTER ST PARKSIDE SA 5063 Reusing comment email and authority from existing record: 26003581 Saving record 26003581, 2 TONGALLA ST SEAFORD SA 5169 Reusing comment email and authority from existing record: 24040450 Saving record 24040450, 11647 GOYDER HWY MARKARANKA SA 5330 Reusing comment email and authority from existing record: 25038845 Saving record 25038845, 35 UNITY DR SHEIDOW PARK SA 5158 Reusing comment email and authority from existing record: 26005254 Saving record 26005254, 228 -230 ADELAIDE RD MURRAY BRIDGE SA 5253 Reusing comment email and authority from existing record: 26005318 Saving record 26005318, 925 -963 PORT WAKEFIELD RD PARALOWIE SA 5108 Reusing comment email and authority from existing record: 25037703 Saving record 25037703, 47 EDMUND AV UNLEY SA 5061 Reusing comment email and authority from existing record: 26004532 Saving record 26004532, 47 FULLARTON RD KENT TOWN SA 5067 Reusing comment email and authority from existing record: 26002235 Saving record 26002235, 153 TOZER RD WATERLOO CORNER SA 5110 Reusing comment email and authority from existing record: 25036549 Saving record 25036549, 2 WELLINGTON TCE FULLARTON SA 5063 First Application data retrieved: {"publicNotificationID"=>12880, "applicationID"=>25035111, "applicationDocumentStorageMetadataID"=>0, "propertyAddress"=>"347 RIVERVIEW DR BERRI SA 5343", "developmentDescription"=>"Construction of a two storey dwelling", "closingDate"=>"4/22/2026 12:00:00 AM", "decisionAuthority"=>"State Planning Commission", "relevantAuthority"=>"The Berri Barmera Council", "locationCouncil"=>"THE BERRI BARMERA COUNCIL", "notificationChannel"=>"DAP", "publicConsultationUrl"=>"", "applicants"=>[{"interestedPartyId"=>1014778, "applicationId"=>25035111, "contactName"=>"Frank Brennan Consulting Services ", "address"=>"PO Box 96 BEACHPORT 5280"}]} Found 84 applications that were already in the database, and added 0 new applications. Added 19.62 seconds total delay over 1 requests so server doesn't complain! Count Authority ----- ------------------ 8 Adelaide Hills Council 3 Alexandrina Council 2 City of Burnside 2 City of Campbelltown 9 City of Charles Sturt 3 City of Marion 2 City of Mitcham 1 City of Mt Gambier 7 City of Norwood, Payneham and St. Peters 4 City of Onkaparinga 2 City of Playford 1 City of Port Adelaide Enfield 1 City of Prospect 2 City of Salisbury 2 City of Tea Tree Gully 4 City of Unley 4 City of West Torrens 1 City of Whyalla 2 Clare and Gilbert Valleys Council 1 Copper Coast Council 1 District Council of Kingston 1 District Council of Loxton Waikerie 1 District Council of Yankalilla 1 Light Regional Council 3 Lower Eyre Council 2 Mid Murray Council 7 Mount Barker District Council 1 Northern Areas Council 1 Regional Council of Goyder 2 Rural City of Murray Bridge 2 State Planning Commission 1 The Berri Barmera Council

Data

Downloaded 4569 times by openaustralia mlandauer dcalde jesse-a-reilly Manasaanand repose-lecture tkrikke DevAppProject softgrow odnagroup ianheggie-oaf tobiasoberrauch Jedwards157 MichaelBone 93399339 eucodepy seegolovemee

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (25.7 MB) Use the API

rows 10 / 74257

id council_reference address description info_url comment_url date_scraped date_received on_notice_to comment_email comment_authority on_notice_from
1
252/D341/17
Wattle Street Brompton, SA
Boundary Realignment. Torrens Title division. 2 semi-detached dwellings. 1 detached dwelling.
http://www.saplanningportal.sa.gov.au/public_register#view-59720-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-15
2
040/D295/17
17-23 Ashburton Street Blair Athol, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59714-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
3
145/D202/17
Valley View Drive McLaren Vale, SA
1 in to 2 land division
http://www.saplanningportal.sa.gov.au/public_register#view-59712-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
4
170/D195/17
Andrea Avenue Newton, SA
Torrens Title land division. One allotment into three. Existing dwelling to be demolished.
http://www.saplanningportal.sa.gov.au/public_register#view-59628-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
5
170/D196/17
8-10 Gilbert Street NEWTON, SA
1 into 4 Torrens division
http://www.saplanningportal.sa.gov.au/public_register#view-59717-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
6
211/D172/17
37 and 39 Malurus Avenue Lockleys, SA
division of land to create 3 new allotments from the existing two.
http://www.saplanningportal.sa.gov.au/public_register#view-59713-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
7
361/D188/17
19 Uranbo Street Salisbury North, SA
Torrens Land Division. One Allotment into Two Allotments.
http://www.saplanningportal.sa.gov.au/public_register#view-59715-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
8
361/D189/17
7 Gilbert Street Ingle Farm, SA
Land Division
http://www.saplanningportal.sa.gov.au/public_register#view-59719-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-13
9
100/D241/17
9 Rosedale Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59699-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12
10
100/D242/17
19 Lawson Avenue Morphettville, SA
Division of land to create two new Torrens title allotments
http://www.saplanningportal.sa.gov.au/public_register#view-59700-LDE
http://www.saplanningportal.sa.gov.au/public_register
2017-10-17
2017-10-12

Statistics

Average successful run time: 3 minutes

Total run time: 4 days

Total cpu time used: about 1 hour

Total disk space used: 25.8 MB

History

  • Auto ran revision b38f71b9 and completed successfully .
    84 records added, 84 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    84 records added, 73 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    84 records added, 84 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    84 records added, 78 records removed, 1 record updated in the database
  • Auto ran revision b38f71b9 and completed successfully .
    78 records added, 78 records removed, 1 record updated in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

saplanningportal / scraper.rb