ianheggie-oaf / joondalup
City of Joondalup Open Development Applications
City of Joondalup - Open Development Applications Scraper
- Cookie tracking - No
- Pagnation - yes, via a flag in the HTML returned in the JSON data
- JavaScript - Yes, but we don't need to execute it, instead call the api directly
- Clearly defined data within a row - No, data is in HTML in a JSON record, and reference in the details page
- System - custom
This is a scraper that runs on Morph. To get started see the documentation
Add any issues to https://github.com/planningalerts-scrapers/issues/issues
To run the scraper
bundle exec ruby scraper.rb
Expected output
Getting initial page
Pausing 1.023s
Getting page 1
/home/ianh/.local/share/mise/installs/ruby/3.2.2/lib/ruby/gems/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated.
Fetching detail page: https://www.joondalup.wa.gov.au/community-and-spaces/community-consultation/31b-strathyre-drive,-duncraig-–-single-house-(additions)
Extracted DA25/0869 from detail page
Saving record DA25/0869 - 31B Strathyre Drive, Duncraig, WA
...
Fetching detail page: https://www.joondalup.wa.gov.au/community-and-spaces/community-consultation/51a-conidae-drive,-heathridge-–-grouped-dwelling-(new-dwelling)
Extracted DA25/0774 from detail page
Saving record DA25/0774 - 51A Conidae Drive, Heathridge, WA
Deleting 0 applications scraped between and 2025-12-28
Running VACUUM to reclaim space...
Finished! Added 12 applications, and skipped 0 unprocessable applications from 1 pages.
Execution time: ~ 11 seconds
To run style and coding checks
bundle exec rubocop
To check for security updates
gem install bundler-audit
bundle-audit
Contributors
Last run completed successfully
.
Console output of last run
Injecting configuration and compiling...
Injecting scraper and running...
Getting initial page
Pausing 2.175s
Getting page 1
/app/vendor/bundle/ruby/3.2.0/gems/mechanize-2.8.5/lib/mechanize/pluggable_parsers.rb:107:in `new': MIME::Type.MIME::Type.new when called with a String is deprecated.
Fetching detail page: https://www.joondalup.wa.gov.au/community-and-spaces/community-consultation/31b-strathyre-drive,-duncraig-–-single-house-(additions)
Extracted DA25/0869 from detail page
Saving record DA25/0869 - 31B Strathyre Drive, Duncraig, WA
Fetching detail page: https://www.joondalup.wa.gov.au/community-and-spaces/community-consultation/12-seger-street,-burns-beach-–-single-house-(new-two-storey-dwelling)
Extracted DA25/0836 from detail page
Saving record DA25/0836 - 12 Seger Street, Burns Beach, WA
Fetching detail page: https://www.joondalup.wa.gov.au/community-and-spaces/community-consultation/98-o’mara-boulevard,-iluka-–-application-for-modifications-to-previously-approved-development
Extracted DA18/1336.02 from detail page
Saving record DA18/1336.02 - 98 O’Mara Boulevard, Iluka, WA
Fetching detail page: https://www.joondalup.wa.gov.au/community-and-spaces/community-consultation/8b-frobisher-avenue,-sorrento-–-single-house-(new-two-storey-dwelling)
Extracted DA25/0797 from detail page
Saving record DA25/0797 - 8B Frobisher Avenue, Sorrento, WA
Fetching detail page: https://www.joondalup.wa.gov.au/community-and-spaces/community-consultation/26a-woodland-loop,-edgewater-–-grouped-dwelling-(additions)
Extracted DA25/0966 from detail page
Saving record DA25/0966 - 26A Woodland Loop, Edgewater, WA
Fetching detail page: https://www.joondalup.wa.gov.au/community-and-spaces/community-consultation/6-pompano-court,-heathridge-–-single-house-(additions)
Extracted DA25/0858 from detail page
Saving record DA25/0858 - 6 Pompano Court, Heathridge, WA
Fetching detail page: https://www.joondalup.wa.gov.au/community-and-spaces/community-consultation/69-st-helier-drive,-sorrento-–-single-house-(outbuilding-addition)
Extracted DA25/0904 from detail page
Saving record DA25/0904 - 69 St Helier Drive, Sorrento, WA
Fetching detail page: https://www.joondalup.wa.gov.au/community-and-spaces/community-consultation/16-manito-court,-joondalup-grouped-dwellings-(two-new-single-storey-dwellings)
Extracted DA25/0789 from detail page
Saving record DA25/0789 - 16 Manito Court, Joondalup, WA
Fetching detail page: https://www.joondalup.wa.gov.au/community-and-spaces/community-consultation/5-foston-drive,-duncraig-–-grouped-dwelling-(new-two-storey-dwelling)
Extracted DA25/0761 from detail page
Saving record DA25/0761 - 5 Foston Drive, Duncraig, WA
Fetching detail page: https://www.joondalup.wa.gov.au/community-and-spaces/community-consultation/20-balga-way,-mullaloo-–-single-house-(new-two-storey-dwelling)
Extracted DA25/0963 from detail page
Saving record DA25/0963 - 20 Balga Way, Mullaloo, WA
Finished! Added 10 applications, and skipped 0 unprocessable applications from 1 pages.
Data
Downloaded
901 times
by
To download data sign in with GitHub
rows 10 / 10
| council_reference | address | description | info_url | date_scraped | on_notice_from | on_notice_to |
|---|---|---|---|---|---|---|
|
DA25/0869
|
31B Strathyre Drive, Duncraig, WA
|
Single house (additions)
|
https://www.joondalup.wa.gov.au/community-and-spaces/community-consultation/31b-strathyre-drive,-duncraig-–-single-house-(additions)
|
2026-02-01
|
2026-01-27
|
2026-02-10
|
|
DA25/0836
|
12 Seger Street, Burns Beach, WA
|
Single house (new two storey dwelling)
|
https://www.joondalup.wa.gov.au/community-and-spaces/community-consultation/12-seger-street,-burns-beach-–-single-house-(new-two-storey-dwelling)
|
2026-02-01
|
2026-01-27
|
2026-02-10
|
|
DA18/1336.02
|
98 O’Mara Boulevard, Iluka, WA
|
Application for modifications to previously approved development
|
https://www.joondalup.wa.gov.au/community-and-spaces/community-consultation/98-o’mara-boulevard,-iluka-–-application-for-modifications-to-previously-approved-development
|
2026-02-01
|
2026-01-27
|
2026-02-10
|
|
DA25/0797
|
8B Frobisher Avenue, Sorrento, WA
|
Single house (new two storey dwelling)
|
https://www.joondalup.wa.gov.au/community-and-spaces/community-consultation/8b-frobisher-avenue,-sorrento-–-single-house-(new-two-storey-dwelling)
|
2026-02-01
|
2026-01-23
|
2026-02-06
|
|
DA25/0966
|
26A Woodland Loop, Edgewater, WA
|
Grouped dwelling (additions)
|
https://www.joondalup.wa.gov.au/community-and-spaces/community-consultation/26a-woodland-loop,-edgewater-–-grouped-dwelling-(additions)
|
2026-02-01
|
2026-01-21
|
2026-02-04
|
|
DA25/0858
|
6 Pompano Court, Heathridge, WA
|
Single house (additions)
|
https://www.joondalup.wa.gov.au/community-and-spaces/community-consultation/6-pompano-court,-heathridge-–-single-house-(additions)
|
2026-02-01
|
2026-01-19
|
2026-02-02
|
|
DA25/0904
|
69 St Helier Drive, Sorrento, WA
|
Single house (outbuilding addition)
|
https://www.joondalup.wa.gov.au/community-and-spaces/community-consultation/69-st-helier-drive,-sorrento-–-single-house-(outbuilding-addition)
|
2026-02-01
|
2026-01-19
|
2026-02-02
|
|
DA25/0789
|
16 Manito Court, Joondalup, WA
|
Grouped dwellings (two new single-storey dwellings)
|
2026-02-01
|
2026-01-19
|
2026-02-02
|
|
|
DA25/0761
|
5 Foston Drive, Duncraig, WA
|
Grouped dwelling (new two storey dwelling)
|
https://www.joondalup.wa.gov.au/community-and-spaces/community-consultation/5-foston-drive,-duncraig-–-grouped-dwelling-(new-two-storey-dwelling)
|
2026-02-01
|
2026-01-19
|
2026-02-02
|
|
DA25/0963
|
20 Balga Way, Mullaloo, WA
|
Single house (new two storey dwelling)
|
https://www.joondalup.wa.gov.au/community-and-spaces/community-consultation/20-balga-way,-mullaloo-–-single-house-(new-two-storey-dwelling)
|
2026-02-01
|
2026-01-30
|
2026-02-13
|
Statistics
Average successful run time: less than 10 seconds
Total run time: less than 20 seconds
Total cpu time used: less than 5 seconds
Total disk space used: 47 KB