ianheggie-oaf / clarence_valley

Clarence Valley Council NSW Advertised DAs Scraper

README.md

Clarence Valley Council NSW Advertised DAs Scraper

approx pop 62K

  • Cookie tracking - No
  • Pagnation - maybe, but we don't have an example to code for
  • Javascript - No
  • Clearly defined data within a row - Yes
  • System - Powered by Granicus

This is a scraper that runs on Morph. To get started see the documentation

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

To run the scraper

bundle exec ruby scraper.rb

Expected output

Getting advertised DAs page
Saving record DA2025/0572 - 115 River Street, Maclean 2463, NSW
...
Saving record DA2026/0004 - 208 Bacon Street, Grafton 2460, NSW
Deleting 0 applications scraped between  and 2025-12-29
  Running VACUUM to reclaim space...
Added 7 records, and skipped 0 unprocessable records.
Found pagination: Page 1 of 1
Finished!

Execution time: ~ 2 seconds

To run style and coding checks

bundle exec rubocop

To check for security updates

gem install bundler-audit
bundle-audit

Contributors ianheggie-oaf

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Getting advertised DAs page Saving record DA2026/0348 - 256 Watts Lane, Harwood 2465, NSW Saving record DA2026/0474 - 383 North Street, Wooli 2462, NSW Saving record DA2026/0448 - 3A Church Street, Maclean 2463, NSW Saving record DA2026/0473 - 1 Gillies Lane, Palmers Island 2463, NSW Added 4 records, and skipped 0 unprocessable records. Found pagination: Page 1 of 1 Finished!

Data

Downloaded 25106 times by ianheggie-oaf tkrikke

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (16 KB) Use the API

rows 6 / 6

council_reference address description info_url date_scraped
SUB2026/0020
Iona Close, Maclean 2463, NSW
20 Lot subdivision, earthworks and retaining walls
https://www.clarence.nsw.gov.au/Building-and-planning/Development-applications/Advertised-DAs/SUB20260020-Iona-Close-MACLEAN
2026-10-24
MOD2026/0088
48 River Street, Maclean 2463, NSW
Modification of DA2023/0300 - amend building design and materials
https://www.clarence.nsw.gov.au/Building-and-planning/Development-applications/Advertised-DAs/MOD20260088-48-River-Street-Maclean
2026-11-02
DA2026/0348
256 Watts Lane, Harwood 2465, NSW
Dwelling and earthworks
https://www.clarence.nsw.gov.au/Building-and-planning/Development-applications/Advertised-DAs/DA20260348-256-Watts-Lane-HARWOOD
2026-11-09
DA2026/0474
383 North Street, Wooli 2462, NSW
Reconfigure caravan park layout
https://www.clarence.nsw.gov.au/Building-and-planning/Development-applications/Advertised-DAs/DA20260474-383-North-Street-WOOLI
2026-11-09
DA2026/0448
3A Church Street, Maclean 2463, NSW
18 Residential Dwellings, including 2 x Affordable Housing Dwellings and 3 x Residential Flat Buildings containing 16 Dwellings. Demolition of tennis court and shed, Earthworks and retaining walls
https://www.clarence.nsw.gov.au/Building-and-planning/Development-applications/Advertised-DAs/DA20260448-3A-Church-Street-Maclean
2026-11-09
DA2026/0473
1 Gillies Lane, Palmers Island 2463, NSW
Demolition of existing buildings and construction of new dwelling
https://www.clarence.nsw.gov.au/Building-and-planning/Development-applications/Advertised-DAs/DA20260473-1-Gillies-Lane-PALMERS-ISLAND-NSW-2463
2026-11-09

Statistics

Average successful run time: less than 5 seconds

Total run time: 19 minutes

Total cpu time used: 5 minutes

Total disk space used: 46.4 KB

History

  • Auto ran revision 0e2840b4 and completed successfully .
    4 records added, 4 records removed in the database
  • Auto ran revision 0e2840b4 and completed successfully .
    4 records added, 4 records removed in the database
  • Auto ran revision 0e2840b4 and completed successfully .
    4 records added, 4 records removed in the database
  • Auto ran revision 0e2840b4 and completed successfully .
    4 records added, 4 records removed in the database
  • Auto ran revision 0e2840b4 and completed successfully .
    4 records added, 4 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

clarence_valley / scraper.rb