markdon / KingboroughCouncilDA

Kingborough Council Development Applications


Kingborough Council Scraper

  • Server - Unknown
  • Cookie tracking - No
  • Pagnation - No
  • Javascript - No
  • Clearly defined data within a row - Yes

Local Development

Prerequisites

  • Node 16 - BEWARE the old version, this is what's supported on morph.io. See nvm if you need to be able to switch between versions.
    • OPTIONAL: The ./devcontainer directory contains config for running a Node 16 Dev Container. See https://code.visualstudio.com/docs/devcontainers/containers
  • Visual Studio Code - Highly recommended as your editor for build in type checking.

Getting Started

In a terminal, run the following commands: npm install npm run dev This will run the scraper whenever you save a change to a file.

Edit the .ts files in the src directory to make changes. These are TypeScript files that are "compiled" to JavaScript files in the build directory.

Commiting

Ensure you have run npm run dev or npm run tsc before commiting and include the contents of ./build.

morph.io runs the built javascript, not typescript files.

Contributors henare markdon 43South jamezpolley LoveMyData mlandauer

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... createQuery: CREATE TABLE IF NOT EXISTS data (council_reference TEXT PRIMARY KEY, address TEXT, description TEXT, info_url TEXT, comment_url TEXT, date_scraped TEXT, on_notice_from TEXT, on_notice_to TEXT, documents TEXT) (node:19) Warning: Setting the NODE_TLS_REJECT_UNAUTHORIZED environment variable to '0' makes TLS connections and HTTPS requests insecure by disabling certificate verification. (Use `node --trace-warnings ...` to show where the warning was created) [ { council_reference: 'DA-2024-87', address: '629 Nicholls Rivulet Road, Oyster Cove, Tasmania', description: 'Dwelling, ancillary dwelling and associated works', info_url: 'https://www.kingborough.tas.gov.au/development/planning-notices/', comment_url: 'mailto:kc@kingborough.tas.gov.au', date_scraped: '2024-12-25', on_notice_from: '2024-12-18', on_notice_to: '2025-01-10', documents: '["https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA-2024-87-00-629-Nicholls-Rivulet-Road-Oyster-Cove.pdf","https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA-2024-87-01-Natural-Values-Assessment.pdf","https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA-2024-87-02-Bushfire-Hazard-Report.pdf","https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA-2024-87-03-Arborist-Report.pdf","https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA-2024-87-04-Geo-Environmental-Assessment.pdf"]' }, { council_reference: 'DA-2024-248', address: '3027 Channel Highway, Kettering and adjoining Channel Highway road reserve, Kettering, Tasmania', description: 'Dwelling and associated works', info_url: 'https://www.kingborough.tas.gov.au/development/planning-notices/', comment_url: 'mailto:kc@kingborough.tas.gov.au', date_scraped: '2024-12-25', on_notice_from: '2024-12-18', on_notice_to: '2025-01-10', documents: '["https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA-2024-248-00-3027-Channel-Highway-Kettering.pdf","https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA-2024-248-01-Stormwater-Assessment.pdf","https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA-2024-248-02-On-Site-Wastewater-Assessment.pdf"]' }, { council_reference: 'DA-2024-366', address: '27 View Street, Blackmans Bay, Tasmania', description: 'Demolition of existing dwelling and construction of new dwelling', info_url: 'https://www.kingborough.tas.gov.au/development/planning-notices/', comment_url: 'mailto:kc@kingborough.tas.gov.au', date_scraped: '2024-12-25', on_notice_from: '2024-12-18', on_notice_to: '2025-01-10', documents: '["https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA-2024-366-27-View-Street-Blackmans-Bay.pdf"]' }, { council_reference: 'DA-2024-127', address: '3856 Bruny Island Main Road, Alonnah, Tasmania', description: 'Dwelling, outbuilding (shed/garage), and associated works', info_url: 'https://www.kingborough.tas.gov.au/development/planning-notices/', comment_url: 'mailto:kc@kingborough.tas.gov.au', date_scraped: '2024-12-25', on_notice_from: '2024-12-18', on_notice_to: '2025-01-10', documents: '["https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA-2024-127-00-3856-Bruny-Island-Main-Road-Alonnah.pdf","https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA-2024-127-01-Natural-Values-Report.pdf","https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA-2024-127-02-Bushfire-Hazard-Assessment.pdf","https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA-2024-127-03-Arborist-Assessment-1.pdf","https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA-2024-127-04-Site-Soil-Evaluation-and-Design-Report.pdf"]' }, { council_reference: 'DA-2024-375', address: '4 Weedings Way, Woodbridge, Tasmania', description: 'Outbuilding (shed)', info_url: 'https://www.kingborough.tas.gov.au/development/planning-notices/', comment_url: 'mailto:kc@kingborough.tas.gov.au', date_scraped: '2024-12-25', on_notice_from: '2024-12-18', on_notice_to: '2025-01-10', documents: '["https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA-2024-375-4-Weedings-Way-Woodbridge.pdf"]' }, { council_reference: 'DA-2024-249', address: '21 Norwood Avenue, Taroona, Tasmania', description: 'Dwelling and ancillary dwelling', info_url: 'https://www.kingborough.tas.gov.au/development/planning-notices/', comment_url: 'mailto:kc@kingborough.tas.gov.au', date_scraped: '2024-12-25', on_notice_from: '2024-12-14', on_notice_to: '2025-01-08', documents: '["https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA-2024-249-21-Norwood-Avenue-Taroona.pdf"]' }, { council_reference: 'DA-2024-339', address: '50 Delta Avenue, Taroona, Tasmania', description: 'Outbuilding (garage)', info_url: 'https://www.kingborough.tas.gov.au/development/planning-notices/', comment_url: 'mailto:kc@kingborough.tas.gov.au', date_scraped: '2024-12-25', on_notice_from: '2024-12-14', on_notice_to: '2025-01-08', documents: '["https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA-2024-339-00-50-Delta-Avenue-Taroona.pdf","https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA-2024-339-01-Bushfire-Hazard-Report.pdf"]' }, { council_reference: 'DA-2024-281', address: '2 Diamond Drive, Blackmans Bay, Tasmania', description: 'Extension and alterations to dwelling', info_url: 'https://www.kingborough.tas.gov.au/development/planning-notices/', comment_url: 'mailto:kc@kingborough.tas.gov.au', date_scraped: '2024-12-25', on_notice_from: '2024-12-14', on_notice_to: '2025-01-08', documents: '["https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA-2024-281-2-Diamond-Drive-Blackmans-Bay.pdf"]' }, { council_reference: 'DA-2024-171', address: "Council, Crown and Private land from Channel Highway to Miandetta Drive, Margate, including untitled land, road reserve and CT's, Tasmania", description: 'Stage 2 Northwest Bay River Multi-User Trail and associated works, including understorey clearance and minor earthworks', info_url: 'https://www.kingborough.tas.gov.au/development/planning-notices/', comment_url: 'mailto:kc@kingborough.tas.gov.au', date_scraped: '2024-12-25', on_notice_from: '2024-12-14', on_notice_to: '2025-01-08', documents: '["https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA-2024-171-00-Council-Crown-and-Private-land-from-Channel-Highway-to-Miandetta-Drive-Margate.pdf","https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA2024-171-01-Submission-Report.pdf","https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA2024-171-02-Natural-Values-Report-Environmental-Management-Plan.pdf","https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA2024-171-03-Arboricultural-Impact-Assessment.pdf","https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA2024-171-04-Threatened-Raptor-and-Swift-Parrot-Survey-Report.pdf"]' }, { council_reference: 'DA-2024-374', address: '25A Selby Road, Kettering, Tasmania', description: 'Dwelling', info_url: 'https://www.kingborough.tas.gov.au/development/planning-notices/', comment_url: 'mailto:kc@kingborough.tas.gov.au', date_scraped: '2024-12-25', on_notice_from: '2024-12-14', on_notice_to: '2025-01-08', documents: '["https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA-2024-374-00-25A-Selby-Road-Kettering.pdf","https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA-2024-374-01-On-Site-Wastewater-Report.pdf"]' }, { council_reference: 'DA-2024-117', address: 'Lot 1/347, 349 & 351 Simpsons Bay Road, Simpsons Bay, Tasmania', description: 'Change of use, outbuilding (shed), and access works', info_url: 'https://www.kingborough.tas.gov.au/development/planning-notices/', comment_url: 'mailto:kc@kingborough.tas.gov.au', date_scraped: '2024-12-25', on_notice_from: '2024-12-11', on_notice_to: '2025-01-03', documents: '["https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA-2024-117-00-Lot-1-347-349-351-Simpsons-Bay-Road-Simpsons-Bay.pdf"," https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA-2024-117-01-Land-Risk-Assessment.pdf"," https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DA-2024-117-02-Environmental-Management-Plan-Map-and-Statement.pdf"]' }, { council_reference: 'DAS-2024-14', address: '31 Nolan Crescent, Kingston, Tasmania', description: 'Subdivision of two (2) lots', info_url: 'https://www.kingborough.tas.gov.au/development/planning-notices/', comment_url: 'mailto:kc@kingborough.tas.gov.au', date_scraped: '2024-12-25', on_notice_from: '2024-12-11', on_notice_to: '2025-01-03', documents: '["https://www.kingborough.tas.gov.au/wp-content/uploads/2024/12/DAS-2024-14-31-Nolan-Crescent-Kingston.pdf"]' } ] insertQuery: INSERT OR REPLACE INTO data (council_reference, address, description, info_url, comment_url, date_scraped, on_notice_from, on_notice_to, documents) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?) Inserted/updated 12 records

Data

Downloaded 939 times by dcalde markdon repose-lecture

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (228 KB) Use the API

rows 10 / 286

council_reference address description info_url comment_url date_scraped on_notice_from on_notice_to documents
DA-2023-282
36 & 42 Roslyn Avenue and 20 Beach Road, Kingston Beach, subdivision road (CT 174783/1) and road casement, Tasmania
Stormwater infrastructure upgrade
mailto:kc@kingborough.tas.gov.au
2023-11-17
2023-11-15
2023-11-28
["https://www.kingborough.tas.gov.au/wp-content/uploads/2023/11/DA-2023-282-36-42-Roslyn-Avenue-and-20-Beach-Road-Kingston-Beach-.pdf","https://www.kingborough.tas.gov.au/wp-content/uploads/2023/11/DA-2023-282-Tree-Plan.pdf"]
DA-2023-365
10 Oak Court, Kingston, Tasmania
Ancillary dwelling
mailto:kc@kingborough.tas.gov.au
2023-11-17
2023-11-11
2023-11-24
["https://www.kingborough.tas.gov.au/wp-content/uploads/2023/11/DA-2023-365-10-Oak-Court-Kingston.pdf"]
DA-2023-295
Devlyns Road, Birchs Bay, Tasmania
Dwelling and outbuilding
mailto:kc@kingborough.tas.gov.au
2023-11-17
2023-11-11
2023-11-24
["https://www.kingborough.tas.gov.au/wp-content/uploads/2023/11/DA-2023-295-Devlyns-Road-Birchs-Bay-7162.pdf"]
DA-2023-20
17 King View Court, Kingston, Tasmania
Landscaping including an internal driveway, dam, glasshouse, potting shed, retaining wall, outdoor dining area and pergola
mailto:kc@kingborough.tas.gov.au
2023-11-17
2023-11-11
2023-11-24
["https://www.kingborough.tas.gov.au/wp-content/uploads/2023/11/DA-2023-20-17-King-View-Court-Kingston.pdf"]
DA-2023-240
15 Warremar Way, Oyster Cove, Tasmania
Addition and alterations to existing dwelling
mailto:kc@kingborough.tas.gov.au
2023-11-17
2023-11-08
2023-11-21
["https://www.kingborough.tas.gov.au/wp-content/uploads/2023/11/DA-2023-240-15-Warremar-Way-Oyster-Cove.pdf"]
DA-2023-330
3 Pimelea Road, Snug, Tasmania
Dwelling and associated works
mailto:kc@kingborough.tas.gov.au
2023-11-17
2023-11-08
2023-11-21
["https://www.kingborough.tas.gov.au/wp-content/uploads/2023/11/DA-2023-330-3-Pimelea-Road-Snug.pdf"]
DA-2023-307
22 Worsley Drive, Margate, Tasmania
Change of use from residential to visitor accommodation
mailto:kc@kingborough.tas.gov.au
2023-11-17
2023-11-08
2023-11-21
["https://www.kingborough.tas.gov.au/wp-content/uploads/2023/11/DA-2023-307-22-Worsley-Drive-Margate.pdf"]
DA-2023-265
Lot 6/3947 Channel Highway, Flowerpot, Tasmania
Dwelling
mailto:kc@kingborough.tas.gov.au
2023-11-17
2023-11-08
2023-11-21
["https://www.kingborough.tas.gov.au/wp-content/uploads/2023/11/DA-2023-265-Lot-6-3947-Channel-Highway-Flowerpot.pdf"]
DA-2023-107
13 Christophers Way, Kingston Beach, Tasmania
Boundary and wall fencing
mailto:kc@kingborough.tas.gov.au
2023-11-17
2023-11-08
2023-11-21
["https://www.kingborough.tas.gov.au/wp-content/uploads/2023/11/DA-2023-107-13-Christophers-Way-Kingston-Beach.pdf"]
DA-2022-137
25 Trowenna Rise, Margate, Tasmania
Extensions to dwelling
mailto:kc@kingborough.tas.gov.au
2023-11-17
2023-11-08
2023-11-21
["https://www.kingborough.tas.gov.au/wp-content/uploads/2023/11/DA-2022-137-25-Trowenna-Rise-Margate.pdf","https://www.kingborough.tas.gov.au/wp-content/uploads/2023/11/DA-2022-137-Natural-Values-Assessment-Report.pdf","https://www.kingborough.tas.gov.au/wp-content/uploads/2023/11/DA-2022-137-Bushfire-Report.pdf"]

Statistics

Average successful run time: less than 5 seconds

Total run time: 28 minutes

Total cpu time used: 5 minutes

Total disk space used: 507 KB

History

  • Auto ran revision 06149c64 and completed successfully .
    12 records added, 12 records removed in the database
  • Auto ran revision 06149c64 and completed successfully .
    12 records added, 12 records removed in the database
  • Auto ran revision 06149c64 and completed successfully .
    12 records added, 12 records removed in the database
  • Auto ran revision 06149c64 and completed successfully .
    12 records added, 12 records removed in the database
  • Auto ran revision 06149c64 and completed successfully .
    12 records added, 12 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Node.js

KingboroughCouncilDA / scraper.js