planningalerts-scrapers / cardinia

Cardinia Shire Council Planning Applications


Cardinia Council Scraper

  • Server - Unknown
  • Cookie tracking - No
  • Pagnation - No
  • Javascript - No
  • Clearly defined data within a row - Yes
  • System - Unknown

Enjoy

This is a scraper that runs on Morph. To get started see the documentation

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

To run the scraper

bundle exec ruby scraper.rb

Expected output

Injecting configuration and compiling...
Injecting scraper and running...
Using Australian proxy: http://***@...
Using user agent: Ruby/3.2.2 PlanningAlerts scraper for Cardinia Shire Council/1.0 (https://www.planningalerts.org.au/about)
Scraping page: https://www.cardinia.vic.gov.au/planning-and-building/applying-and-managing-planning-applications-and-permits/current-advertised
Saving record T250324, 5445 South Gippsland HighwayLang Lang, VIC

(Sometimes it fixes urls:)
NOT: Reference: T250582 had an invalid url (https://T250582 PA - Advertising Package - 1340 Westernport Rd, Heath Hill), using list url instead!
Saving record T250582, 1340 Westernport Road, Heath Hill, VIC
Saving record T200592-1, 43 Tynong Road, Tynong, VIC
Saving record T240496, 150 Macclesfield Road, Avonsleigh, VIC
...
Saving record T260120, 3 George Street, Bunyip, VIC
Saving record T160676-2, 95 Hall Road, Pakenham South, VIC
Saving record T260459, Commercial Drive, Pakenham, VIC
Finished! Saved 18 applications.

Execution time under a minute

To run style and coding checks

bundle exec rubocop

To check for security updates

gem install bundler-audit
bundle-audit

Contributors flying-feline LoveMyData henare equivalentideas mlandauer benrfairless CloCkWeRX ianheggie-oaf

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Using Australian proxy: http://***@plannies-proxy.thesite.info:49976/ Using user agent: Ruby/3.2.2 PlanningAlerts scraper for Cardinia Shire Council/1.0 (https://www.planningalerts.org.au/about) Scraping page: https://www.cardinia.vic.gov.au/planning-and-building/applying-and-managing-planning-applications-and-permits/current-advertised NOTE: Reference: T260173 had an invalid url (/media/3870), using list url instead! Saving record T260173, 30 Breyleigh Drive, Pakenham, VIC NOTE: Reference: T260120 had an invalid url (/media/3874), using list url instead! Saving record T260120, 3 George Street, Bunyip, VIC Saving record T160676-2, 95 Hall Road, Pakenham South, VIC Saving record T260459, Commercial Drive, Pakenham, VIC Saving record T260240, 53-55 Main StreetNar Nar Goon, VIC Saving record T260237 , 95 Hall RoadPakenham South, VIC Saving record T260127, U 1/23 Main StreetNar Nar Goon, VIC Saving record T100906-1, FY 9 / 22-26 Bald Hill Road, Pakenham, VIC Saving record T260356, 11 Kookaburra Rise, Pakenham, VIC Saving record T260470, 40 Avon Road, Avonsleigh, VIC Finished! Saved 10 applications.

Data

Downloaded 6253 times by openaustralia dcalde mlandauer LoveMyData jesse-a-reilly tkrikke repose-lecture kouzi-sys DevAppProject TheZepto davidyu37 equivalentideas 538digital MikeRalphson Joel-Tan_valocity 93399339 danielpurton mustafa0 ianheggie-oaf Simsoi Manasaanand AthleticoPrawn TornMarketing derman232 Jedwards157

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (519 KB) Use the API

rows 10 / 1297

info_url comment_url council_reference description address on_notice_to date_scraped
mailto:mail@cardinia.vic.gov.au
T200500-1
Amendment to planning permit T200500 (that was issued for the use and development of land for a place of worship and associated works) to delete conditions
Army Road (Corner of Murphy Road), Pakenham, VIC
2021-05-13
2021-05-19
mailto:mail@cardinia.vic.gov.au
T200716
Development of the land for a dwelling, earthworks and removal of vegetation
11A Duffys Road, Emerald, VIC
2021-05-13
2021-05-19
mailto:mail@cardinia.vic.gov.au
T200754
Use and development of the land for a car park
Lyle Blue Court, Pakenham (rear of Castellos Hotel), VIC
2021-05-13
2021-05-19
mailto:mail@cardinia.vic.gov.au
T200816
Development of the land for a dwelling and outbuilding and associated works
34 A`Beckett Road, Bunyip, VIC
2021-05-14
2021-05-19
mailto:mail@cardinia.vic.gov.au
T210180
Use of the land for an indoor recreation facility
Trampoline Centre FY 14/99 Bald Hill Road, Pakenham, VIC
2021-05-21
2021-05-24
mailto:mail@cardinia.vic.gov.au
T210001
Removal of vegetation
405 Monomeith Road, Monomeith, VIC
2021-05-24
2021-05-24
mailto:mail@cardinia.vic.gov.au
T200455
Use of the land for a retail premises and signage
122 Old Princes Highway, Beaconsfield, VIC
2021-05-28
2021-06-03
mailto:mail@cardinia.vic.gov.au
T210005
Use and development of the land for domestic animal husbandry (dog breeding)
150 Settlement Road, Caldermeade, VIC
2021-06-04
2021-06-10
mailto:mail@cardinia.vic.gov.au
T210314
Removal of vegetation (five trees, including one native tree)
335 Garfield North Road, Garfield North, VIC
2021-06-04
2021-06-10
mailto:mail@cardinia.vic.gov.au
T210234
Removal of native vegetation (three trees)
4 Wattletree Road, Bunyip, VIC
2021-06-04
2021-06-10

Statistics

Average successful run time: less than a minute

Total run time: 5 days

Total cpu time used: about 1 hour

Total disk space used: 600 KB

History

  • Auto ran revision d1705a55 and completed successfully .
    10 records added, 9 records removed in the database
  • Auto ran revision d1705a55 and completed successfully .
    14 records added, 12 records removed in the database
  • Auto ran revision d1705a55 and completed successfully .
    12 records added, 12 records removed in the database
  • Auto ran revision d1705a55 and completed successfully .
    12 records added, 12 records removed in the database
  • Auto ran revision d1705a55 and completed successfully .
    12 records added, 11 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

cardinia / scraper.rb