ianheggie-oaf / launceston

README.md

This is a scraper that runs on Morph. To get started see the documentation

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

To run the scraper

bundle exec ruby scraper.rb

Set MORPH_AUSTRALIAN_PROXY to the url for an Australian proxy

Expected output

Fetching public notices list from: https://onlineservice.launceston.tas.gov.au/eProperty/P1/PublicNotices/PublicNoticeDetails.aspx?r=P1.LCC.WEBGUEST&f=%24P1.ESB.PUBNOTAL.ENQ
Found 30 public notices
Skipping existing record: DA0004/2025
Skipping existing record: DA0301/2025
(etc)
Scraping Public Notice - Application Details for DA0405/2025
Saved record for DA0405/2025
Scraping Public Notice - Application Details for DA0412/2025
Saved record for DA0412/2025
Saved record for DA0540/2025
Scraping complete

Execution time ~ 43 seconds.

To run style and coding checks

bundle exec rubocop

To check for security updates

gem install bundler-audit
bundle-audit

Contributors mlandauer dcalde ianheggie-oaf simonzippy benrfairless

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Installing bundler 2.3.10 [1G-----> Removing BUNDLED WITH version in the Gemfile.lock [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-3.2.2 [1G-----> Installing dependencies using bundler 2.3.10 [1G Running: BUNDLE_WITHOUT='development:test' BUNDLE_PATH=vendor/bundle BUNDLE_BIN=vendor/bundle/bin BUNDLE_DEPLOYMENT=1 bundle install -j4 [1G Fetching gem metadata from https://rubygems.org/......... [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Fetching rake 12.3.3 [1G Installing rake 12.3.3 [1G Fetching public_suffix 6.0.2 [1G Fetching ansi 1.5.0 [1G Fetching base64 0.3.0 [1G Fetching ast 2.4.3 [1G Installing base64 0.3.0 [1G Using bundler 2.4.10 [1G Fetching connection_pool 2.5.3 [1G Installing ast 2.4.3 [1G Fetching diff-lcs 1.6.2 [1G Installing ansi 1.5.0 [1G Installing connection_pool 2.5.3 [1G Fetching docile 1.4.1 [1G Installing diff-lcs 1.6.2 [1G Installing docile 1.4.1 [1G Installing public_suffix 6.0.2 [1G Fetching domain_name 0.6.20240107 [1G Fetching mutex_m 0.3.0 [1G Installing mutex_m 0.3.0 [1G Installing domain_name 0.6.20240107 [1G Fetching json 2.13.2 [1G Fetching language_server-protocol 3.17.0.5 [1G Installing language_server-protocol 3.17.0.5 [1G Installing json 2.13.2 with native extensions [1G Fetching lint_roller 1.1.0 [1G Installing lint_roller 1.1.0 [1G Fetching mime-types-data 3.2025.0603 [1G Fetching logger 1.7.0 [1G Installing logger 1.7.0 [1G Installing mime-types-data 3.2025.0603 [1G Fetching net-http-digest_auth 1.4.1 [1G Installing net-http-digest_auth 1.4.1 [1G Fetching racc 1.8.1 [1G Installing racc 1.8.1 with native extensions [1G Fetching webrick 1.9.1 [1G Installing webrick 1.9.1 [1G Fetching webrobots 0.1.2 [1G Fetching parallel 1.27.0 [1G Installing webrobots 0.1.2 [1G Installing parallel 1.27.0 [1G Fetching prism 1.4.0 [1G Fetching rainbow 3.1.1 [1G Installing rainbow 3.1.1 [1G Fetching regexp_parser 2.11.2 [1G Installing prism 1.4.0 with native extensions [1G Installing regexp_parser 2.11.2 [1G Fetching rspec-support 3.13.4 [1G Installing rspec-support 3.13.4 [1G Fetching ruby-progressbar 1.13.0 [1G Installing ruby-progressbar 1.13.0 [1G Fetching unicode-emoji 4.0.4 [1G Installing unicode-emoji 4.0.4 [1G Fetching sqlite3 1.6.9 (x86_64-linux) [1G Fetching simplecov-html 0.13.1 [1G Installing simplecov-html 0.13.1 [1G Fetching rubyntlm 0.6.5 [1G Installing rubyntlm 0.6.5 [1G Fetching net-http-persistent 4.0.6 [1G Installing net-http-persistent 4.0.6 [1G Fetching addressable 2.8.7 [1G Installing sqlite3 1.6.9 (x86_64-linux) [1G Installing addressable 2.8.7 [1G Fetching httpclient 2.9.0 [1G Installing httpclient 2.9.0 [1G Fetching http-cookie 1.0.8 [1G Installing http-cookie 1.0.8 [1G Fetching mime-types 3.7.0 [1G Installing mime-types 3.7.0 [1G Fetching rspec-core 3.13.4 [1G Fetching rspec-expectations 3.13.5 [1G Installing rspec-core 3.13.4 [1G Installing rspec-expectations 3.13.5 [1G Fetching rspec-mocks 3.13.5 [1G Fetching unicode-display_width 3.1.4 [1G Installing rspec-mocks 3.13.5 [1G Installing unicode-display_width 3.1.4 [1G Fetching nokogiri 1.16.8 (x86_64-linux) [1G Fetching parser 3.3.9.0 [1G Installing parser 3.3.9.0 [1G Fetching simplecov 0.18.5 [1G Installing nokogiri 1.16.8 (x86_64-linux) [1G Installing simplecov 0.18.5 [1G Fetching sqlite_magic 0.0.6 [1G Installing sqlite_magic 0.0.6 [1G Fetching terminal-table 4.0.0 [1G Installing terminal-table 4.0.0 [1G Fetching rspec 3.13.1 [1G Installing rspec 3.13.1 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Fetching simplecov-console 0.9.3 [1G Installing simplecov-console 0.9.3 [1G Fetching mechanize 2.8.5 [1G Installing mechanize 2.8.5 [1G Fetching rubocop-ast 1.46.0 [1G Installing rubocop-ast 1.46.0 [1G Fetching rubocop 1.80.1 [1G Installing rubocop 1.80.1 [1G Bundle complete! 9 Gemfile dependencies, 50 gems now installed. [1G Gems in the groups 'development' and 'test' were not installed. [1G Bundled gems are installed into `./vendor/bundle` [1G Bundle completed (20.41s) [1G Cleaning up the bundler cache. [1G Removing bundler (2.3.10) [1G-----> Detecting rake tasks [1G [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... Using Australian proxy... Fetching public notices list from: https://onlineservice.launceston.tas.gov.au/eProperty/P1/PublicNotices/PublicNoticeDetails.aspx?r=P1.LCC.WEBGUEST&f=%24P1.ESB.PUBNOTAL.ENQ Found 30 public notices Skipping existing record: DA0004/2025 Skipping existing record: DA0301/2025 Skipping existing record: DA0312/2025 Skipping existing record: DA0354/2025 Skipping existing record: DA0393/2025 Skipping existing record: DA0405/2025 Skipping existing record: DA0412/2025 Skipping existing record: DA0424/2025 Skipping existing record: DA0432/2025 Skipping existing record: DA0446/2025 Skipping existing record: DA0453/2025 Skipping existing record: DA0468/2025 Skipping existing record: DA0480/2025 Skipping existing record: DA0485/2025 Skipping existing record: DA0490/2025 Skipping existing record: DA0491/2025 Skipping existing record: DA0496/2025 Skipping existing record: DA0499/2025 Skipping existing record: DA0501/2025 Skipping existing record: DA0502/2025 Skipping existing record: DA0504/2025 Skipping existing record: DA0507/2025 Skipping existing record: DA0508/2025 Skipping existing record: DA0515/2025 Skipping existing record: DA0516/2025 Skipping existing record: DA0517/2025 Skipping existing record: DA0518/2025 Skipping existing record: DA0523/2025 Skipping existing record: DA0531/2025 Skipping existing record: DA0540/2025 Scraping complete

Data

Downloaded 17905 times by ianheggie-oaf dcalde tkrikke

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (128 KB) Use the API

rows 10 / 228

date_scraped council_reference info_url description address legal_description date_received on_notice_from
2025-06-05
DA0025/2025
https://onlineservice.launceston.tas.gov.au/eProperty/P1/PublicNotices/PublicNoticeDetails.aspx?r=P1.LCC.WEBGUEST&f=%24P1.ESB.PUBNOT.VIW&rf=%24P1.ESB.PUBNOTAL.ENQ&ApplicationId=DA0025%2F2025
Subdivision - Subdivide one lot into two lots
35 Trevallyn Road TREVALLYN, TAS, 7250
Lot 1 RP 123043 Vol 123043 Fol 1
2025-01-30
2025-06-04
2025-06-05
DA0089/2025
https://onlineservice.launceston.tas.gov.au/eProperty/P1/PublicNotices/PublicNoticeDetails.aspx?r=P1.LCC.WEBGUEST&f=%24P1.ESB.PUBNOT.VIW&rf=%24P1.ESB.PUBNOTAL.ENQ&ApplicationId=DA0089%2F2025
Residential - Construction of a secondary residence, outbuilding and carport with access over 241345/1
74 Hill Street WEST LAUNCESTON, TAS, 7250
Lot 1 RP 60022 Vol 60022 Fol 1
2025-03-03
2025-05-24
2025-06-05
DA0163/2025
https://onlineservice.launceston.tas.gov.au/eProperty/P1/PublicNotices/PublicNoticeDetails.aspx?r=P1.LCC.WEBGUEST&f=%24P1.ESB.PUBNOT.VIW&rf=%24P1.ESB.PUBNOTAL.ENQ&ApplicationId=DA0163%2F2025
General Retail and Hire - Change of use to a pet grooming parlour and installation of window signs
274A Hobart Road YOUNGTOWN, TAS, 7249
Lot 5 STR 136577 Vol 136577 Fol 5
2025-04-07
2025-05-28
2025-06-05
DA0167/2025
https://onlineservice.launceston.tas.gov.au/eProperty/P1/PublicNotices/PublicNoticeDetails.aspx?r=P1.LCC.WEBGUEST&f=%24P1.ESB.PUBNOT.VIW&rf=%24P1.ESB.PUBNOTAL.ENQ&ApplicationId=DA0167%2F2025
Sports and Recreation - Construction of an outbuilding to store golf carts
27-99 Opossum Road KINGS MEADOWS, TAS, 7249
Lot 19 RP 88212 Vol 88212 Fol 19,Lot 35 RP 59765 Vol 59765 Fol 35,Lot 200 RP 187064 Vol 187064 Fol 200,Lot 201 RP 187064 Vol 187064 Fol 201
2025-04-14
2025-05-24
2025-06-05
DA0173/2025
https://onlineservice.launceston.tas.gov.au/eProperty/P1/PublicNotices/PublicNoticeDetails.aspx?r=P1.LCC.WEBGUEST&f=%24P1.ESB.PUBNOT.VIW&rf=%24P1.ESB.PUBNOTAL.ENQ&ApplicationId=DA0173%2F2025
Residential - Construction of alterations and additions to a dwelling
38 Hart Street NEWSTEAD, TAS, 7250
Lot 176 RP 54558 Vol 54558 Fol 176
2025-04-17
2025-05-28
2025-06-05
DA0179/2025
https://onlineservice.launceston.tas.gov.au/eProperty/P1/PublicNotices/PublicNoticeDetails.aspx?r=P1.LCC.WEBGUEST&f=%24P1.ESB.PUBNOT.VIW&rf=%24P1.ESB.PUBNOTAL.ENQ&ApplicationId=DA0179%2F2025
Residential - Construction of a carport
10 Middle Street LAUNCESTON, TAS, 7250
Lot 1 RP 45567 Vol 45567 Fol 1
2025-04-24
2025-05-31
2025-06-05
DA0187/2025
https://onlineservice.launceston.tas.gov.au/eProperty/P1/PublicNotices/PublicNoticeDetails.aspx?r=P1.LCC.WEBGUEST&f=%24P1.ESB.PUBNOT.VIW&rf=%24P1.ESB.PUBNOTAL.ENQ&ApplicationId=DA0187%2F2025
Residential - Construction of a carport and front boundary fence
16 Beech Road NORWOOD, TAS, 7250
Lot 113 RP 28224 Vol 28224 Fol 113
2025-04-30
2025-05-28
2025-06-05
DA0195/2025
https://onlineservice.launceston.tas.gov.au/eProperty/P1/PublicNotices/PublicNoticeDetails.aspx?r=P1.LCC.WEBGUEST&f=%24P1.ESB.PUBNOT.VIW&rf=%24P1.ESB.PUBNOTAL.ENQ&ApplicationId=DA0195%2F2025
Residential - Demolition of a dwelling and construction of a dwelling
8 Spencer Street EAST LAUNCESTON, TAS, 7250
Lot 1 RP 220214 Vol 220214 Fol 1
2025-05-08
2025-05-24
2025-06-05
DA0200/2025
https://onlineservice.launceston.tas.gov.au/eProperty/P1/PublicNotices/PublicNoticeDetails.aspx?r=P1.LCC.WEBGUEST&f=%24P1.ESB.PUBNOT.VIW&rf=%24P1.ESB.PUBNOTAL.ENQ&ApplicationId=DA0200%2F2025
Residential - Construction of an outbuilding
8 Enterprize Drive YOUNGTOWN, TAS, 7249
Lot 4 RP 180048 Vol 180048 Fol 4
2025-05-09
2025-05-24
2025-06-05
DA0211/2025
https://onlineservice.launceston.tas.gov.au/eProperty/P1/PublicNotices/PublicNoticeDetails.aspx?r=P1.LCC.WEBGUEST&f=%24P1.ESB.PUBNOT.VIW&rf=%24P1.ESB.PUBNOTAL.ENQ&ApplicationId=DA0211%2F2025
Residential - Construction of alterations and additions to a dwelling, including a separate alfresco area
3 Suffolk Street NEWSTEAD, TAS, 7250
Lot 1 RP 46222 Vol 46222 Fol 1
2025-05-19
2025-05-28

Statistics

Average successful run time: less than 10 seconds

Total run time: 26 minutes

Total cpu time used: 3 minutes

Total disk space used: 199 KB

History

  • Auto ran revision d09632a3 and completed successfully .
    nothing changed in the database
  • Manually ran revision 6c9d83f4 and completed successfully .
    nothing changed in the database
  • Manually ran revision 68d9c478 and completed successfully .
    nothing changed in the database
  • Manually ran revision 6f58741b and failed .
    nothing changed in the database
  • Auto ran revision 3ddd872e and completed successfully .
    4 records added in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

launceston / scraper.rb