This is a scraper that runs on Morph. To get started see the documentation
bundle exec ruby scraper.rb
bundle exec rake
bundle exec rubocop
To download data sign in with GitHub
rows 10 / 412
council_reference | address | description | info_url | date_received | date_scraped | authority_label | on_notice_from | on_notice_to |
---|---|---|---|---|---|---|---|---|
2025/129/1
|
3 Crest Road GLEDSWOOD HILLS NSW 2557
|
Construction of an inground fiberglass swimming pool.
|
2025-03-17
|
2025-04-16
|
camden
|
|
|
|
2025/122/1
|
15 Epsom Street SPRING FARM NSW 2570
|
Inground Fibreglass Pool
|
2025-03-17
|
2025-04-16
|
camden
|
|
|
|
2025/127/1
|
33 Meridian Street LEPPINGTON NSW 2179
|
Construction of a two storey dwelling and associated site works.
|
2025-03-17
|
2025-04-16
|
camden
|
|
|
|
2021/1697/8
|
96 Rickard Road LEPPINGTON NSW 2179
|
Section 4.55 modification to an approved mixed use development to increase the height of the signage for the McDonalds restaurant
|
2025-03-17
|
2025-04-16
|
camden
|
|
|
|
2025/123/1
|
70 Southwell Road ORAN PARK NSW 2570
|
Change of use and fit out of an existing unit to a gym facility - Unit 5
|
2025-03-17
|
2025-04-16
|
camden
|
|
|
|
2025/128/1
|
21 Templeton Road ELDERSLIE NSW 2570
|
Demolition of an existing dwelling and construction of a two storey dwelling
|
2025-03-17
|
2025-04-16
|
camden
|
|
|
|
13336/2025
|
21-25 Atherton Street YORKEYS KNOB QLD 4878
|
Operational Works Civil Works
|
2025-03-17
|
2025-04-16
|
cairns
|
|
|
|
13342/2025
|
Catalano Access GOLDSBOROUGH QLD 4865
|
Material Change of Use Dwelling House
|
2025-03-17
|
2025-04-16
|
cairns
|
|
|
|
13344/2025
|
Catalano Access GOLDSBOROUGH QLD 4865
|
Operational Works Major Earthworks
|
2025-03-17
|
2025-04-16
|
cairns
|
|
|
|
13339/2025
|
67 Del Manso Crescent EDMONTON QLD 4869
|
EXPRESS Material Change of Use Dual Occupancy
|
2025-03-17
|
2025-04-16
|
cairns
|
|
|
To download data sign in with GitHub
rows 10 / 216
run_at | attempt | authority_label | records_saved | unprocessable_records | status | error_message | error_class | error_backtrace |
---|---|---|---|---|---|---|---|---|
2025-04-15T22:41:24+00:00
|
1
|
bunbury
|
121
|
0
|
successful
|
|
|
|
2025-04-15T22:41:24+00:00
|
1
|
burwood
|
0
|
0
|
failed
|
500 => Net::HTTPInternalServerError for https://ecouncil.burwood.nsw.gov.au/eservice/daEnquiryInit.do?doc_typ=10&nodeNum=219 -- unhandled response
|
Mechanize::ResponseCodeError
|
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch'
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get'
/app/lib/civica_scraper.rb:41:in `scrape_period'
/app/lib/civica_scraper.rb:23:in `scrape'
scraper.rb:19:in `block in scrape'
scraper.rb:15:in `each'
|
2025-04-15T22:41:24+00:00
|
1
|
camden
|
102
|
0
|
successful
|
|
|
|
2025-04-15T22:41:24+00:00
|
1
|
cairns
|
55
|
0
|
successful
|
|
|
|
2025-04-15T22:41:24+00:00
|
1
|
dorset
|
0
|
0
|
failed
|
Couldn't find form daEnquiryForm for period on https://eservices.dorset.tas.gov.au/eservice/daEnquiryInit.do?nodeNum=12238
|
RuntimeError
|
/app/lib/civica_scraper/page/search.rb:10:in `period'
/app/lib/civica_scraper.rb:63:in `scrape_period'
/app/lib/civica_scraper.rb:23:in `scrape'
scraper.rb:19:in `block in scrape'
scraper.rb:15:in `each'
scraper.rb:15:in `scrape'
|
2025-04-15T22:41:24+00:00
|
1
|
lane_cove
|
17
|
0
|
successful
|
|
|
|
2025-04-15T22:41:24+00:00
|
1
|
nambucca
|
0
|
0
|
failed
|
500 => Net::HTTPInternalServerError for https://eservices.nambucca.nsw.gov.au/eservice/daEnquiryInit.do?doc_typ=10&nodeNum=2811 -- unhandled response
|
Mechanize::ResponseCodeError
|
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch'
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get'
/app/lib/civica_scraper.rb:41:in `scrape_period'
/app/lib/civica_scraper.rb:23:in `scrape'
scraper.rb:19:in `block in scrape'
scraper.rb:15:in `each'
|
2025-04-15T22:41:24+00:00
|
1
|
orange
|
0
|
0
|
failed
|
500 => Net::HTTPInternalServerError for https://ecouncil.orange.nsw.gov.au/eservice/daEnquiryInit.do?nodeNum=24 -- unhandled response
|
Mechanize::ResponseCodeError
|
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch'
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get'
/app/lib/civica_scraper.rb:41:in `scrape_period'
/app/lib/civica_scraper.rb:23:in `scrape'
scraper.rb:19:in `block in scrape'
scraper.rb:15:in `each'
|
2025-04-15T22:41:24+00:00
|
1
|
vincent
|
51
|
0
|
successful
|
|
|
|
2025-04-15T22:41:24+00:00
|
1
|
wanneroo
|
0
|
0
|
failed
|
500 => Net::HTTPInternalServerError for https://eservice.wanneroo.wa.gov.au/eservice/daEnquiry.do?nodeNum=8047 -- unhandled response
|
Mechanize::ResponseCodeError
|
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize/http/agent.rb:329:in `fetch'
/app/vendor/bundle/ruby/2.5.0/gems/mechanize-2.7.7/lib/mechanize.rb:464:in `get'
/app/lib/civica_scraper.rb:41:in `scrape_period'
/app/lib/civica_scraper.rb:23:in `scrape'
scraper.rb:19:in `block in scrape'
scraper.rb:15:in `each'
|
To download data sign in with GitHub
rows 10 / 18
run_at | attempt | duration | successful | failed | interrupted | successful_count | interrupted_count | failed_count | public_ip |
---|---|---|---|---|---|---|---|---|---|
2025-04-15T22:41:24+00:00
|
1
|
362.6
|
bunbury,camden,cairns,lane_cove,vincent,woollahra
|
burwood,dorset,nambucca,orange,wanneroo,whittlesea
|
|
6
|
0
|
6
|
|
2025-04-15T22:47:27+00:00
|
2
|
65.4
|
bunbury,camden,cairns,lane_cove,vincent,woollahra
|
burwood,dorset,nambucca,orange,wanneroo,whittlesea
|
|
6
|
0
|
6
|
|
2025-04-16T12:00:13+00:00
|
1
|
358.3
|
bunbury,camden,cairns,lane_cove,vincent,woollahra
|
burwood,dorset,nambucca,orange,wanneroo,whittlesea
|
|
6
|
0
|
6
|
|
2025-04-16T12:06:11+00:00
|
2
|
67.2
|
bunbury,camden,cairns,lane_cove,vincent,woollahra
|
burwood,dorset,nambucca,orange,wanneroo,whittlesea
|
|
6
|
0
|
6
|
|
2025-04-16T14:54:53+00:00
|
1
|
349.9
|
bunbury,camden,cairns,lane_cove,vincent,woollahra
|
burwood,dorset,nambucca,orange,wanneroo,whittlesea
|
|
6
|
0
|
6
|
|
2025-04-16T15:00:43+00:00
|
2
|
65.7
|
bunbury,camden,cairns,lane_cove,vincent,woollahra
|
burwood,dorset,nambucca,orange,wanneroo,whittlesea
|
|
6
|
0
|
6
|
|
2025-04-17T05:23:04+00:00
|
1
|
339.5
|
bunbury,camden,cairns,lane_cove,woollahra
|
burwood,dorset,nambucca,orange,vincent,wanneroo,whittlesea
|
|
5
|
0
|
7
|
|
2025-04-17T05:28:44+00:00
|
2
|
74.3
|
bunbury,camden,cairns,lane_cove,vincent,woollahra
|
burwood,dorset,nambucca,orange,wanneroo,whittlesea
|
|
6
|
0
|
6
|
|
2025-04-17T15:00:13+00:00
|
1
|
364.1
|
bunbury,camden,cairns,lane_cove,vincent,woollahra
|
burwood,dorset,nambucca,orange,wanneroo,whittlesea
|
|
6
|
0
|
6
|
|
2025-04-17T15:06:17+00:00
|
2
|
65.5
|
bunbury,camden,cairns,lane_cove,vincent,woollahra
|
burwood,dorset,nambucca,orange,wanneroo,whittlesea
|
|
6
|
0
|
6
|
|
Total run time: about 1 hour
Total cpu time used: half a minute
Total disk space used: 5.88 MB