problemgenerator / sash_windows
Sash windows for sale on renovaterestorerecycle.com.au
Oh hi! This is the code for a scraper that runs daily on Morph.io. It finds all of the sash windows available for sale at https://renovaterestorerecycle.com.au/ and https://www.renovatorsparadise.com.au/, and sends an email (via Sendgrid) to a nominated email address if any new windows are found.
If that sounds incredibly niche and not very interesting, that's because it is!
Contributors
Last run completed successfully
.
Console output of last run
Injecting configuration and compiling...
[1G [1G-----> Ruby app detected
[1G-----> Compiling Ruby/Rack
[1G-----> Using Ruby version: ruby-2.6.2
[1G-----> Installing dependencies using bundler version 1.17.2
[1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment
[1G Fetching gem metadata from https://rubygems.org/...........
[1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git
[1G Using bundler 1.17.2
[1G Fetching unf_ext 0.0.7.1
[1G Fetching httpclient 2.6.0.1
[1G Fetching mime-types 2.5
[1G Installing mime-types 2.5
[1G Installing httpclient 2.6.0.1
[1G Installing unf_ext 0.0.7.1 with native extensions
[1G Fetching net-http-digest_auth 1.4
[1G Installing net-http-digest_auth 1.4
[1G Fetching net-http-persistent 2.9.4
[1G Installing net-http-persistent 2.9.4
[1G Fetching mini_portile2 2.4.0
[1G Fetching ntlm-http 0.1.1
[1G Installing mini_portile2 2.4.0
[1G Installing ntlm-http 0.1.1
[1G Fetching webrobots 0.1.1
[1G Fetching mustermann 1.0.3
[1G Installing webrobots 0.1.1
[1G Installing mustermann 1.0.3
[1G Fetching rack 2.0.7
[1G Fetching ruby_http_client 3.3.0
[1G Installing rack 2.0.7
[1G Installing ruby_http_client 3.3.0
[1G Fetching sqlite3 1.3.10
[1G Installing sqlite3 1.3.10 with native extensions
[1G Fetching tilt 2.0.9
[1G Installing tilt 2.0.9
[1G Fetching nokogiri 1.10.8
[1G Installing nokogiri 1.10.8 with native extensions
[1G Fetching rack-protection 2.0.5
[1G Installing rack-protection 2.0.5
[1G Fetching unf 0.1.4
[1G Installing unf 0.1.4
[1G Fetching sinatra 2.0.5
[1G Installing sinatra 2.0.5
[1G Fetching domain_name 0.5.24
[1G Installing domain_name 0.5.24
[1G Fetching sendgrid-ruby 5.3.0
[1G Installing sendgrid-ruby 5.3.0
[1G Fetching http-cookie 1.0.2
[1G Installing http-cookie 1.0.2
[1G Fetching sqlite_magic 0.0.3
[1G Installing sqlite_magic 0.0.3
[1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)
[1G Fetching mechanize 2.7.3
[1G Installing mechanize 2.7.3
[1G Bundle complete! 3 Gemfile dependencies, 24 gems now installed.
[1G Gems in the groups development and test were not installed.
[1G Bundled gems are installed into `./vendor/bundle`
[1G Removing bundler (1.15.2)
[1G Bundle completed (17.33s)
[1G Cleaning up the bundler cache.
[1G-----> Detecting rake tasks
[1G
[1G [1G-----> Discovering process types
[1G Procfile declares types -> scraper
Injecting scraper and running...
Scraping renovaterestorerecycle.com.au:
Scraping page: https://www.renovaterestorerecycle.com.au/category/sash-windows?post_type=rrr_stock
0 products found.
1 pages scraped. 0 total products found.
0 available product(s) found.
Scraping renovatorsparadise.com.au:
Finding pages to scrape.
7 page(s) of interest found.
Scraping page: https://www.renovatorsparadise.com.au/product-category/windows/single-sash-window/interwar-sash/interwar-0-1395-mm-high/
33 product(s) found.
Scraping page: https://www.renovatorsparadise.com.au/product-category/windows/single-sash-window/interwar-sash/interwar-1400-1595-high/
15 product(s) found.
Scraping page: https://www.renovatorsparadise.com.au/product-category/windows/single-sash-window/interwar-sash/interwar-1600-1895-high/
20 product(s) found.
Scraping page: https://www.renovatorsparadise.com.au/product-category/windows/single-sash-window/interwar-sash/interwar-1900-mm-high/
19 product(s) found.
Scraping page: https://www.renovatorsparadise.com.au/product-category/windows/single-sash-window/leadlight-sash/
13 product(s) found.
Scraping page: https://www.renovatorsparadise.com.au/product-category/windows/sash-window/
39 product(s) found.
Scraping page: https://www.renovatorsparadise.com.au/product-category/windows/triple-quadruple-sash/
33 product(s) found.
7 pages scraped. 172 total products found.
No new products found. Oh well. Seeya.
Data
Downloaded
3 times
by
To download data sign in with GitHub
rows 10 / 281
| name | description | price | url |
|---|---|---|---|
|
Excellent Deco Sash Window
|
1235 w x 1235 h
|
$1,295.00
|
|
|
Toorak Road Sash Window
|
1205 w x 1200 h
|
$595.00
|
|
|
Ivanhoe Sash Window
|
925 w x 1340 h
|
$990.00
|
|
|
Clear Glass Sash Windows
|
2 available
|
$990.00
|
|
|
Spotswood Glass Sash Window
|
890 w x 1310 h
|
$950.00
|
|
|
Weatherboard Sash Window
|
805 w x 1405 h
|
$990.00
|
|
|
Art Deco Sash Windows
|
2 available
|
$1,195.00
|
|
|
Recycled Sash Window
|
1055 w x 1330 h
|
$1,050.00
|
|
|
Excellent Wide Sash Window
|
1265 w x 1150 h
|
$1,495.00
|
|
|
Neat Sash Window
|
1070 w x 1070 h
|
$1,150.00
|
Statistics
Average successful run time: 1 minute
Total run time: 1 day
Total cpu time used: about 1 hour
Total disk space used: 108 KB
History
-
Auto
ran
revision
476d08bb
and
completed successfully
.
nothing changed in the database
-
Auto
ran
revision
476d08bb
and
completed successfully
.
nothing changed in the database
-
Auto
ran
revision
476d08bb
and
completed successfully
.
nothing changed in the database
-
Auto
ran
revision
476d08bb
and
completed successfully
.
nothing changed in the database
-
Auto
ran
revision
476d08bb
and
completed successfully
.
nothing changed in the database
- ...
- Created on morph.io