eliasbaixas / inmo

Real state stuff


This is a scraper that runs on Morph. To get started see the documentation

Contributors eliasbaixas

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.5.5 [1G-----> Installing dependencies using bundler version 1.15.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.17.3). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G Fetching gem metadata from https://rubygems.org/...... [1G Fetching version metadata from https://rubygems.org/. [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Fetching public_suffix 4.0.7 [1G Using bundler 1.15.2 [1G Fetching connection_pool 2.4.1 [1G Fetching unf_ext 0.0.8.2 [1G Installing connection_pool 2.4.1 [1G Installing public_suffix 4.0.7 [1G Installing unf_ext 0.0.8.2 with native extensions [1G Fetching facets 3.1.0 [1G Fetching httpclient 2.8.3 [1G Installing facets 3.1.0 [1G Installing httpclient 2.8.3 [1G Fetching mime-types-data 3.2023.0808 [1G Installing mime-types-data 3.2023.0808 [1G Fetching net-http-digest_auth 1.4.1 [1G Installing net-http-digest_auth 1.4.1 [1G Fetching mini_portile2 2.6.1 [1G Installing mini_portile2 2.6.1 [1G Fetching racc 1.7.1 [1G Installing racc 1.7.1 with native extensions [1G Fetching rubyntlm 0.6.3 [1G Installing rubyntlm 0.6.3 [1G Fetching webrick 1.8.1 [1G Installing webrick 1.8.1 [1G Fetching webrobots 0.1.2 [1G Installing webrobots 0.1.2 [1G Fetching sqlite3 1.4.4 [1G Installing sqlite3 1.4.4 with native extensions [1G Fetching net-http-persistent 4.0.2 [1G Installing net-http-persistent 4.0.2 [1G Fetching addressable 2.8.5 [1G Installing addressable 2.8.5 [1G Fetching mime-types 3.5.1 [1G Installing mime-types 3.5.1 [1G Fetching unf 0.1.4 [1G Installing unf 0.1.4 [1G Fetching domain_name 0.5.20190701 [1G Installing domain_name 0.5.20190701 [1G Fetching http-cookie 1.0.5 [1G Installing http-cookie 1.0.5 [1G Fetching nokogiri 1.12.5 (x86_64-linux) [1G Installing nokogiri 1.12.5 (x86_64-linux) [1G Fetching mechanize 2.8.5 [1G Installing mechanize 2.8.5 [1G Fetching sqlite_magic 0.0.6 [1G Installing sqlite_magic 0.0.6 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Bundle complete! 3 Gemfile dependencies, 24 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Bundle completed (9.32s) [1G Cleaning up the bundler cache. [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.17.3). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G-----> Detecting rake tasks [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... I, [2023-09-12T08:23:48.171377 #19] INFO -- : Got page number 1 with # of results = 16 I, [2023-09-12T08:23:48.172550 #19] INFO -- : house_type city m2 bedrooms bathrooms has_pool price I, [2023-09-12T08:23:48.504575 #19] INFO -- : https://www.portalmenorca.com/es/son-parc/apartamento-20638006 I, [2023-09-12T08:23:48.508689 #19] INFO -- : {"link"=>"https://www.portalmenorca.com/es/son-parc/apartamento-20638006", "house_type"=>"Apartamento", "city"=>"Es Mercadal , Son Parc", "price"=>0.0, "construction"=>"Fin de la construcción 1983-01-01", "license"=>"Licencia Turística 1021/1986", "bathrooms"=>1.0, "bedrooms"=>2.0, "livingrooms"=>1.0, "has_washer"=>0, "sea_distance"=>nil, "built_m2"=>72.0, "terrace_m2"=>nil, "has_ac"=>0, "has_alarm"=>0, "has_pool"=>1, "has_shared_pool"=>1, "has_garden"=>0, "has_parking"=>1} I, [2023-09-12T08:23:48.894261 #19] INFO -- : https://www.portalmenorca.com/es/playas-de-fornells/apartamento-20574326 I, [2023-09-12T08:23:48.897186 #19] INFO -- : {"link"=>"https://www.portalmenorca.com/es/playas-de-fornells/apartamento-20574326", "house_type"=>"Apartamento", "city"=>"Es Mercadal , Playas de Fornells", "price"=>0.0, "construction"=>"Fin de la construcción 1985-01-01", "license"=>"Licencia Turística ET2888ME", "bathrooms"=>1.0, "bedrooms"=>1.0, "livingrooms"=>1.0, "has_washer"=>0, "sea_distance"=>nil, "built_m2"=>46.0, "terrace_m2"=>nil, "has_ac"=>0, "has_alarm"=>0, "has_pool"=>0, "has_shared_pool"=>0, "has_garden"=>0, "has_parking"=>0} I, [2023-09-12T08:23:49.365206 #19] INFO -- : https://www.portalmenorca.com/es/calan-bosch/chalet-20544823 I, [2023-09-12T08:23:49.368744 #19] INFO -- : {"link"=>"https://www.portalmenorca.com/es/calan-bosch/chalet-20544823", "house_type"=>"Chalet", "city"=>"Ciutadella , Cala'n Bosch", "price"=>850000.0, "construction"=>"Fin de la construcción 1978-01-01", "license"=>"Licencia Turística ET0923ME", "bathrooms"=>2.0, "bedrooms"=>3.0, "livingrooms"=>nil, "has_washer"=>0, "built_m2"=>206.0, "terrace_m2"=>nil, "has_ac"=>1, "has_alarm"=>0, "has_pool"=>1, "has_shared_pool"=>0, "has_garden"=>0, "has_parking"=>0} I, [2023-09-12T08:23:49.734537 #19] INFO -- : https://www.portalmenorca.com/es/cala-blanca/chalet-20511271 I, [2023-09-12T08:23:49.738581 #19] INFO -- : {"link"=>"https://www.portalmenorca.com/es/cala-blanca/chalet-20511271", "house_type"=>"Chalet", "city"=>"Ciutadella , Cala Blanca", "price"=>370000.0, "construction"=>"Fin de la construcción 1974-06-07", "license"=>nil, "bathrooms"=>1.0, "bedrooms"=>3.0, "livingrooms"=>nil, "has_washer"=>0, "built_m2"=>64.0, "terrace_m2"=>nil, "has_ac"=>1, "has_alarm"=>0} I, [2023-09-12T08:23:50.169236 #19] INFO -- : https://www.portalmenorca.com/es/cap-dartruitx/chalet-20486266 I, [2023-09-12T08:23:50.171456 #19] INFO -- : {"link"=>"https://www.portalmenorca.com/es/cap-dartruitx/chalet-20486266", "house_type"=>"Chalet", "city"=>"Ciutadella , Cap D'Artruitx", "price"=>800000.0, "built_m2"=>190.0, "terrace_m2"=>nil} I, [2023-09-12T08:23:50.614069 #19] INFO -- : https://www.portalmenorca.com/es/binibeca-vell/chalet-20668885 I, [2023-09-12T08:23:50.617036 #19] INFO -- : {"link"=>"https://www.portalmenorca.com/es/binibeca-vell/chalet-20668885", "house_type"=>"Chalet", "city"=>"Sant Lluís , Binibeca Vell", "price"=>1850000.0, "bathrooms"=>4.0, "bedrooms"=>6.0, "livingrooms"=>2.0, "has_washer"=>0, "built_m2"=>316.0, "terrace_m2"=>nil} I, [2023-09-12T08:23:51.084264 #19] INFO -- : https://www.portalmenorca.com/es/arenal-den-castell/apartamento-19983703 I, [2023-09-12T08:23:51.087857 #19] INFO -- : {"link"=>"https://www.portalmenorca.com/es/arenal-den-castell/apartamento-19983703", "house_type"=>"Apartamento", "city"=>"Es Mercadal , Arenal d'en Castell", "price"=>335000.0, "construction"=>"Fin de la construcción 2004-01-01", "license"=>"Licencia Turística ET1915ME", "bathrooms"=>2.0, "bedrooms"=>3.0, "livingrooms"=>1.0, "has_washer"=>1, "sea_distance"=>nil, "built_m2"=>99.84, "terrace_m2"=>19.58, "has_ac"=>1, "has_alarm"=>1, "has_pool"=>1, "has_shared_pool"=>1, "has_garden"=>1, "has_parking"=>1} I, [2023-09-12T08:23:51.524398 #19] INFO -- : https://www.portalmenorca.com/es/sa-caleta/chalet-19820045 I, [2023-09-12T08:23:51.528182 #19] INFO -- : {"link"=>"https://www.portalmenorca.com/es/sa-caleta/chalet-19820045", "house_type"=>"Chalet", "city"=>"Ciutadella , Sa Caleta", "price"=>970000.0, "construction"=>"Fin de la construcción 2001-01-01", "license"=>nil, "bathrooms"=>2.0, "bedrooms"=>4.0, "livingrooms"=>1.0, "has_washer"=>0, "built_m2"=>333.0, "terrace_m2"=>nil, "has_ac"=>1, "has_alarm"=>0, "has_pool"=>1, "has_shared_pool"=>0, "has_garden"=>1, "has_parking"=>0} I, [2023-09-12T08:23:51.954322 #19] INFO -- : https://www.portalmenorca.com/es/san-antonio-cala-rata/chalet-19744102 I, [2023-09-12T08:23:51.957830 #19] INFO -- : {"link"=>"https://www.portalmenorca.com/es/san-antonio-cala-rata/chalet-19744102", "house_type"=>"Chalet", "city"=>"Mahón / Maó , San Antonio - Cala Rata", "price"=>2250000.0, "construction"=>nil, "license"=>"Licencia Turística ET1062ME", "bathrooms"=>4.0, "bedrooms"=>4.0, "livingrooms"=>nil, "has_washer"=>0, "sea_distance"=>nil, "built_m2"=>240.0, "terrace_m2"=>nil, "has_pool"=>1, "has_shared_pool"=>0, "has_garden"=>0, "has_parking"=>0} I, [2023-09-12T08:23:52.358759 #19] INFO -- : https://www.portalmenorca.com/es/addaia/chalet-19642947 I, [2023-09-12T08:23:52.362874 #19] INFO -- : {"link"=>"https://www.portalmenorca.com/es/addaia/chalet-19642947", "house_type"=>"Chalet", "city"=>"Es Mercadal , Addaia", "price"=>595000.0, "construction"=>"Fin de la construcción", "license"=>nil, "bathrooms"=>3.0, "bedrooms"=>4.0, "livingrooms"=>0.0, "has_washer"=>1, "built_m2"=>170.0, "terrace_m2"=>nil, "has_ac"=>0, "has_alarm"=>0, "has_pool"=>1, "has_shared_pool"=>0, "has_garden"=>1, "has_parking"=>1} I, [2023-09-12T08:23:52.783199 #19] INFO -- : https://www.portalmenorca.com/es/santa-ana/chalet-19468383 I, [2023-09-12T08:23:52.786452 #19] INFO -- : {"link"=>"https://www.portalmenorca.com/es/santa-ana/chalet-19468383", "house_type"=>"Chalet", "city"=>"Es Castell , Santa Ana", "price"=>1970000.0, "construction"=>nil, "license"=>nil, "bathrooms"=>5.0, "bedrooms"=>5.0, "livingrooms"=>nil, "has_washer"=>0, "sea_distance"=>nil, "built_m2"=>367.0, "terrace_m2"=>nil, "has_ac"=>0, "has_alarm"=>0, "has_pool"=>1, "has_shared_pool"=>0, "has_garden"=>0, "has_parking"=>0} I, [2023-09-12T08:23:53.215085 #19] INFO -- : https://www.portalmenorca.com/es/san-jaime-mediterraneo/chalet-19696626 I, [2023-09-12T08:23:53.222173 #19] INFO -- : {"link"=>"https://www.portalmenorca.com/es/san-jaime-mediterraneo/chalet-19696626", "house_type"=>"Chalet", "city"=>"Alaior , San Jaime Mediterráneo", "price"=>1120000.0, "construction"=>nil, "license"=>"Licencia Turística VT412ME", "bathrooms"=>2.0, "bedrooms"=>3.0, "livingrooms"=>nil, "has_washer"=>0, "sea_distance"=>nil, "built_m2"=>181.03, "terrace_m2"=>nil, "has_ac"=>1, "has_alarm"=>0, "has_pool"=>1, "has_shared_pool"=>0, "has_garden"=>0, "has_parking"=>0} I, [2023-09-12T08:23:53.632408 #19] INFO -- : https://www.portalmenorca.com/es/salgar/chalet-17770382 I, [2023-09-12T08:23:53.640093 #19] INFO -- : {"link"=>"https://www.portalmenorca.com/es/salgar/chalet-17770382", "house_type"=>"Chalet", "city"=>"Sant Lluís , S'Algar", "price"=>850000.0, "construction"=>nil, "license"=>nil, "bathrooms"=>3.0, "bedrooms"=>3.0, "livingrooms"=>nil, "has_washer"=>1, "sea_distance"=>nil, "built_m2"=>175.0, "terrace_m2"=>nil, "has_ac"=>1, "has_alarm"=>0, "has_pool"=>1, "has_shared_pool"=>0, "has_garden"=>0, "has_parking"=>0} I, [2023-09-12T08:23:53.983624 #19] INFO -- : https://www.portalmenorca.com/es/son-remei/chalet-4232138 I, [2023-09-12T08:23:53.987060 #19] INFO -- : {"link"=>"https://www.portalmenorca.com/es/son-remei/chalet-4232138", "house_type"=>"Chalet", "city"=>"Sant Lluís , Son Remei", "price"=>0.0, "construction"=>nil, "license"=>"Licencia Turística ET0199ME", "bathrooms"=>2.0, "bedrooms"=>3.0, "livingrooms"=>nil, "has_washer"=>0, "built_m2"=>110.0, "terrace_m2"=>nil, "has_ac"=>1, "has_alarm"=>0, "has_pool"=>1, "has_shared_pool"=>0, "has_garden"=>0, "has_parking"=>1} I, [2023-09-12T08:23:54.388314 #19] INFO -- : https://www.portalmenorca.com/es/cala-llonga/chalet-4076662 I, [2023-09-12T08:23:54.392937 #19] INFO -- : {"link"=>"https://www.portalmenorca.com/es/cala-llonga/chalet-4076662", "house_type"=>"Chalet", "city"=>"Mahón / Maó , Cala Llonga", "price"=>1750000.0, "construction"=>"Fin de la construcción 2004-03-04", "license"=>nil, "bathrooms"=>5.0, "bedrooms"=>5.0, "livingrooms"=>1.0, "has_washer"=>1, "sea_distance"=>nil, "built_m2"=>563.0, "terrace_m2"=>nil, "has_ac"=>1, "has_alarm"=>0, "has_pool"=>1, "has_shared_pool"=>0, "has_garden"=>1, "has_parking"=>1} I, [2023-09-12T08:23:54.806754 #19] INFO -- : https://www.portalmenorca.com/es/binibeca-nou/chalet-19809135 I, [2023-09-12T08:23:54.810558 #19] INFO -- : {"link"=>"https://www.portalmenorca.com/es/binibeca-nou/chalet-19809135", "house_type"=>"Chalet", "city"=>"Sant Lluís , Binibeca Nou", "price"=>0.0, "construction"=>nil, "license"=>nil, "bathrooms"=>2.0, "bedrooms"=>3.0, "livingrooms"=>nil, "has_washer"=>0, "sea_distance"=>nil, "built_m2"=>146.0, "terrace_m2"=>nil, "has_pool"=>1, "has_shared_pool"=>0, "has_garden"=>1, "has_parking"=>0} I, [2023-09-12T08:23:55.420540 #19] INFO -- : Got page number 2 with # of results = 0

Data

Downloaded 1 time by eliasbaixas

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (11 KB) Use the API

rows 10 / 16

link house_type city price construction license bathrooms bedrooms livingrooms has_washer sea_distance built_m2 terrace_m2 has_ac has_alarm has_pool has_shared_pool has_garden has_parking
Apartamento
Es Mercadal , Son Parc
0.0
Fin de la construcción 1983-01-01
Licencia Turística 1021/1986
1.0
2.0
1.0
0
72.0
0
0
1
1
0
1
Apartamento
Es Mercadal , Playas de Fornells
0.0
Fin de la construcción 1985-01-01
Licencia Turística ET2888ME
1.0
1.0
1.0
0
46.0
0
0
0
0
0
0
Chalet
Ciutadella , Cala'n Bosch
850000.0
Fin de la construcción 1978-01-01
Licencia Turística ET0923ME
2.0
3.0
0
206.0
1
0
1
0
0
0
Chalet
Ciutadella , Cala Blanca
370000.0
Fin de la construcción 1974-06-07
1.0
3.0
0
64.0
1
0
Chalet
Ciutadella , Cap D'Artruitx
800000.0
190.0
Chalet
Sant Lluís , Binibeca Vell
1850000.0
4.0
6.0
2.0
0
316.0
Apartamento
Es Mercadal , Arenal d'en Castell
335000.0
Fin de la construcción 2004-01-01
Licencia Turística ET1915ME
2.0
3.0
1.0
1
99.84
19.58
1
1
1
1
1
1
Chalet
Ciutadella , Sa Caleta
970000.0
Fin de la construcción 2001-01-01
2.0
4.0
1.0
0
333.0
1
0
1
0
1
0
Chalet
Mahón / Maó , San Antonio - Cala Rata
2250000.0
Licencia Turística ET1062ME
4.0
4.0
0
240.0
1
0
0
0
Chalet
Es Mercadal , Addaia
595000.0
Fin de la construcción
3.0
4.0
0.0
1
170.0
0
0
1
0
1
1

Statistics

Average successful run time: less than a minute

Total run time: 2 minutes

Total cpu time used: less than 5 seconds

Total disk space used: 37 KB

History

  • Manually ran revision 70bca104 and completed successfully .
    16 records added in the database
  • Manually ran revision be4bbe9c and failed .
  • Manually ran revision be4bbe9c and failed .
  • Manually ran revision be4bbe9c and failed .
  • Manually ran revision e05a9f23 and failed .
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

inmo / scraper.rb