sicvermilion / airbnb_scraper

airbnb scraper

Last run failed with status code 1.

Console output of last run

https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=0&guests=1&items_per_page=20 new offset 20 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=20&guests=1&items_per_page=20 new offset 40 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=40&guests=1&items_per_page=20 new offset 60 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=60&guests=1&items_per_page=20 new offset 80 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=80&guests=1&items_per_page=20 new offset 100 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=100&guests=1&items_per_page=20 new offset 120 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=120&guests=1&items_per_page=20 new offset 140 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=140&guests=1&items_per_page=20 new offset 160 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=160&guests=1&items_per_page=20 new offset 180 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=180&guests=1&items_per_page=20 new offset 200 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=200&guests=1&items_per_page=20 new offset 220 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=220&guests=1&items_per_page=20 new offset 240 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=240&guests=1&items_per_page=20 new offset 260 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=260&guests=1&items_per_page=20 new offset 280 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=280&guests=1&items_per_page=20 new offset 300 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=300&guests=1&items_per_page=20 new offset 320 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=320&guests=1&items_per_page=20 new offset 340 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=340&guests=1&items_per_page=20 new offset 360 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=360&guests=1&items_per_page=20 new offset 380 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=380&guests=1&items_per_page=20 new offset 400 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=400&guests=1&items_per_page=20 new offset 420 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=420&guests=1&items_per_page=20 new offset 440 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=440&guests=1&items_per_page=20 new offset 460 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=460&guests=1&items_per_page=20 new offset 480 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=480&guests=1&items_per_page=20 new offset 500 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=500&guests=1&items_per_page=20 new offset 520 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=520&guests=1&items_per_page=20 new offset 540 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=540&guests=1&items_per_page=20 new offset 560 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=560&guests=1&items_per_page=20 new offset 580 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=580&guests=1&items_per_page=20 new offset 600 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=600&guests=1&items_per_page=20 new offset 620 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=620&guests=1&items_per_page=20 new offset 640 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=640&guests=1&items_per_page=20 new offset 660 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=660&guests=1&items_per_page=20 new offset 680 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=680&guests=1&items_per_page=20 new offset 700 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=700&guests=1&items_per_page=20 new offset 720 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=720&guests=1&items_per_page=20 new offset 740 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=740&guests=1&items_per_page=20 new offset 760 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=760&guests=1&items_per_page=20 new offset 780 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=780&guests=1&items_per_page=20 new offset 800 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=800&guests=1&items_per_page=20 new offset 820 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=820&guests=1&items_per_page=20 new offset 840 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=840&guests=1&items_per_page=20 new offset 860 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=860&guests=1&items_per_page=20 new offset 880 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=880&guests=1&items_per_page=20 new offset 900 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=900&guests=1&items_per_page=20 new offset 920 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=920&guests=1&items_per_page=20 new offset 940 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=940&guests=1&items_per_page=20 new offset 960 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=960&guests=1&items_per_page=20 new offset 980 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=980&guests=1&items_per_page=20 new offset 1000 https://m.airbnb.com/api/-/v1/listings/search?location=Bali--Indonesia&number_of_guests=1&offset=1000&guests=1&items_per_page=20 Traceback (most recent call last): File "/repo/scraper.py", line 69, in <module> ab.crawl() File "/repo/scraper.py", line 49, in crawl count = js['listings_count'] KeyError: 'listings_count'

Data

Downloaded 6 times by EddieHomie MikeRalphson dacamp

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (274 KB) Use the API

rows 10 / 994

city picture_count bedrooms user_id name price_native price picture_url smart_location zipcode state address lat lng property_type id room_type room_type_category
Singaraja
35
2
6319357
NEW VILLA PRIVATE POOL, NORTH BALI
139
139
https://a0.muscache.com/pictures/42044264/large.jpg
Singaraja, Indonesia
Bali
Singaraja, Bali, Indonesia
-8.097819468884486
115.21888548198237
Villa
1873760
Entire home/apt
entire_home
Kuta
21
1
4378957
Kuta EcoStay- for budget travellers
29
28
https://a1.muscache.com/pictures/12296715/large.jpg
Kuta, Indonesia
80361
Bali
Jalan Pantai, Kuta, Bali 80361, Indonesia
-8.722203382521956
115.17460473457483
Villa
858437
Private room
private_room
North Kuta
67
3
12046178
Luxury Villa Prana near beach/pool
169
169
https://a1.muscache.com/pictures/34054479/large.jpg
North Kuta, Indonesia
80361
Bali
Jalan Raya Semat, North Kuta, Bali 80361, Indonesia
-8.653639323723345
115.14223536397604
Villa
2358767
Entire home/apt
entire_home
Badung
22
2
10304534
kubu bingin
80
80
https://a2.muscache.com/pictures/38968111/large.jpg
Badung, Indonesia
80364
Bali
Jl pantai Bingin, pecatu, Badung, Bali 80364, Indonesia
-8.807679934245842
115.11081449458636
Hut
2505182
Entire home/apt
entire_home
Abang
29
1
5915396
Stunning 180°Ocean view rooms &pool
56
54
https://a2.muscache.com/pictures/23511349/large.jpg
Abang, Indonesia
80852
Bali
Abang, Bali 80852, Indonesia
-8.357281698120604
115.69397017620756
Bed & Breakfast
1075199
Private room
private_room
Gianyar
30
1
8682340
Beachfront large tranquil apartment
33
32
https://a2.muscache.com/pictures/40050836/large.jpg
Gianyar, Indonesia
80515
Bali
Gianyar, Bali 80515, Indonesia
-8.58194498680858
115.35292424891294
Apartment
1634455
Entire home/apt
entire_home
Denpasar
21
1
8950304
Little tree House sanur suite D
45
45
https://a1.muscache.com/pictures/34431100/large.jpg
Denpasar , Indonesia
80227
Bali
Jalan Mertasari, Denpasar , Bali 80227, Indonesia
-8.711098451773747
115.25198877301975
Chalet
1694711
Private room
private_room
Manggis
20
1
2875281
Bamboo House on the beach Candidasa
50
50
https://a0.muscache.com/pictures/9218578/large.jpg
Manggis, Indonesia
Bali
Jalan Raya Candidasa, Manggis, Bali, Indonesia
-8.504670316220004
115.55879487595325
House
614417
Entire home/apt
entire_home
Seminyak
22
1
5273290
Single Room 7mns Walk From Beach!
26
25
https://a1.muscache.com/pictures/29062848/large.jpg
Seminyak, Indonesia
80361
Bali
Gang Bima No. 5, Pondok Wisata Kari Suci, Seminyak, Bali 80361, Indonesia
-8.69170642135781
115.16522370556349
Villa
966628
Private room
private_room
South Kuta
11
1
8555523
Rooms with AC/POOL JIMBARAN BEACH1
34
33
https://a1.muscache.com/pictures/27841894/large.jpg
South Kuta, Indonesia
80361
Bali
South Kuta, Bali 80361, Indonesia
-8.770315586194435
115.17158357057254
Bed & Breakfast
1605915
Private room
private_room

Statistics

Average successful run time: 2 minutes

Total run time: about 2 hours

Total cpu time used: less than 10 seconds

Total disk space used: 301 KB

History

  • Manually ran revision 9ae1b20a and failed .
    994 records added in the database
  • Manually ran revision 28da693f and completed successfully .
    35 records added in the database
  • Manually ran revision 1583c11f and failed .
    nothing changed in the database
  • Manually ran revision 1583c11f and failed .
    nothing changed in the database
  • Manually ran revision 1583c11f and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

airbnb_scraper