JamesFransham / airbnb_scraper-1

airbnb scraper

Last run failed with status code 1.

Console output of last run

https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=0&guests=1&items_per_page=20 new offset 20 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=20&guests=1&items_per_page=20 new offset 40 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=40&guests=1&items_per_page=20 new offset 60 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=60&guests=1&items_per_page=20 new offset 80 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=80&guests=1&items_per_page=20 new offset 100 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=100&guests=1&items_per_page=20 new offset 120 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=120&guests=1&items_per_page=20 new offset 140 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=140&guests=1&items_per_page=20 new offset 160 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=160&guests=1&items_per_page=20 new offset 180 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=180&guests=1&items_per_page=20 new offset 200 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=200&guests=1&items_per_page=20 new offset 220 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=220&guests=1&items_per_page=20 new offset 240 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=240&guests=1&items_per_page=20 new offset 260 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=260&guests=1&items_per_page=20 new offset 280 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=280&guests=1&items_per_page=20 new offset 300 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=300&guests=1&items_per_page=20 new offset 320 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=320&guests=1&items_per_page=20 new offset 340 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=340&guests=1&items_per_page=20 new offset 360 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=360&guests=1&items_per_page=20 new offset 380 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=380&guests=1&items_per_page=20 new offset 400 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=400&guests=1&items_per_page=20 new offset 420 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=420&guests=1&items_per_page=20 new offset 440 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=440&guests=1&items_per_page=20 new offset 460 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=460&guests=1&items_per_page=20 new offset 480 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=480&guests=1&items_per_page=20 new offset 500 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=500&guests=1&items_per_page=20 new offset 520 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=520&guests=1&items_per_page=20 new offset 540 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=540&guests=1&items_per_page=20 new offset 560 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=560&guests=1&items_per_page=20 new offset 580 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=580&guests=1&items_per_page=20 new offset 600 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=600&guests=1&items_per_page=20 new offset 620 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=620&guests=1&items_per_page=20 new offset 640 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=640&guests=1&items_per_page=20 new offset 660 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=660&guests=1&items_per_page=20 new offset 680 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=680&guests=1&items_per_page=20 new offset 700 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=700&guests=1&items_per_page=20 new offset 720 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=720&guests=1&items_per_page=20 new offset 740 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=740&guests=1&items_per_page=20 new offset 760 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=760&guests=1&items_per_page=20 new offset 780 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=780&guests=1&items_per_page=20 new offset 800 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=800&guests=1&items_per_page=20 new offset 820 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=820&guests=1&items_per_page=20 new offset 840 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=840&guests=1&items_per_page=20 new offset 860 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=860&guests=1&items_per_page=20 new offset 880 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=880&guests=1&items_per_page=20 new offset 900 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=900&guests=1&items_per_page=20 new offset 920 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=920&guests=1&items_per_page=20 new offset 940 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=940&guests=1&items_per_page=20 new offset 960 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=960&guests=1&items_per_page=20 new offset 980 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=980&guests=1&items_per_page=20 new offset 1000 https://m.airbnb.com/api/-/v1/listings/search?location=tokyo--japan&number_of_guests=1&offset=1000&guests=1&items_per_page=20 Traceback (most recent call last): File "/repo/scraper.py", line 69, in <module> ab.crawl() File "/repo/scraper.py", line 49, in crawl count = js['listings_count'] KeyError: 'listings_count'

Statistics

Total run time: about 9 hours

Total cpu time used: half a minute

Total disk space used: 313 KB

History

  • Manually ran revision 2081e058 and failed .
    986 records added in the database
  • Manually ran revision 0e4f218c and failed .
    997 records added in the database
  • Manually ran revision b5f1cb0d and failed .
    1000 records added in the database
  • Manually ran revision b5f1cb0d and failed .
    739 records removed in the database
  • Manually ran revision af7b3f84 and failed .
    739 records added in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

airbnb_scraper-1