andela-ookoro / healthtools_ke

[morph] Scrapers for the HealthTools Kenya data.

Contributors Gathondu DavidLemayian andela-mabdussalam RyanSept

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... [Doctors Scraper] [2017-11-01 15:02:01] Started Scraper. [Doctors Scraper] [2017-11-01 15:02:01] Started Scraper. [Doctors Scraper] [2017-11-01 15:02:01] Started Scraper. [Doctors Scraper] [2017-11-01 15:02:01] Started Scraper. [2017-11-01 15:09:19] Archived: Data has been updated. [2017-11-01 15:09:19] - ERROR: elasticsearch_delete_docs() - SOURCE: DoctorsScraper - MESSAGE: ConnectionError(<urllib3.connection.HTTPConnection object at 0x7f249b221610>: Failed to establish a new connection: [Errno 111] Connection refused) caused by: NewConnectionError(<urllib3.connection.HTTPConnection object at 0x7f249b221610>: Failed to establish a new connection: [Errno 111] Connection refused) [2017-11-01 15:09:19] - ERROR: elasticsearch_index() - SOURCE: DoctorsScraper - MESSAGE: ConnectionError(<urllib3.connection.HTTPConnection object at 0x7f249b221a90>: Failed to establish a new connection: [Errno 111] Connection refused) caused by: NewConnectionError(<urllib3.connection.HTTPConnection object at 0x7f249b221a90>: Failed to establish a new connection: [Errno 111] Connection refused) [2017-11-01 15:09:19] Scraper completed. 7680 documents retrieved. [Foreign Doctors Scraper] [2017-11-01 15:09:19] Started Scraper. [2017-11-01 15:09:19] Archived: Data has been updated. [2017-11-01 15:09:19] - ERROR: elasticsearch_delete_docs() - SOURCE: DoctorsScraper - MESSAGE: ConnectionError(<urllib3.connection.HTTPConnection object at 0x7f249b221610>: Failed to establish a new connection: [Errno 111] Connection refused) caused by: NewConnectionError(<urllib3.connection.HTTPConnection object at 0x7f249b221610>: Failed to establish a new connection: [Errno 111] Connection refused) [2017-11-01 15:09:19] - ERROR: elasticsearch_index() - SOURCE: DoctorsScraper - MESSAGE: ConnectionError(<urllib3.connection.HTTPConnection object at 0x7f249b221a90>: Failed to establish a new connection: [Errno 111] Connection refused) caused by: NewConnectionError(<urllib3.connection.HTTPConnection object at 0x7f249b221a90>: Failed to establish a new connection: [Errno 111] Connection refused) [2017-11-01 15:09:19] Scraper completed. 7680 documents retrieved. [Foreign Doctors Scraper] [2017-11-01 15:09:19] Started Scraper. [2017-11-01 15:10:45] Archived: Data has been updated. [2017-11-01 15:10:45] - ERROR: elasticsearch_delete_docs() - SOURCE: ForeignDoctorsScraper - MESSAGE: ConnectionError(<urllib3.connection.HTTPConnection object at 0x7f249a8ab310>: Failed to establish a new connection: [Errno 111] Connection refused) caused by: NewConnectionError(<urllib3.connection.HTTPConnection object at 0x7f249a8ab310>: Failed to establish a new connection: [Errno 111] Connection refused) [2017-11-01 15:10:45] - ERROR: elasticsearch_index() - SOURCE: ForeignDoctorsScraper - MESSAGE: ConnectionError(<urllib3.connection.HTTPConnection object at 0x7f249a8ab510>: Failed to establish a new connection: [Errno 111] Connection refused) caused by: NewConnectionError(<urllib3.connection.HTTPConnection object at 0x7f249a8ab510>: Failed to establish a new connection: [Errno 111] Connection refused) [2017-11-01 15:10:45] Scraper completed. 1680 documents retrieved. [Clinical Officers Scraper] [2017-11-01 15:10:45] Started Scraper. [2017-11-01 15:10:47] - ERROR: scrape_page() - SOURCE: http://clinicalofficerscouncil.org/online-services/retention/?currpage=1 - MESSAGE: time data '05-01-89 00:00' does not match format '%d-%m-%Y' Traceback (most recent call last): File "scraper.py", line 40, in <module> clinical_officers_result = clinical_officers_scraper.run_scraper() File "/app/healthtools/scrapers/base_scraper.py", line 78, in run_scraper self.scrape_site() File "/app/healthtools/scrapers/base_scraper.py", line 104, in scrape_site results, results_es = self.scrape_page(url, 5) TypeError: 'NoneType' object is not iterable

Statistics

Total run time: 10 minutes

Total cpu time used: less than 5 seconds

Total disk space used: 2.75 MB

History

  • Manually ran revision 9b5d75f8 and failed .
    nothing changed in the database
  • Manually ran revision 9b5d75f8 and failed .
    nothing changed in the database
  • Created on morph.io

Scraper code

healthtools_ke