DemocracyClub / womblr

Underground, overground, wombling free

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Python app detected [1G-----> Installing python-3.4.3 [1G $ pip install -r requirements.txt [1G Collecting git+https://github.com/polling-bot-4000/polling-bot.git (from -r /tmp/build/requirements.txt (line 4)) [1G Cloning https://github.com/polling-bot-4000/polling-bot.git to /tmp/pip-plr9dikc-build [1G Collecting python-dateutil (from -r /tmp/build/requirements.txt (line 1)) [1G Downloading python_dateutil-2.6.1-py2.py3-none-any.whl (194kB) [1G Collecting requests (from -r /tmp/build/requirements.txt (line 2)) [1G Downloading requests-2.18.4-py2.py3-none-any.whl (88kB) [1G Collecting scraperwiki==0.5.1 (from -r /tmp/build/requirements.txt (line 3)) [1G Downloading scraperwiki-0.5.1.tar.gz [1G Collecting six>=1.5 (from python-dateutil->-r /tmp/build/requirements.txt (line 1)) [1G Downloading six-1.11.0-py2.py3-none-any.whl [1G Collecting urllib3<1.23,>=1.21.1 (from requests->-r /tmp/build/requirements.txt (line 2)) [1G Downloading urllib3-1.22-py2.py3-none-any.whl (132kB) [1G Collecting idna<2.7,>=2.5 (from requests->-r /tmp/build/requirements.txt (line 2)) [1G Downloading idna-2.6-py2.py3-none-any.whl (56kB) [1G Collecting certifi>=2017.4.17 (from requests->-r /tmp/build/requirements.txt (line 2)) [1G Downloading certifi-2017.7.27.1-py2.py3-none-any.whl (349kB) [1G Collecting chardet<3.1.0,>=3.0.2 (from requests->-r /tmp/build/requirements.txt (line 2)) [1G Downloading chardet-3.0.4-py2.py3-none-any.whl (133kB) [1G Collecting sqlalchemy (from scraperwiki==0.5.1->-r /tmp/build/requirements.txt (line 3)) [1G Downloading SQLAlchemy-1.1.14.tar.gz (5.2MB) [1G Collecting alembic (from scraperwiki==0.5.1->-r /tmp/build/requirements.txt (line 3)) [1G Downloading alembic-0.9.6.tar.gz (998kB) [1G Collecting Mako (from alembic->scraperwiki==0.5.1->-r /tmp/build/requirements.txt (line 3)) [1G Downloading Mako-1.0.7.tar.gz (564kB) [1G Collecting python-editor>=0.3 (from alembic->scraperwiki==0.5.1->-r /tmp/build/requirements.txt (line 3)) [1G Downloading python-editor-1.0.3.tar.gz [1G Collecting MarkupSafe>=0.9.2 (from Mako->alembic->scraperwiki==0.5.1->-r /tmp/build/requirements.txt (line 3)) [1G Downloading MarkupSafe-1.0.tar.gz [1G Installing collected packages: six, python-dateutil, urllib3, idna, certifi, chardet, requests, sqlalchemy, MarkupSafe, Mako, python-editor, alembic, scraperwiki, polling-bot [1G Running setup.py install for sqlalchemy: started [1G Running setup.py install for sqlalchemy: finished with status 'done' [1G Running setup.py install for MarkupSafe: started [1G Running setup.py install for MarkupSafe: finished with status 'done' [1G Running setup.py install for Mako: started [1G Running setup.py install for Mako: finished with status 'done' [1G Running setup.py install for python-editor: started [1G Running setup.py install for python-editor: finished with status 'done' [1G Running setup.py install for alembic: started [1G Running setup.py install for alembic: finished with status 'done' [1G Running setup.py install for scraperwiki: started [1G Running setup.py install for scraperwiki: finished with status 'done' [1G Running setup.py install for polling-bot: started [1G Running setup.py install for polling-bot: finished with status 'done' [1G Successfully installed Mako-1.0.7 MarkupSafe-1.0 alembic-0.9.6 certifi-2017.7.27.1 chardet-3.0.4 idna-2.6 polling-bot-0.0.0 python-dateutil-2.6.1 python-editor-1.0.3 requests-2.18.4 scraperwiki-0.5.1 six-1.11.0 sqlalchemy-1.1.14 urllib3-1.22 [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... Nothing to do today, but here's the results from the last run.. ===== :rotating_light: *Elections happening in the next month* :alarm_clock: 19/10/2017: <https://candidates.democracyclub.org.uk/election/local.city-of-lincoln.2017-10-19/post/DIW:E05010787|City of Lincoln local election - Carholme>. known candidates: 4 :lock: 19/10/2017: <https://candidates.democracyclub.org.uk/election/local.epping-forest.2017-10-19/post/DIW:E05004167|Epping Forest local election - Lower Sheering>. known candidates: 2 :lock: 19/10/2017: <https://candidates.democracyclub.org.uk/election/local.gravesham.2017-10-19/post/DIW:E05004969|Gravesham local election - Meopham North>. known candidates: 4 :lock: 19/10/2017: <https://candidates.democracyclub.org.uk/election/local.hartlepool.2017-10-19/constituencies|Hartlepool local election>. known candidates: 0 :womble: required 19/10/2017: <https://candidates.democracyclub.org.uk/election/local.nottingham.2017-10-19/post/UTW:E05001826|Nottingham local election - Bestwood>. known candidates: 6 :lock: 19/10/2017: <https://candidates.democracyclub.org.uk/election/local.south-oxfordshire.2017-10-19/constituencies|South Oxfordshire local election>. known candidates: 0 :womble: required 19/10/2017: <https://candidates.democracyclub.org.uk/election/local.wigan.2017-10-19/post/MTW:E05000843|Wigan local election - Astley Mosley Common>. known candidates: 5 :lock: 26/10/2017: <https://candidates.democracyclub.org.uk/election/local.charnwood.2017-10-26/constituencies|Charnwood local election>. known candidates: 0 :womble: required 26/10/2017: <https://candidates.democracyclub.org.uk/election/local.derbyshire-dales.2017-10-26/constituencies|Derbyshire Dales local election>. known candidates: 0 :womble: required 26/10/2017: <https://candidates.democracyclub.org.uk/election/local.herefordshire.2017-10-26/constituencies|Herefordshire local election>. known candidates: 0 :womble: required 26/10/2017: <https://candidates.democracyclub.org.uk/election/local.kirklees.2017-10-26/post/MTW:E05001390|Kirklees local election - Batley East>. known candidates: 5 :lock: 26/10/2017: <https://candidates.democracyclub.org.uk/election/local.mid-sussex.2017-10-26/constituencies|Mid Sussex local election>. known candidates: 0 :womble: required 26/10/2017: <https://candidates.democracyclub.org.uk/election/local.tameside.2017-10-26/constituencies|Tameside local election>. known candidates: 0 :womble: required 02/11/2017: <https://candidates.democracyclub.org.uk/election/local.arun.2017-11-02/constituencies|Arun local election>. known candidates: 0 :womble: required 02/11/2017: <https://candidates.democracyclub.org.uk/election/local.buckinghamshire.2017-11-02/constituencies|Buckinghamshire local election>. known candidates: 0 :womble: required 02/11/2017: <https://candidates.democracyclub.org.uk/election/local.copeland.2017-11-02/constituencies|Copeland Borough Council>. known candidates: 0 :womble: required 02/11/2017: <https://candidates.democracyclub.org.uk/election/local.north-devon.2017-11-02/constituencies|North Devon local election>. known candidates: 0 :womble: required 02/11/2017: <https://candidates.democracyclub.org.uk/election/local.sefton.2017-11-02/constituencies|Sefton local election>. known candidates: 0 :womble: required 02/11/2017: <https://candidates.democracyclub.org.uk/election/local.south-bucks.2017-11-02/constituencies|South Bucks local election>. known candidates: 0 :womble: required 09/11/2017: <https://candidates.democracyclub.org.uk/election/local.camden.2017-11-09/constituencies|Camden local election>. known candidates: 0 :womble: required 09/11/2017: <https://candidates.democracyclub.org.uk/election/local.fareham.2017-11-09/constituencies|Fareham local election>. known candidates: 0 :womble: required 09/11/2017: <https://candidates.democracyclub.org.uk/election/local.flintshire.2017-11-09/constituencies|Flintshire local election>. known candidates: 0 :womble: required 09/11/2017: <https://candidates.democracyclub.org.uk/election/local.wandsworth.2017-11-09/constituencies|Wandsworth local election>. known candidates: 0 :womble: required 16/11/2017: <https://candidates.democracyclub.org.uk/election/local.west-lindsey.2017-11-16/constituencies|West Lindsey local election>. known candidates: 0 :womble: required

Data

Downloaded 0 times

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (74 KB) Use the API

rows 10 / 238

name timestamp known_candidates url id poll_open_date locked post_id
Babergh local election
2017-08-18T15:30:53+00:00
0
https://candidates.democracyclub.org.uk/election/local.babergh.2017-09-07/constituencies
local.babergh.2017-09-07
2017-09-07
Cannock Chase local election
2017-08-18T15:30:53+00:00
0
https://candidates.democracyclub.org.uk/election/local.cannock-chase.2017-09-07/constituencies
local.cannock-chase.2017-09-07
2017-09-07
Colchester local election
2017-08-18T15:30:53+00:00
0
https://candidates.democracyclub.org.uk/election/local.colchester.2017-09-07/constituencies
local.colchester.2017-09-07
2017-09-07
Croydon local election
2017-08-18T15:30:53+00:00
0
https://candidates.democracyclub.org.uk/election/local.croydon.2017-09-07/constituencies
local.croydon.2017-09-07
2017-09-07
East Cambridgeshire local election
2017-08-18T15:30:53+00:00
0
https://candidates.democracyclub.org.uk/election/local.east-cambridgeshire.2017-09-07/constituencies
local.east-cambridgeshire.2017-09-07
2017-09-07
Glasgow City local election
2017-08-18T15:30:53+00:00
0
https://candidates.democracyclub.org.uk/election/local.glasgow-city.2017-09-07/constituencies
local.glasgow-city.2017-09-07
2017-09-07
Herefordshire local election
2017-08-18T15:30:53+00:00
0
https://candidates.democracyclub.org.uk/election/local.herefordshire.2017-09-07/constituencies
local.herefordshire.2017-09-07
2017-09-07
Lancaster local election
2017-08-18T15:30:53+00:00
0
https://candidates.democracyclub.org.uk/election/local.lancaster.2017-09-07/constituencies
local.lancaster.2017-09-07
2017-09-07
Lewes local election
2017-08-18T15:30:53+00:00
0
https://candidates.democracyclub.org.uk/election/local.lewes.2017-09-07/constituencies
local.lewes.2017-09-07
2017-09-07
Mid Devon local election
2017-08-18T15:30:53+00:00
0
https://candidates.democracyclub.org.uk/election/local.mid-devon.2017-09-14/constituencies
local.mid-devon.2017-09-14
2017-09-14

Statistics

Average successful run time: 1 minute

Total run time: about 1 hour

Total cpu time used: less than a minute

Total disk space used: 107 KB

History

  • Auto ran revision 346240d5 and completed successfully .
    nothing changed in the database
  • Auto ran revision 346240d5 and completed successfully .
    nothing changed in the database
  • Auto ran revision 8512ddd8 and completed successfully .
    nothing changed in the database
  • Auto ran revision 8512ddd8 and completed successfully .
    nothing changed in the database
  • Auto ran revision 8512ddd8 and completed successfully .
    24 records added in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

womblr