adrianshort / inlink-scraper

Scrapes planning applications data for BT InLink kiosks

Complete history

• Auto ran revision 21862a4c and completed successfully 2019-02-04.
  run time 2 minutes
  nothing changed in the database
• Auto ran revision e3bd2840 and failed 2019-02-04.
  run time about 2 months
  79 records added, 79 records removed in the database
  119 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-12-18.
  run time about 7 hours
  1406 records added, 1406 records removed in the database
  2144 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-12-17.
  run time about 7 hours
  1410 records added, 1410 records removed in the database
  2142 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-12-16.
  run time about 6 hours
  1119 records added, 1119 records removed in the database
  1760 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-12-16.
  run time about 7 hours
  1403 records added, 1403 records removed in the database
  2130 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-12-14.
  run time about 7 hours
  1409 records added, 1409 records removed in the database
  2147 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-12-13.
  run time about 7 hours
  1416 records added, 1411 records removed in the database
  2139 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-12-12.
  run time about 7 hours
  1404 records added, 1404 records removed in the database
  2139 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-12-11.
  run time about 8 hours
  1405 records added, 1402 records removed in the database
  2144 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-12-11.
  run time about 7 hours
  1352 records added, 1348 records removed in the database
  2079 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-12-10.
  run time about 7 hours
  1397 records added, 1397 records removed in the database
  2132 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-12-08.
  run time about 7 hours
  1385 records added, 1385 records removed in the database
  2127 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-12-07.
  run time about 7 hours
  1407 records added, 1395 records removed in the database
  2132 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-12-07.
  run time about 7 hours
  1383 records added, 1368 records removed in the database
• Auto ran revision e3bd2840 and completed successfully 2018-12-05.
  run time about 7 hours
  1271 records added, 1271 records removed in the database
  2055 pages scraped
• Manually ran revision e3bd2840 and completed successfully 2018-12-04.
  run time about 7 hours
  1345 records added, 1319 records removed in the database
• Auto ran revision e3bd2840 and completed successfully 2018-12-04.
  run time 11 days
  1243 records added, 1221 records removed in the database
  1967 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-11-22.
  run time about 6 hours
  1264 records added, 1263 records removed in the database
  1996 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-11-21.
  run time about 6 hours
  1263 records added, 1263 records removed in the database
  2039 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-11-20.
  run time about 7 hours
  1226 records added, 1226 records removed in the database
  1937 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-11-19.
  run time about 6 hours
  1277 records added, 1277 records removed in the database
  1997 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-11-18.
  run time about 6 hours
  1209 records added, 1209 records removed in the database
• Auto ran revision e3bd2840 and completed successfully 2018-11-17.
  run time about 6 hours
  1240 records added, 1240 records removed in the database
  1951 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-11-16.
  run time about 7 hours
  1329 records added, 1329 records removed in the database
  2051 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-11-15.
  run time about 7 hours
  1320 records added, 1314 records removed in the database
  2051 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-11-15.
  run time about 7 hours
  1282 records added, 1271 records removed in the database
  2011 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-11-14.
  run time about 6 hours
  1172 records added, 1172 records removed in the database
  1971 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-11-12.
  run time about 6 hours
  1304 records added, 1304 records removed in the database
• Auto ran revision e3bd2840 and completed successfully 2018-11-11.
  run time about 6 hours
  1285 records added, 1285 records removed in the database
• Auto ran revision e3bd2840 and completed successfully 2018-11-10.
  run time about 6 hours
  1044 records added, 1044 records removed in the database
  1862 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-11-10.
  run time about 6 hours
  1288 records added, 1281 records removed in the database
• Auto ran revision e3bd2840 and completed successfully 2018-11-08.
  run time about 7 hours
  1022 records added, 1022 records removed in the database
  1874 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-11-08.
  run time about 6 hours
  1316 records added, 1316 records removed in the database
  2029 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-11-06.
  run time about 6 hours
  1302 records added, 1302 records removed in the database
  2009 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-11-06.
  run time about 6 hours
  1276 records added, 1276 records removed in the database
  2001 pages scraped
• Manually ran revision e3bd2840 and completed successfully 2018-11-05.
  run time about 7 hours
  1299 records added, 1299 records removed in the database
  2003 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-11-04.
  run time about 6 hours
  1299 records added, 1299 records removed in the database
  2009 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-11-03.
  run time about 6 hours
  1285 records added, 1285 records removed in the database
  1992 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-11-02.
  run time about 6 hours
  1197 records added, 1197 records removed in the database
  1914 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-11-01.
  run time about 7 hours
  1293 records added, 1287 records removed in the database
  2007 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-11-01.
  run time about 6 hours
  1217 records added, 1194 records removed in the database
• Auto ran revision e3bd2840 and completed successfully 2018-10-30.
  run time about 7 hours
  1295 records added, 1289 records removed in the database
  2007 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-10-29.
  run time about 7 hours
  1198 records added, 1184 records removed in the database
  1901 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-10-28.
  run time about 6 hours
  1210 records added, 1210 records removed in the database
  1905 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-10-27.
  run time about 6 hours
  1269 records added, 1268 records removed in the database
  1981 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-10-26.
  run time about 7 hours
  1253 records added, 1226 records removed in the database
• Auto ran revision e3bd2840 and completed successfully 2018-10-25.
  run time about 7 hours
  1236 records added, 1236 records removed in the database
  1903 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-10-24.
  run time about 6 hours
  1227 records added, 1227 records removed in the database
• Auto ran revision e3bd2840 and completed successfully 2018-10-23.
  run time about 6 hours
  1231 records added, 1231 records removed in the database
  1930 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-10-22.
  run time about 6 hours
  1281 records added, 1281 records removed in the database
  1947 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-10-20.
  run time about 6 hours
  1259 records added, 1238 records removed in the database
  1927 pages scraped
• Auto ran revision e3bd2840 and completed successfully 2018-10-19.
  run time about 6 hours
  1260 records added, 1198 records removed in the database
  1942 pages scraped
• Auto ran revision f8422bcf and completed successfully 2018-10-18.
  run time about 6 hours
  1205 records added, 1134 records removed in the database
  1727 pages scraped
• Auto ran revision 680e002d and completed successfully 2018-10-17.
  run time about 5 hours
  890 records added, 890 records removed in the database
  1572 pages scraped
• Auto ran revision 680e002d and completed successfully 2018-10-17.
  run time about 5 hours
  1099 records added, 1071 records removed in the database
  1641 pages scraped
• Auto ran revision 7a73c616 and completed successfully 2018-10-15.
  run time about 5 hours
  1056 records added, 1056 records removed in the database
  1546 pages scraped
• Auto ran revision 7a73c616 and completed successfully 2018-10-14.
  run time about 5 hours
  1069 records added, 1069 records removed in the database
  1562 pages scraped
• Auto ran revision 7a73c616 and completed successfully 2018-10-14.
  run time about 5 hours
  1066 records added, 1009 records removed in the database
  1559 pages scraped
• Auto ran revision ca0fa0dd and completed successfully 2018-10-12.
  run time about 4 hours
  816 records added, 814 records removed in the database
• Auto ran revision ca0fa0dd and completed successfully 2018-10-11.
  run time about 5 hours
  1067 records added, 1052 records removed in the database
  1539 pages scraped
• Manually ran revision ca0fa0dd and failed 2018-10-10.
  run time 12 minutes
  31 records added in the database
  57 pages scraped
• Auto ran revision 54fc32de and completed successfully 2018-10-10.
  run time about 5 hours
  1024 records added, 994 records removed in the database
  1377 pages scraped
• Auto ran revision 54fc32de and completed successfully 2018-10-09.
  run time about 4 hours
  974 records added, 963 records removed in the database
• Auto ran revision 54fc32de and completed successfully 2018-10-08.
  run time about 4 hours
  745 records added, 739 records removed in the database
  812 pages scraped
• Manually ran revision 54fc32de and completed successfully 2018-10-07.
  run time about 4 hours
  980 records added, 980 records removed in the database
  1322 pages scraped
• Auto ran revision 54fc32de and failed 2018-10-07.
  run time 58 s
  nothing changed in the database
• Auto ran revision 54fc32de and completed successfully 2018-10-06.
  run time about 4 hours
  933 records added, 922 records removed in the database
  1268 pages scraped
• Manually ran revision 54fc32de and completed successfully 2018-10-05.
  run time about 5 hours
  971 records added, 967 records removed in the database
• Auto ran revision 2c229a0d and failed 2018-10-05.
  run time about 1 hour
  187 records added, 187 records removed in the database
  208 pages scraped
• Auto ran revision 2c229a0d and completed successfully 2018-10-05.
  run time about 4 hours
  966 records added, 966 records removed in the database
  1293 pages scraped
• Auto ran revision 2c229a0d and completed successfully 2018-10-03.
  run time about 4 hours
  959 records added, 959 records removed in the database
• Auto ran revision 2c229a0d and failed 2018-10-02.
  run time 16 minutes
  32 records added, 32 records removed in the database
  64 pages scraped
• Manually ran revision a8732d66 and completed successfully 2018-10-02.
  run time about 5 hours
  929 records added, 929 records removed in the database
  1293 pages scraped
• Manually ran revision 18613b7b and completed successfully 2018-10-02.
  run time 2 minutes
  8 records added, 8 records removed in the database
  10 pages scraped
• Manually ran revision 5e51a2ea and failed 2018-10-02.
  run time about 3 hours
  187 records added, 187 records removed in the database
  208 pages scraped
• Auto ran revision 5e51a2ea and completed successfully 2018-10-01.
  run time about 4 hours
  967 records added, 930 records removed in the database
  1295 pages scraped
• Manually ran revision 5e51a2ea and completed successfully 2018-09-30.
  run time about 4 hours
  933 records added in the database
  1254 pages scraped
• Manually ran revision 04750474 and failed 2018-09-30.
  run time 43 minutes
  148 records added, 148 records removed in the database
  182 pages scraped
• Manually ran revision 48359473 and completed successfully 2018-09-20.
  run time about 4 hours
  920 records added, 675 records removed in the database
• Manually ran revision 3eab867c and failed 2018-09-20.
  run time 29 minutes
  33 records added, 33 records removed in the database
• Manually ran revision 3eab867c and failed 2018-09-20.
  run time about 3 hours
  675 records added, 125 records removed in the database
  901 pages scraped
• Manually ran revision a2d68580 and failed 2018-09-19.
  run time 39 minutes
  125 records added in the database
  148 pages scraped
• Manually ran revision 6c346d60 and completed successfully 2018-09-17.
  run time 2 minutes
  140 records added, 39 records removed in the database
  21 pages scraped
• Manually ran revision bfb71972 and failed 2018-09-17.
  run time 41 s
  826 records added in the database
  12 pages scraped
• Manually ran revision bfb71972 and failed 2018-09-17.
  run time 2 minutes
  33 records added, 32 records removed in the database
  12 pages scraped
• Manually ran revision f1f83c79 and failed 2018-09-17.
  run time 3 minutes
  40 records added, 8 records removed in the database
  17 pages scraped
• Manually ran revision b6eeba38 and completed successfully 2018-09-17.
  run time 1 minute
  6 records added in the database
  3 pages scraped
• Manually ran revision 164ffc16 and completed successfully 2018-09-16.
  run time 20 minutes
  60 records added, 60 records removed in the database
• Manually ran revision 5ab29ba5 and failed 2018-09-16.
  run time 53 s
  nothing changed in the database
• Manually ran revision 5675ae4e and failed 2018-09-16.
  run time 42 minutes
  143 records added, 143 records removed in the database
• Manually ran revision 1936fa37 and failed 2018-09-16.
  run time about 2 hours
  276 records added, 276 records removed in the database
  586 pages scraped
• Manually ran revision 2f92d43a and failed 2018-09-16.
  run time about 2 hours
  303 records added, 303 records removed in the database
• Manually ran revision 955f91bd and failed 2018-09-16.
  run time 5 minutes
  13 records added, 13 records removed, 774 records updated in the database
  18 pages scraped
• Manually ran revision a2001fe1 and completed successfully 2018-09-15.
  run time 21 minutes
  787 records added, 522 records removed in the database
  141 pages scraped
• Manually ran revision 468a647a and failed 2018-09-15.
  run time 36 s
  nothing changed in the database
• Manually ran revision a2bdc6cb and failed 2018-09-15.
  run time 5 minutes
  160 records added, 160 records removed in the database
  31 pages scraped
• Manually ran revision 5cb8f0f3 and completed successfully 2018-09-14.
  run time 14 minutes
  522 records added in the database
  91 pages scraped
• Manually ran revision 16656594 and failed 2018-09-14.
  run time 22 s
• Created on morph.io 2018-09-14