openpolis / norme-net

Scraping italian laws in order to build a graph of all connections

Complete history

• Manually ran revision 06cd0264 and failed 2018-06-24.
  run time about 18 hours
  36700 records added, 1920 records removed in the database
  41493 pages scraped
• Manually ran revision 06cd0264 and failed 2017-01-10.
  run time 7 minutes
  462 records added, 139 records removed in the database
  984 pages scraped
• Manually ran revision 06cd0264 and failed 2017-01-10.
  run time 26 minutes
  1970 records added, 154 records removed in the database
  3211 pages scraped
• Manually ran revision 06cd0264 and failed 2017-01-10.
  run time 4 minutes
  397 records added, 12 records removed in the database
• Manually ran revision 06cd0264 and failed 2017-01-10.
  run time 4 minutes
  145 records added, 5 records removed in the database
  526 pages scraped
• Manually ran revision db283207 and failed 2017-01-10.
  run time about 2 hours
  19142 records added, 1781 records removed in the database
  15902 pages scraped
• Manually ran revision db283207 and failed 2017-01-09.
  run time 20 minutes
  2451 records added in the database
  2378 pages scraped
• Manually ran revision db283207 and failed 2017-01-09.
  run time 55 s
  81 records added, 81 records removed, 1602 records updated in the database
  20 pages scraped
• Manually ran revision 89b665f4 and completed successfully 2017-01-09.
  run time about 1 hour
  5614 records added in the database
  6047 pages scraped
• Manually ran revision 3c8e500c and failed 2017-01-09.
  run time 8 minutes
  1127 records added in the database
  943 pages scraped
• Manually ran revision 3c8e500c and failed 2017-01-09.
  run time 4 s
  nothing changed in the database
  1 page scraped
• Manually ran revision c523bc87 and failed 2017-01-09.
  run time 6 s
  nothing changed in the database
  6 pages scraped
• Manually ran revision d71667d4 and completed successfully 2017-01-09.
  run time about 3 hours
  29904 records added in the database
  23740 pages scraped
• Manually ran revision f8b194ed and completed successfully 2017-01-07.
  run time 2 minutes
  115 records added in the database
  112 pages scraped
• Created on morph.io 2017-01-06