JessiQ711 / myfirstscraper

Scrapes foo.com and www.foo.com

Foo.com

Contributors JessiQ711

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Hello ['<!DOCTYPE html>\n<html data-adblockkey=\'MFwwDQYJKoZIhvcNAQEBBQADSwAwSAJBAL/3/SrV7P8AsTHMFSpPmYbyv2PkACHwmG9Z+1IFZq3vA54IN7pQcGnhgNo+8SN9r/KtUWCb9OPqTfWM1N4w/EUCAwEAAQ==_SWSZ/a887qeNgDyR88V/HpagDd3mJsrqq9QAOtr60lLTbm6U8aRlziJpuHLWpAnAP7Knt5Cp4voX6zE0ZRJ4kw==\'>\n<head>\n\n\n<meta charset=\'UTF-8\'>\n<title>Foo.com</title>\n<link href=\'data:image/png;base64,iVBORw0KGgo=\' rel=\'icon\' type=\'image/png\'>\n<link href="/assets/style-85cdb3be1709c9028b204b38f8ccb358.css" media="none" onload="if(media!==&#x27;all&#x27;)media=&#x27;all&#x27;" rel="stylesheet" type="text/css" />\n<link href="/assets/belt_layout_caf-4a3dea87ed4a809b49d0640b48d26654.css" media="none" onload="if(media!==&#x27;all&#x27;)media=&#x27;all&#x27;" rel="stylesheet" type="text/css" />\n<script src="///code.jquery.com/jquery-3.3.1.min.js" type="text/javascript"></script>\n<!-- = stylesheet_link_tag "/load_style", :media => "all" -->\n<meta content="authenticity_token" name="csrf-param" />\n<meta content="5hCvSZJsKJf9sl/hM7MWaoNdjQ8olm2Kj7T3dk8ZFyc=" name="csrf-token" />\n<style>\na, .ourterm a{\n\tcolor: #00c;\n}\n\n.background1{\n\tbackground-color: #ccc;\n}\n\n.background2{\n\tbackground-color: #aaa;\n}\n\n.divider_background{\n\tbackground-color: #aaa;\n}\n\n\n</style>\n\n</head>\n<body>\n<script async="async" src="/assets/application-ea87d7f1cf81efea754ac69b6a6922a8.js" type="text/javascript"></script>\n\n\n\n\n<center>\n<div id=\'outer_container\'>\n<div id=\'outer_container2\'>\n<div id=\'container\'>\n<div id=\'header\'>\n<div class=\'logo\'>\n<a href="/">Foo.com</a>\n</div>\n<div class=\'googleframe\' id=\'header_image\'></div>\n</div>\n\n\n\n\n\n\n\n<div id=\'main\'>\n<div class=\'image\'>\n<img alt="Cordovabeach" border="0" src="/media/W1siZiIsIjIwMTIvMDQvMjYvMjAvMTEvNDkvNDI2L2NvcmRvdmFiZWFjaC5qcGciXSxbInAiLCJ0aHVtYiIsIjc1MHgyMDAjIl1d/cordovabeach.jpg" /></div>\n<div class=\'search\'>\n<div class=\'catch_phrase\'>\n<div id=\'wysiwyg_id_322\' class=\'mercury-region\' data-type=\'editable\'>Search FOO.com\n</div>\n</div>\n<div class=\'googleframe\' id=\'search\'></div>\n</div>\n</div>\n<script>\nvar searchblock1 = {\n \'type\' : \'searchbox\',\n \'container\' : \'search\',\n \'widthSearchButton\' : 100,\n \'searchBoxMethod\' : \'get\'\n};\n</script>\n\n<div id=\'footer\'>\n<a href=\'/digimedia_privacy_policy.html\' target=\'_blank\'>Privacy Policy</a>\n - \nCopyright &copy; 2019 Digimedia.com, L.P.\n</div>\n\n</div>\n\n</div>\n</div>\n</center>\n<script src="/assets/abp2-4831d5b24977f8140fd9aa25543527f2.js" type="text/javascript"></script>\n<script src="/assets/ads-832e97bfd2d3e735f6dc8a30dd7190bc.js" type="text/javascript"></script>\n<!-- %script{:type=>"text/javascript", :language=>"JavaScript", :src=>"/abp.js"} -->\n<script language=\'JavaScript\' src=\'///www.google.com/adsense/domains/caf.js\' type=\'text/javascript\'></script>\n<script>\n function jscript_log(name, severity, message, page){\n $.ajax({\n type: "POST",\n url: "/log_error",\n data: {\n name: name,\n severity: severity,\n domain: window.location.hostname,\n message: message,\n tag: \'dp-digimedia_js\',\n page: page\n },\n context: document.body\n })\n }\n</script>\n<script>\nfunction google_index_loaded(requestAccepted, status) {\n if(!requestAccepted){\n console.log(\'failed: \' + requestAccepted);\n jscript_log(\'faillisted\', 10, JSON.stringify(status), "/")\n }\n console.log(\'status: \');\n console.log(status);\n}\nvar pageOptions = {\n\'pubId\' : \'dp-digimedia_js\',\n\'kw\': \'foo\',\n\'domainRegistrant\': \'as-drid-oo-1626960400946279\',\n\n\'resultsPageBaseUrl\': \'///www.foo.com/results?\',\n\'channel\': \'digi-caf_pef,digimedia-template-09\',\n\'adtest\' : false,\n\'optimizeTerms\': true,\n\'terms\': \'\',\n\n\n\'colorAttribution\' : \'black\',\n\n\'fontFamilyAttribution\' : \'arial\',\n\'fontSizeAttribution\' : 12,\n\'attributionBold\' : false,\n\'fontSizeTitle\' : 16,\n\'fontSizeDescription\' : 12,\n\'lineHeightTitle\' : 22,\n\'attributionBold\' : false,\n\'numRepeated\' : 3,\n\'pageLoadedCallback\' : google_index_loaded,\n\'colorTitleLink\' : \'#00c\',\n\'colorDomainLink\' : \'green\',\n\'noTitleUnderline\' : false\n}\n</script>\n\n<script>new google.ads.domains.Caf(pageOptions, searchblock1);AdblockPlus.detect(\'/px.gif\', function(usesABP){console.log(\'usesABP:\' + usesABP);if(usesABP){blocked_ads_logger(\'whitelisted\');}else{if(adsblocked()){blocked_ads_logger(\'blocked\');}else{blocked_ads_logger(\'not_blocked\');}}});</script>\n\n<!-- Global site tag (gtag.js) - Google Analytics -->\n<script async src=\'https://www.googletagmanager.com/gtag/js?id=UA-1726084-83\'></script>\n<script>\n window.dataLayer = window.dataLayer || [];\n function gtag(){dataLayer.push(arguments);}\n gtag(\'js\', new Date());\n \n gtag(\'config\', \'UA-1726084-83\', {\n \'page_title\': \'foo.com\',\n \'page_location\': \'http://www.foo.com/\',\n \'page_path\': \'/\'\n });\n \n \n gtag(\'event\', \'index\', {\'event_category\': \'domain_name\', \'event_label\': \'foo.com\'});\n</script>\n\n<script>\nvar privacy_policy=\'/digimedia_privacy_policy.html\';\nvar domain_name=\'foo.com\'\n</script>\n<script src="///privacy.digimedia.com/check_cookie_country_code.js" type="text/javascript"></script>\n<style>\n .privacy_consent{\n background:rgb(0,0,0,0.5);\n }\n .privacy_consent a{\n color:black;\n }\n .privacy_consent_box{\n text-shadow:none;\n padding:0px 20px;\n font-size:1.4em;\n }\n .privacy_consent_box h2{\n display:none;\n margin:0px;\n padding:15px 0px 5px 0px;\n border-bottom: 1px solid #eee;\n }\n .privacy_consent_button{\n padding:10px 20px;\n background:green;\n color:white;\n }\n .privacy_consent_more_button{\n margin-right:15px;\n padding:10px 20px;\n background:black;\n color:white;\n }\n .privacy_consent_footer{\n position:relative;\n clear:both;\n }\n .privacy_consent_footer_p{\n font-size:0.6em;\n margin:0px;\n margin-top:15px;\n }\n</style>\n<script>\n $(document).ready(function(){\n pc_options = {\n privacy_domain: "privacy.digimedia.com",\n ssl: false,\n title: null,\n question: "This website uses cookies to improve user experience. By using our website you consent to our <a href=\'"+privacy_policy+"\' target=\'_blank\'>privacy policy</a>.",\n links_left: [],\n agree_text: "YES, I ACCEPT",\n more_info_text: "MORE INFO",\n more_info_link: privacy_policy,\n text_color: \'black\',\n link_color: \'black\',\n width: \'320px\',\n height: \'150px\'\n }\n privacy_consent(pc_options);\n });\n</script>\n\n</body>\n</html>\n'] <!DOCTYPE html> <html data-adblockkey='MFwwDQYJKoZIhvcNAQEBBQADSwAwSAJBAL/3/SrV7P8AsTHMFSpPmYbyv2PkACHwmG9Z+1IFZq3vA54IN7pQcGnhgNo+8SN9r/KtUWCb9OPqTfWM1N4w/EUCAwEAAQ==_SWSZ/a887qeNgDyR88V/HpagDd3mJsrqq9QAOtr60lLTbm6U8aRlziJpuHLWpAnAP7Knt5Cp4voX6zE0ZRJ4kw=='> <head> <meta charset='UTF-8'> <title>Foo.com</title> <link href='data:image/png;base64,iVBORw0KGgo=' rel='icon' type='image/png'> <link href="/assets/style-85cdb3be1709c9028b204b38f8ccb358.css" media="none" onload="if(media!==&#x27;all&#x27;)media=&#x27;all&#x27;" rel="stylesheet" type="text/css" /> <link href="/assets/belt_layout_caf-4a3dea87ed4a809b49d0640b48d26654.css" media="none" onload="if(media!==&#x27;all&#x27;)media=&#x27;all&#x27;" rel="stylesheet" type="text/css" /> <script src="///code.jquery.com/jquery-3.3.1.min.js" type="text/javascript"></script> <!-- = stylesheet_link_tag "/load_style", :media => "all" --> <meta content="authenticity_token" name="csrf-param" /> <meta content="5hCvSZJsKJf9sl/hM7MWaoNdjQ8olm2Kj7T3dk8ZFyc=" name="csrf-token" /> <style> a, .ourterm a{ color: #00c; } .background1{ background-color: #ccc; } .background2{ background-color: #aaa; } .divider_background{ background-color: #aaa; } </style> </head> <body> <script async="async" src="/assets/application-ea87d7f1cf81efea754ac69b6a6922a8.js" type="text/javascript"></script> <center> <div id='outer_container'> <div id='outer_container2'> <div id='container'> <div id='header'> <div class='logo'> <a href="/">Foo.com</a> </div> <div class='googleframe' id='header_image'></div> </div> <div id='main'> <div class='image'> <img alt="Cordovabeach" border="0" src="/media/W1siZiIsIjIwMTIvMDQvMjYvMjAvMTEvNDkvNDI2L2NvcmRvdmFiZWFjaC5qcGciXSxbInAiLCJ0aHVtYiIsIjc1MHgyMDAjIl1d/cordovabeach.jpg" /></div> <div class='search'> <div class='catch_phrase'> <div id='wysiwyg_id_322' class='mercury-region' data-type='editable'>Search FOO.com </div> </div> <div class='googleframe' id='search'></div> </div> </div> <script> var searchblock1 = { 'type' : 'searchbox', 'container' : 'search', 'widthSearchButton' : 100, 'searchBoxMethod' : 'get' }; </script> <div id='footer'> <a href='/digimedia_privacy_policy.html' target='_blank'>Privacy Policy</a> - Copyright &copy; 2019 Digimedia.com, L.P. </div> </div> </div> </div> </center> <script src="/assets/abp2-4831d5b24977f8140fd9aa25543527f2.js" type="text/javascript"></script> <script src="/assets/ads-832e97bfd2d3e735f6dc8a30dd7190bc.js" type="text/javascript"></script> <!-- %script{:type=>"text/javascript", :language=>"JavaScript", :src=>"/abp.js"} --> <script language='JavaScript' src='///www.google.com/adsense/domains/caf.js' type='text/javascript'></script> <script> function jscript_log(name, severity, message, page){ $.ajax({ type: "POST", url: "/log_error", data: { name: name, severity: severity, domain: window.location.hostname, message: message, tag: 'dp-digimedia_js', page: page }, context: document.body }) } </script> <script> function google_index_loaded(requestAccepted, status) { if(!requestAccepted){ console.log('failed: ' + requestAccepted); jscript_log('faillisted', 10, JSON.stringify(status), "/") } console.log('status: '); console.log(status); } var pageOptions = { 'pubId' : 'dp-digimedia_js', 'kw': 'foo', 'domainRegistrant': 'as-drid-oo-1626960400946279', 'resultsPageBaseUrl': '///www.foo.com/results?', 'channel': 'digi-caf_pef,digimedia-template-09', 'adtest' : false, 'optimizeTerms': true, 'terms': '', 'colorAttribution' : 'black', 'fontFamilyAttribution' : 'arial', 'fontSizeAttribution' : 12, 'attributionBold' : false, 'fontSizeTitle' : 16, 'fontSizeDescription' : 12, 'lineHeightTitle' : 22, 'attributionBold' : false, 'numRepeated' : 3, 'pageLoadedCallback' : google_index_loaded, 'colorTitleLink' : '#00c', 'colorDomainLink' : 'green', 'noTitleUnderline' : false } </script> <script>new google.ads.domains.Caf(pageOptions, searchblock1);AdblockPlus.detect('/px.gif', function(usesABP){console.log('usesABP:' + usesABP);if(usesABP){blocked_ads_logger('whitelisted');}else{if(adsblocked()){blocked_ads_logger('blocked');}else{blocked_ads_logger('not_blocked');}}});</script> <!-- Global site tag (gtag.js) - Google Analytics --> <script async src='https://www.googletagmanager.com/gtag/js?id=UA-1726084-83'></script> <script> window.dataLayer = window.dataLayer || []; function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'UA-1726084-83', { 'page_title': 'foo.com', 'page_location': 'http://www.foo.com/', 'page_path': '/' }); gtag('event', 'index', {'event_category': 'domain_name', 'event_label': 'foo.com'}); </script> <script> var privacy_policy='/digimedia_privacy_policy.html'; var domain_name='foo.com' </script> <script src="///privacy.digimedia.com/check_cookie_country_code.js" type="text/javascript"></script> <style> .privacy_consent{ background:rgb(0,0,0,0.5); } .privacy_consent a{ color:black; } .privacy_consent_box{ text-shadow:none; padding:0px 20px; font-size:1.4em; } .privacy_consent_box h2{ display:none; margin:0px; padding:15px 0px 5px 0px; border-bottom: 1px solid #eee; } .privacy_consent_button{ padding:10px 20px; background:green; color:white; } .privacy_consent_more_button{ margin-right:15px; padding:10px 20px; background:black; color:white; } .privacy_consent_footer{ position:relative; clear:both; } .privacy_consent_footer_p{ font-size:0.6em; margin:0px; margin-top:15px; } </style> <script> $(document).ready(function(){ pc_options = { privacy_domain: "privacy.digimedia.com", ssl: false, title: null, question: "This website uses cookies to improve user experience. By using our website you consent to our <a href='"+privacy_policy+"' target='_blank'>privacy policy</a>.", links_left: [], agree_text: "YES, I ACCEPT", more_info_text: "MORE INFO", more_info_link: privacy_policy, text_color: 'black', link_color: 'black', width: '320px', height: '150px' } privacy_consent(pc_options); }); </script> </body> </html> [<Element div at 0x7f8b18a852b8>] <Element a at 0x7f8b18a852b8> {'link': '<a href="/">Foo.com</a>\n'} <a href="/">Foo.com</a> <Element a at 0x7f8b18a85310> {'link': '<a href="/digimedia_privacy_policy.html" target="_blank">Privacy Policy</a>\n - \nCopyright &#169; 2019 Digimedia.com, L.P.\n'} <a href="/digimedia_privacy_policy.html" target="_blank">Privacy Policy</a> - Copyright &#169; 2019 Digimedia.com, L.P.

Data

Downloaded 0 times

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3 KB) Use the API

rows 2 / 2

link
<a href="/">Foo.com</a>
<a href="/digimedia_privacy_policy.html" target="_blank">Privacy Policy</a> - Copyright © 2019 Digimedia.com, L.P.

Statistics

Average successful run time: half a minute

Total run time: 4 minutes

Total cpu time used: less than 5 seconds

Total disk space used: 44.5 KB

History

  • Manually ran revision 94244085 and completed successfully .
    2 records added, 2 records removed in the database
    2 pages scraped
  • Manually ran revision 94244085 and completed successfully .
    2 records added in the database
    2 pages scraped
  • Manually ran revision 995c0fd9 and failed .
    nothing changed in the database
    8 pages scraped
  • Manually ran revision 7b0b3d27 and failed .
    nothing changed in the database
  • Manually ran revision e5c04b73 and failed .
    nothing changed in the database
    2 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

myfirstscraper