Brandhunt / Brandhunt_produpdate_scraper_phantomjs_py_module_2_v2
Collects product information to be updated from product URLs stored at Brandhunt.se - Only products that require usage of headless browser! Module scraper 2 for centrailzed main scraper
This is a scraper that runs on Morph. To get started see the documentation
Contributors
Last run failed
with status code 999.
Console output of last run
Please install the Morph Github App on Brandhunt so that Morph can access this repository on GitHub. Please go to https://github.com/apps/morph-io/installations/new/permissions?repository_ids%5B%5D=&repository_ids%5B%5D=&repository_ids%5B%5D=236666980&repository_ids%5B%5D=235955839&repository_ids%5B%5D=228601078&repository_ids%5B%5D=236667136&repository_ids%5B%5D=241724279&repository_ids%5B%5D=235683126&repository_ids%5B%5D=242797121&repository_ids%5B%5D=242797163&repository_ids%5B%5D=242797184&repository_ids%5B%5D=242797206&repository_ids%5B%5D=242797224&repository_ids%5B%5D=242797246&repository_ids%5B%5D=242797261&repository_ids%5B%5D=271550009&repository_ids%5B%5D=271550170&repository_ids%5B%5D=241960308&repository_ids%5B%5D=241960371&repository_ids%5B%5D=241960432&repository_ids%5B%5D=242253859&repository_ids%5B%5D=241960855&repository_ids%5B%5D=241960930&repository_ids%5B%5D=242797094&repository_ids%5B%5D=&suggested_target_id=57029610
Why? See https://morph.io/documentation/github_app
Data
Downloaded
68009 times
by
To download data sign in with GitHub
rows 10 / 1572
| productid | url | domain | price | salesprice | domainmisc | prodlogurls | prodlogurl | finalimgurls | validimgurls | imgurls | notfound | notavailable | removeon404 | soldoutfix | soldouthtmlfix | catstoaddresult | attributes | sizetypemapsqls |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
27216
|
pauw.com
|
1
|
|
""
|
""
|
|
""
|
""
|
""
|
true
|
false
|
true
|
false
|
false
|
""
|
[{"name": "Brand", "options": [[{"term_id": 918, "name": "Pauw", "slug": "brand-pauw", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 2, "visible": 1, "variation": 1}]
|
["", "", "", ""]
|
|
|
27060
|
pauw.com
|
1
|
|
""
|
""
|
|
""
|
""
|
""
|
true
|
false
|
true
|
false
|
false
|
""
|
[{"name": "Brand", "options": [[{"term_id": 918, "name": "Pauw", "slug": "brand-pauw", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 2, "visible": 1, "variation": 1}]
|
["", "", "", ""]
|
|
|
27276
|
pauw.com
|
1
|
|
""
|
""
|
|
""
|
""
|
""
|
true
|
false
|
true
|
false
|
false
|
""
|
[{"name": "Brand", "options": [[{"term_id": 918, "name": "Pauw", "slug": "brand-pauw", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 2, "visible": 1, "variation": 1}]
|
["", "", "", ""]
|
|
|
27166
|
pauw.com
|
1
|
|
""
|
""
|
|
""
|
""
|
""
|
true
|
false
|
true
|
false
|
false
|
""
|
[{"name": "Brand", "options": [[{"term_id": 918, "name": "Pauw", "slug": "brand-pauw", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false]], "position": 2, "visible": 1, "variation": 1}]
|
["", "", "", ""]
|
|
|
26046
|
www.stenstromsstore.com
|
1
|
|
""
|
""
|
|
""
|
""
|
""
|
true
|
true
|
true
|
false
|
false
|
""
|
[{"name": "Brand", "options": [[{"term_id": 899, "name": "Stenstr\u00f6ms", "slug": "brand-stenstr%c3%b6ms", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false], [{"term_id": 142, "name": "Female", "slug": "female", "taxonomy": "pa_sex"}, false]], "position": 2, "visible": 1, "variation": 1}]
|
["", "", "", ""]
|
|
|
26129
|
www.stenstromsstore.com
|
1
|
|
""
|
""
|
|
""
|
""
|
""
|
true
|
true
|
true
|
false
|
false
|
""
|
[{"name": "Brand", "options": [[{"term_id": 899, "name": "Stenstr\u00f6ms", "slug": "brand-stenstr%c3%b6ms", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 115, "name": "White", "slug": "color-white", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false], [{"term_id": 142, "name": "Female", "slug": "female", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
|
["", "", "", ""]
|
|
|
26169
|
www.stenstromsstore.com
|
1
|
|
""
|
""
|
|
""
|
""
|
""
|
true
|
true
|
true
|
false
|
false
|
[[{"term_id": 43, "name": "Jeans", "slug": "jeans", "taxonomy": "product_cat", "ancestors": []}, false], [{"term_id": 94, "name": "Jeans(Trousers)", "slug": "jeans-trousers", "taxonomy": "product_cat", "ancestors": [92, 73]}, false], [{"term_id": 92, "name": "Trousers", "slug": "trousers", "taxonomy": "product_cat", "ancestors": [73]}, false], [{"term_id": 73, "name": "Trousers & Chinos", "slug": "trousers-chinos", "taxonomy": "product_cat", "ancestors": []}, false]]
|
[{"name": "Brand", "options": [[{"term_id": 899, "name": "Stenstr\u00f6ms", "slug": "brand-stenstr%c3%b6ms", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 119, "name": "Orange", "slug": "color-orange", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false], [{"term_id": 142, "name": "Female", "slug": "female", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}, {"name": "Sizetype", "options": [[{"term_id": 2021, "name": "Bottoms", "slug": "sizetype-bottoms", "taxonomy": "pa_sizetype"}, false]], "position": 4, "visible": 1, "variation": 1}]
|
["", "", "", ""]
|
|
|
26213
|
www.stenstromsstore.com
|
1
|
|
""
|
""
|
|
""
|
""
|
""
|
true
|
true
|
true
|
false
|
false
|
""
|
[{"name": "Brand", "options": [[{"term_id": 899, "name": "Stenstr\u00f6ms", "slug": "brand-stenstr%c3%b6ms", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 475, "name": "Green", "slug": "color-green", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false], [{"term_id": 142, "name": "Female", "slug": "female", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}]
|
["", "", "", ""]
|
|
|
26242
|
www.stenstromsstore.com
|
1
|
|
""
|
""
|
|
""
|
""
|
""
|
true
|
true
|
true
|
false
|
false
|
[[{"term_id": 77, "name": "Underwear", "slug": "underwear", "taxonomy": "product_cat", "ancestors": []}, false]]
|
[{"name": "Brand", "options": [[{"term_id": 899, "name": "Stenstr\u00f6ms", "slug": "brand-stenstr%c3%b6ms", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 117, "name": "Black", "slug": "color-black", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false], [{"term_id": 142, "name": "Female", "slug": "female", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}, {"name": "Sizetype", "options": [[{"term_id": 2578, "name": "Underwear/Swimwear", "slug": "sizetype-underwearswimwear", "taxonomy": "pa_sizetype"}, false]], "position": 4, "visible": 1, "variation": 1}]
|
["", "", "", ""]
|
|
|
26388
|
www.stenstromsstore.com
|
1
|
|
""
|
""
|
|
""
|
""
|
""
|
true
|
true
|
true
|
false
|
false
|
[[{"term_id": 61, "name": "Socks", "slug": "socks", "taxonomy": "product_cat", "ancestors": [2584]}, false], [{"term_id": 2584, "name": "Footwear", "slug": "footwear", "taxonomy": "product_cat", "ancestors": []}, false]]
|
[{"name": "Brand", "options": [[{"term_id": 899, "name": "Stenstr\u00f6ms", "slug": "brand-stenstr%c3%b6ms", "taxonomy": "pa_brand"}, false]], "position": 1, "visible": 1, "variation": 1}, {"name": "Color", "options": [[{"term_id": 493, "name": "Dark Grey", "slug": "color-dark-grey", "taxonomy": "pa_color"}, false], [{"term_id": 116, "name": "Grey", "slug": "color-grey", "taxonomy": "pa_color"}, false]], "position": 2, "visible": 1, "variation": 1}, {"name": "Sex", "options": [[{"term_id": 141, "name": "Male", "slug": "male", "taxonomy": "pa_sex"}, false], [{"term_id": 142, "name": "Female", "slug": "female", "taxonomy": "pa_sex"}, false]], "position": 3, "visible": 1, "variation": 1}, {"name": "Sizetype", "options": [[{"term_id": 2022, "name": "Footwear", "slug": "sizetype-footwear", "taxonomy": "pa_sizetype"}, false]], "position": 4, "visible": 1, "variation": 1}]
|
["", "", "", ""]
|
Statistics
Average successful run time: about 2 hours
Total run time: about 1 month
Total cpu time used: 4 days
Total disk space used: 4.75 MB
History
-
Auto
ran
and
failed
.
-
Auto
ran
and
failed
.
-
Auto
ran
and
failed
.
-
Auto
ran
and
failed
.
-
Auto
ran
and
failed
.
- ...
- Created on morph.io