User-Agents Database

User Agent Details of Contacts Crawler

Name:	Contacts Crawler
URL:	http://www.scrapinghub.com
User Agent Key:	Contacts Crawler
User Agents:	Contacts Crawler (+http://www.scrapinghub.com)
IP Ranges:
Adheres robots.txt:	N/A
Adheres META tag:	N/A
Type(s):	DataMiningCommercial IndexingTool OtherBad
Verified:
Info:	Scrapy Cloud, our cloud-based web crawling platform, allows you to easily deploy crawlers and scale them on demand – without needing to worry about servers, monitoring, backups, or cron jobs. It helps developers like you turn over two billion web pages per month into valuable data. Our platform's many add-ons let you extend your spiders in clicks. Among them, our smart proxy rotator (Crawlera) helps you bypass bot counter-measures so you can crawl large sites faster. Your data gets safely stored in a high-availability database. You can browse it and share it with your team from your dashboard, or consume your data in your app using our API.
Date Added:	24/11/2016 9:07:21

User Agents - Search