| User Agent | | Date Added |
| Contacts Crawler |  | 24/11/2016 9:07:21 |
Scrapy Cloud, our cloud-based web crawling platform, allows you to easily deploy crawlers and scale them on demand – without needing to worry about servers, monitoring, backups, or cron jobs. It helps developers like you turn over two billion web pages per month into valuable data.
Our platform's many add-ons let you extend your spiders in clicks. Among them, our smart proxy rotator (Crawlera) helps you bypass bot counter-measures so you can crawl large sites faster.
Your data gets safely stored in a high-availability database. You can browse it and share it with your team from your dashboard, or consume your data in your app using our API. |
| copier | | 12/09/2006 0:34:06 |
|
| core-project | | 25/05/2006 23:24:35 |
| Seems to be scanning for frontpage vulnerabilities |
| CorporateNewsSearchEngine | | 13/12/2015 10:47:34 |
| Url not working |
| crack | | 12/09/2006 0:32:28 |
|
| CRAP CRAP CRAP | | 18/04/2013 14:01:25 |
|
| Crawler | | 30/07/2010 17:49:24 |
|
| Crawler MSIE | | 22/12/2011 15:52:18 |
| fell for bad bot trap |
| crawler.feedback@gmail.com | | 27/03/2018 9:02:24 |
|
| crawler4j | | 11/04/2011 13:51:01 |
| fell for bad bot trap |
| C-SYMPA | | 14/10/2007 23:23:36 |
| fell for bad bot trap (guestbook spam trap) |
| cu.patible | | 16/12/2009 15:43:12 |
|
| Custom 1.0 | | 11/10/2016 9:40:09 |
| requests /version |
| cz32ts | | 9/11/2009 0:24:20 |
| does SQL injection |
| czxt2s | | 20/12/2012 15:47:42 |
| SQL injection tool |
| D2502 SQL Injection | | 21/10/2015 14:37:25 |
| performs SQL injection |
| Dahoms.com spam | | 24/03/2015 8:29:05 |
|
| darxi | | 8/03/2008 1:13:01 |
| fell for bad bot trap + very aggressive (+10 requests/second) |
| DataCha0s | | 5/11/2006 11:54:03 |
| exploit tool that scans for Perl Awstats |
| Dataprovider Site Explorer | | 8/04/2012 11:26:23 |
| fell for bad bot trap! |
| DBot | | 29/05/2014 10:02:53 |
| Same as DownloadBot |
| DCPbot | | 26/11/2011 23:20:20 |
| fell for bad bot trap! |
| Default UA | | 26/01/2018 16:04:12 |
| exploit scanner |
| Desktop Security 2010 | | 27/03/2010 0:44:01 |
| malware |
| DISCo | | 8/09/2006 0:08:17 |
|
| discoveryengine.com | | 2/01/2008 16:41:52 |
|
| DnyzBot | | 3/11/2017 9:08:09 |
| fell for bad bot trap |
| DomainCheck.io Crawler | | 2/08/2017 11:27:38 |
|
| DomainCrawler | | 3/11/2009 1:24:04 |
| fell for bad bot trap |
| DonutP; Windows98SE | | 20/12/2012 17:03:50 |
|
| DownloadBot | | 1/05/2014 11:14:26 |
| Is now DBot |
| dragonfly | | 11/06/2006 23:55:32 |
| fell for bad bot trap |
| dredges dredger for sale | | 3/03/2015 21:02:01 |
| spam |
| DW.ubs.in | | 19/12/2016 11:47:21 |
| X-Requested-With: com.datawind.UbiCombined |
| eagle | | 15/11/2005 0:33:40 |
| bad user agent |
| EdisterBot | | 1/03/2012 11:18:45 |
EdisterBot is the web crawler for Edister.com. A "crawler" is simply software that fetches web pages, records details about those pages, and examines them for links to other web pages -- which it then fetches and examines, etc.
fell for bad bot trap |
| EirGrabber | | 8/09/2006 0:17:18 |
|
| en-ww | | 28/12/2012 11:17:22 |
| bad country code |
| EvaalSE | | 24/07/2019 15:02:15 |
|
| everyfeed-spider | | 29/03/2020 14:31:01 |
| Performs SQL injection |
| Experibot | | 7/01/2016 9:37:38 |
| Fake referer |
| exploit | | 12/09/2006 0:34:37 |
|
| Explore 6.0 | | 6/12/2011 22:42:58 |
| referer spamming |
| extract | | 12/09/2006 0:34:51 |
|
| EyeNetIE | | 8/09/2006 0:18:51 |
|
| Fake "Mozilla | | 8/08/2015 23:28:17 |
|
| Fake .NET | | 12/11/2009 22:41:46 |
|
| Fake .NET CLR 3128A1F76 | | 18/12/2016 10:10:23 |
|
| Fake .NET Framework | | 25/01/2010 1:58:07 |
|
| Fake .NET Framework 4.0R | | 9/04/2014 11:17:16 |
|
