| User Agent | | Date Added |
| AskTbSTT |  | 22/12/2010 13:21:09 |
|
| AskTbTKR | | 26/07/2010 11:06:23 |
|
| AskTbTRL | | 11/06/2010 0:29:18 |
|
| AskTbTRL2 | | 23/04/2010 1:16:21 |
|
| AskTbUNB | | 5/02/2012 23:35:58 |
|
| AskTbUT | | 5/06/2010 9:32:29 |
|
| AskTbUTR | | 28/03/2011 1:55:24 |
|
| AskTbUTR2 | | 8/08/2011 12:08:39 |
|
| AskTbVD | | 18/06/2010 19:05:03 |
|
| AskTbVDJ | | 28/06/2011 0:38:45 |
|
| AskTbVRS | | 26/07/2010 11:00:11 |
|
| AskTbVSAT | | 18/01/2012 23:44:48 |
|
| AskTbVSO | | 18/11/2010 10:27:59 |
|
| AskTbW3I | | 22/08/2012 14:06:58 |
|
| AskTbW3I4 | | 9/04/2012 14:09:39 |
|
| AskTbWBG | | 12/06/2010 23:41:53 |
|
| AskTbWBM | | 1/03/2011 22:26:58 |
|
| AskTbWBM3 | | 8/01/2012 22:43:41 |
|
| AskTbWBR | | 23/07/2010 13:24:13 |
|
| AskTbWBV | | 9/06/2010 12:12:14 |
|
| AskTbWCL | | 21/06/2010 13:38:43 |
|
| AskTbWCR | | 4/11/2011 23:52:09 |
|
| AskTbWCV5 | | 1/09/2010 16:39:41 |
|
| AskTbWIZ | | 23/07/2010 18:26:17 |
|
| AskTbWME | | 31/01/2011 0:53:58 |
|
| AskTbWSV5 | | 5/09/2010 1:29:10 |
|
| AskTbX | | 25/05/2012 14:48:31 |
|
| AskTbX-SD | | 6/07/2010 20:23:08 |
|
| AskTbYLC | | 23/04/2010 1:20:20 |
|
| AskTbYSI2 | | 12/10/2012 11:43:23 |
|
| AskTbZMR | | 9/12/2010 16:37:16 |
|
| AskTbZTV | | 6/07/2010 19:53:32 |
|
| ASpider (Associative Spider) | | 10/02/2004 21:01:11 |
| ASpider is a CGI script that searches the web for keywords given by the user through a form. |
| Asterias | | 8/02/2004 19:38:37 |
| Singingfish uses an innovative, multimedia-oriented spider or robot to crawl the Web, looking for media files to index for the Singingfish Streambase. Our spider, called Asterias®, obeys spider Netiquette rules: It checks the Robot Exclusion File and it avoids hitting each site too frequently. Asterias® identifies multimedia (Real Media, Windows Media, Quicktime, MP3 and Flash) files and adds them to our index. Sometimes this process results in many sequential accesses to a Site. While this process results in a complete index, the behavior is atypical of other spiders found on the web. |
| ATN Worldwide | | 10/02/2004 23:52:53 |
| The ATN robot is used to build the database for the AllThatNet search service operated by All That Net. The robot runs weekly, and visits sites in a random order. |
| Atomz.com Search Robot | | 10/02/2004 23:54:53 |
| Robot used for web site search service. |
| Baiduspider | | 8/02/2004 15:21:41 |
|
| Baiduspider-image | | 21/12/2009 0:59:06 |
|
| BBot | | 11/02/2004 0:02:44 |
| Mainly intended for site level search, sometimes set loose. |
| BebopBot | | 1/12/2008 0:46:59 |
| BebopBot is an experimental web crawler under development since January 2007. BebopBot is owned and operated by A Passion for Jazz!™ as part of an effort to develop a niche based searchable Web index. We are not attempting to steal any copyrighted information from your site and will not be re-distributing your content. We will only be allowing users to find your website more easily. The information gathered will be indexed and made accessible via one or more publicly accessible web sites in the near future. |
| BecomeBot | | 17/01/2005 10:17:49 |
| BecomeBot is the user-agent for Become's new web crawler. Become is crawling the web to build a next generation search engine. |
| bingbot | | 29/09/2010 11:55:13 |
|
| boitho.com | | 5/01/2006 10:05:08 |
| The boitho.com-robot is a distributed crawler that downloads web pages to build the database used by boitho.com to search in. |
| Borg-Bot | | 11/02/2004 0:27:02 |
| Developmental crawler to feed a search engine |
| BSpider | | 11/02/2004 0:29:42 |
| BSpider is crawling inside of Japanese domain for indexing. |
| Businessjet | | 8/02/2004 15:22:06 |
|
| Calif | | 11/02/2004 16:04:50 |
| Used to build searchable index |
| Cassandra | | 11/02/2004 16:06:54 |
| Cassandra search robot is used to create and maintain indexed database for widespread Information Retrieval System |
| Charlotte | | 8/02/2004 15:23:24 |
|
| Charlotte Searchme | | 8/01/2008 16:36:23 |
|
