|User Agent|| ||Verified||Date Added|
|Compatible win32||16/01/2010 1:12:32|
|Computer COMPUTERNAME||16/12/2009 23:43:54|
|ComputingSite Robi/1.0||27/07/2005 23:25:37|
|Intelligent agent used to build the ComputingSite Search Directory.|
It was born on August 1997.
|Concealed Defense||13/09/2006 1:03:12|
|The Conceptbot spider is used to research concept-based search indexing techniques. It uses a breadth first search to spread out the number of hits on a single site over time. The spider runs at irregular intervals and is still under construction.|
|Confidential PHSA Information||4/09/2011 2:56:34|
|Congoo NetPass||5/11/2009 23:39:20|
|Congoo NetPass Version 2||20/12/2009 19:54:11|
|same as LMQueueBot|
|Content Crawler||22/12/2012 11:27:32|
|Content Parser||19/04/2012 14:28:36|
|ContextAd Bot||30/07/2010 13:51:13|
|This is a component of the Internet Explorer browser used when downloading PDF and similar files. It is outdated, poorly implemented, and can cause downloads to fail where authorization is required.|
|ConveraCrawler is an experimental web crawler under development since April 2004. ConveraCrawler is owned and operated by Convera Corporation as part of an effort to develop a state-of-the-art searchable Web index. The information gathered by ConveraCrawler will be indexed and made accessible via one or more publicly-accessible web sites in the near future.|
We intend for ConveraCrawler to be a polite and unobtrusive netizen. From January 2005 through March 2005 we will be rapidly increasing the size of our Web index towards an initial target of 4 billion pages. As a result, during this period we may occasionally make page requests at a rate exceeding commonly accepted standards for unobtrusive crawling. We apologize for this intrusion and will return to a more discreet crawl rate at the earliest possible date.
You may control ConveraCrawler's access to your site by updating your robots.txt file.