|
|
|
|
User-Agents Database |
User Agent Details of ConveraCrawler
Name: | ConveraCrawler |
URL: | http://www.authoritativeweb.com/crawl |
User Agent Key: | ConveraCrawler |
User Agents: | ConveraCrawler/0.4 ConveraCrawler/0.5 (+http://www ConveraCrawler/0.7 (+http://www.authoritativeweb.com/crawl) ConveraCrawler/0.8 (+http://www.authoritativeweb.com/crawl) ConveraCrawler/0.9 (+http://www.authoritativeweb.com/crawl) ConveraCrawler/0.9b (+http://www.authoritativeweb.com/crawl) ConveraCrawler/0.9c (+http://www.authoritativeweb.com/crawl) ConveraCrawler/0.9d (+http://www.authoritativeweb.com/crawl) ConveraCrawler/0.9e (+http://ews.converasearch.com/crawl.htm)
|
IP Ranges: | |
Adheres robots.txt: | Yes |
Adheres META tag: | N/A |
Type(s): |
|
Verified: | | Info: | ConveraCrawler is an experimental web crawler under development since April 2004. ConveraCrawler is owned and operated by Convera Corporation as part of an effort to develop a state-of-the-art searchable Web index. The information gathered by ConveraCrawler will be indexed and made accessible via one or more publicly-accessible web sites in the near future.
We intend for ConveraCrawler to be a polite and unobtrusive netizen. From January 2005 through March 2005 we will be rapidly increasing the size of our Web index towards an initial target of 4 billion pages. As a result, during this period we may occasionally make page requests at a rate exceeding commonly accepted standards for unobtrusive crawling. We apologize for this intrusion and will return to a more discreet crawl rate at the earliest possible date.
You may control ConveraCrawler's access to your site by updating your robots.txt file. | Date Added: | 5/07/2005 10:50:04 | | |
User Agents - Search
|
|