| User Agent | | Verified | Date Added |
| AdvertDex | [edit] | | 15/11/2005 0:54:39 |
| Advertising Web Directory |
| AlkalineBOT | [edit] | Yes | 7/02/2004 23:04:26 |
|
| ananzi | [edit] | | 11/02/2004 22:43:44 |
|
| ASpider (Associative Spider) | [edit] | | 10/02/2004 21:01:11 |
| ASpider is a CGI script that searches the web for keywords given by the user through a form. |
| ASPseek | [edit] | Yes | 7/02/2004 23:03:13 |
| ASPseek is an Internet search engine software developed by SWsoft and licensed as free software under GNU GPL. |
| AURESYS | [edit] | | 10/02/2004 23:56:08 |
| The AURESYS is used to build a personnal database for somebody who search information. The database is structured to be analysed. AURESYS can found new server by IP incremental. It generate statistics... |
| Building-X | [edit] | Yes | 30/04/2006 0:54:50 |
| Building and Construction Web Directory |
| BullsEye | [edit] | | 7/09/2006 23:53:37 |
| Intelliseek robot |
| CatchBot | [edit] | | 9/09/2008 13:55:03 |
CatchBot is the web crawler for Catch, the online division of Reed Business Information Australia. Reed Business Information is Australia’s leading and largest business to business publisher and information provider.
CatchBot investigates websites for publicly available information about companies, such as a company’s name, address, telephone number and keyword data about a company’s products and services. CatchBot is not designed to access or index any personal information or any information about individuals.
Information gathered by CatchBot is stored on our password protected servers and the security of this information is of the highest importance to us.
Information gathered by CatchBot may be used for business activities that are undertaken by Catch. Examples of this include publishing and maintaining business directories in various countries around the world, industry specific websites and online portals |
| charlotte betaspider.com | [edit] | | 5/11/2006 22:51:16 |
We are a stealth-mode startup that is indexing the web for a novel application. We plan to release this new service to the public very soon.
We are not attempting to steal any copyrighted information from your site and will not be re-distributing your content. We will only be allowing users to find for your website more easily. |
| CMC/0.01 | [edit] | | 11/02/2004 16:16:32 |
| This CMC/0.01 robot collects the information of the page that was registered to the music specialty searching service. |
| Combine | [edit] | Yes | 7/02/2004 23:05:39 |
| Combine is an open system for harvesting and threshing (indexing) Internet resources. |
| ComputingSite Robi/1.0 | [edit] | | 27/07/2005 23:25:37 |
Intelligent agent used to build the ComputingSite Search Directory.
It was born on August 1997. |
| Conceptbot | [edit] | | 11/02/2004 16:26:22 |
| The Conceptbot spider is used to research concept-based search indexing techniques. It uses a breadth first search to spread out the number of hits on a single site over time. The spider runs at irregular intervals and is still under construction. |
| DeWeb(c) Katalog/Index | [edit] | Yes | 11/02/2004 16:53:41 |
| Its purpose is to generate a Resource Discovery database, perform mirroring, and generate statistics. Uses combination of Informix(tm) Database and WN 1.11 serversoftware for indexing/ressource discovery, fulltext search, text excerpts. |
| DNAbot | [edit] | | 11/02/2004 17:07:07 |
| A search robot in 100 java, with its own built-in database engine and web server . Currently in Japanese. |
| Emacs-w3 Search Engine | [edit] | Yes | 11/02/2004 22:42:30 |
| Its purpose is to generate a Resource Discovery database This code has not been looked at in a while, but will be spruced up for the Emacs-w3 2.2.0 release sometime this month. It will honor the /robots.txt file at that time. |
| Enterprise_Search | [edit] | Yes | 7/02/2004 23:08:44 |
|
| ES.NET | [edit] | | 5/07/2005 11:02:08 |
| Innerprise develops full-text indexing search engine software technology enabling search for your Web site, Intranet, or the Web. Advanced crawler features ensure that only documents you want indexed are indexed. Key features provide support for common file types, secure servers, multiple servers, and complete automation through built-in schedulers. |
| FAST Enterprise Crawler | [edit] | | 18/03/2004 21:41:19 |
|
| Felix IDE | [edit] | Yes | 11/02/2004 22:55:39 |
| Felix IDE is a retail personal search spider sold by The Pentone Group, Inc. It supports the proprietary exclusion "Frequency: ??????????" in the robots.txt file. Question marks represent an integer indicating number of milliseconds to delay between document requests. This is called VDRF(tm) or Variable Document Retrieval Frequency. Note that users can re-define the useragent name. |
| FetchRover | [edit] | Yes | 11/02/2004 23:00:32 |
| FetchRover fetches Web Pages. It is an automated page-fetching engine. FetchRover can be used stand-alone or as the front-end to a full-featured Spider. Its database can use any ODBC compliant database server, including Microsoft Access, Oracle, Sybase SQL Server, FoxPro, etc. |
| Fish search | [edit] | | 11/02/2004 23:13:23 |
| Its purpose is to discover resources on the fly a version exists that is integrated into the Tübingen Mosaic 2.4.2 browser (also written in C) |
| Fluid Dynamics Search Engine robot (FDSE) | [edit] | Yes | 7/02/2004 23:10:47 |
| FDSE is an easy-to-install search engine for local and remote sites. It returns fast, accurate results from a template-driven architecture. |
