|
|
|
|
|
User-Agents Database |
User Agent Details of Conceptbot
| Name: | Conceptbot |
| URL: | http://www.aptltd.com/~sifry/conceptbot |
| User Agent Key: | Conceptbot |
| User Agents: | |
| IP Ranges: | |
| Adheres robots.txt: | Yes |
| Adheres META tag: | Yes |
| Type(s): |
DataMiningCommercial
IndexingTool
SearchEngine
|
| Verified: | | | Info: | The Conceptbot spider is used to research concept-based search indexing techniques. It uses a breadth first search to spread out the number of hits on a single site over time. The spider runs at irregular intervals and is still under construction. | | Date Added: | 11/02/2004 16:26:22 | | |  |
User Agents - Search
|
|
