|
|
|
|
|
User-Agents Database |
User Agent Details of WebCrawler
| Name: | WebCrawler |
| URL: | http://www.webcrawler.com/ |
| User Agent Key: | WebCrawler |
| User Agents: | WebCrawler/3.0 Robot libwww/5.0a
WebCrawler-AddURL/2.0
|
| IP Ranges: | |
| Adheres robots.txt: | N/A |
| Adheres META tag: | N/A |
| Type(s): |
SearchEngine
|
| Verified: | Yes | | Info: | | | Date Added: | 10/02/2004 1:44:41 | | |  |
User Agents - Search
|
|
