|
|
|
|
|
User-Agents Database |
User Agent Details of HTMLgobble
| Name: | HTMLgobble |
| URL: | |
| User Agent Key: | HTMLgobble |
| User Agents: | HTMLgobble v2.2
|
| IP Ranges: | |
| Adheres robots.txt: | N/A |
| Adheres META tag: | No |
| Type(s): |
OfflineBrowser
|
| Verified: | Yes | | Info: | A mirroring robot. Configured to stay within a directory, sleeps between requests, and the next version will use HEAD to check if the entire document needs to be retrieved. | | Date Added: | 14/02/2004 0:25:26 | | |  |
User Agents - Search
|
|
