|
|
|
|
|
User-Agents Database |
 |
User Agent Details of ParaSite
| Name: | ParaSite |
| URL: | http://marty.anstey.ca/projects/robots/ |
| User Agent Key: | ParaSite |
| User Agents: | ParaSite/0.21 (http://www.ianett.com/parasite/)
|
| IP Ranges: | |
| Adheres robots.txt: | Yes |
| Adheres META tag: | Yes |
| Type(s): |
IndexingTool
|
| Verified: | Yes | | Info: | ParaSite is an incredibly powerful spider which went through several different versions over the course of two years. It is designed to index a substantial portion of the web quickly. ParaSite runs using a server and multiple downloaders. Each downloader runs a number of threads, capable of indexing five to ten documents per second. Since this is a parallel implementation, multiple downloaders can be run simultaneously. The server sorts the incoming urls into queues and hands of batches of urls to the downloaders for indexing. | | Date Added: | 7/02/2004 23:39:09 | | |  |
User Agents - Search
|
|
