IP Range: 80.119.*.* Request same page multiple times + not RFC compliant (treats these urls "/file" as relative to current path instead of domain) User-Agent: Java/1.4.1_04
This robot will transverse a web site and map every web page found. It will index them in a coma separate file. (.csv) Atlas will construct a site map of your web site, logging all web pages and locations. This will enable you to analyze the site and monitor size.
Does GET requests with Content-Type: application/x-www-form-urlencoded Also does a GET request on url where a POST should be done (reads html form actions). User-Agent: Java/1.6.0-beta aggressive bot (every second a request + sometimes 2 requests/second)
