Logo
Home
 
User Agents
New Agents
List All
My User Agent
Add New
 
User-Agents Database

User Agent Details of IRLbot

Name:IRLbot
URL:http://irl.cs.tamu.edu/crawler
User Agent Key:IRLbot
User Agents:TAMU_CS_IRL_CRAWLER/1.0
IRLbot/1.0 (+http://irl.cs.tamu.edu/crawler)
IRLbot/2.0 (compatible; MSIE 6.0; http://irl.cs.tamu.edu/crawler)
IRLbot/3.0 (compatible; MSIE 6.0; http://irl.cs.tamu.edu/crawler)
IP Ranges:
Adheres robots.txt:Yes
Adheres META tag:Yes
Type(s): DataMiningCommercial
Verified:Yes
Info:IRL-crawler is a Texas A&M research project sponsored in part by the National Science Foundation that investigates algorithms for mapping the topology of the Internet and discovering the various parts of the web. The crawler downloads random web pages (text only) and follows certain links to find other websites.
Date Added:2/05/2006 0:42:29
 edit

User Agents - Search

Enter keyword or user agent: