User-Agents Database

User Agent Details of Shim-Crawler

Name:	Shim-Crawler
URL:	http://www.logos.ic.i.u-tokyo.ac.jp/crawler/
User Agent Key:	Shim-Crawler
User Agents:	Shim-Crawler(Mozilla-compatible; http://www.logos.ic.i.u-tokyo.ac.jp/crawler/; crawl@logos.ic.i.u-tokyo.ac.jp)
IP Ranges:
Adheres robots.txt:	Yes
Adheres META tag:	Yes
Type(s):	DataMiningPublic IndexingTool SearchEngine
Verified:	Yes
Info:	Shim-crawler was written by Shim Wonbo of Chikayama-Taura laboratory.The main goal behind writing the crawler is to collect web pages for researches related to web-search and data mining. Recently, we are planning to use it for crawling weblogs too.The Crawler is used by the members of Chikayama-Taura Laboratory to crawl web-pages only for the research purposes.Our crawling policy distinctly respects the general crawling norm.Though we duely understand the concern of the webmasters, we would like to assure that our crawler is only crawling pages for performing researches and not for any business use.Please have a glance at our crawling policy for better understanding.We sincerely appriciate your co-operation and support.
Date Added:	6/02/2006 15:38:26

User Agents - Search