| User Agent | | Verified | Date Added |
| SH-03C Build |  | | 28/07/2011 11:58:51 |
|
| SH-06D | | | 24/06/2012 16:15:44 |
|
| SH-09D | | | 26/09/2012 10:36:55 |
|
| SH-12C | | | 24/06/2012 16:15:20 |
|
| SH-13C | | | 22/08/2012 12:11:11 |
|
| ShagSeeker | | | 31/07/2005 23:39:54 |
| Shagseeker is the gatherer for the Shagseek.com search engine and goes out weekly. |
| Shai'Hulud | | | 31/07/2005 23:40:57 |
Used to build mirrors for internal use.
This robot finds its roots in a research project at RDTeX Perspective Projects Group in 1996. |
| Shareaza | | | 3/05/2010 17:28:58 |
|
| SHC | | | 27/01/2012 0:04:40 |
|
| SHC-Z120L | | | 31/01/2011 12:04:40 |
|
| SheenBot | | | 8/12/2009 0:41:46 |
|
| shelob | | | 27/06/2007 0:55:39 |
| fell for bad bot trap |
| sherisranch | | | 19/02/2010 23:27:11 |
|
| Sherlock | | | 17/01/2005 10:23:33 |
|
| Sherlock Holmes Search Engine | | Yes | 8/02/2004 0:08:16 |
| Sherlock Holmes is a universal search engine – a system for gathering and indexing of textual data (text files, web pages, ...), both locally and over the network. |
| Shim-Crawler | | Yes | 6/02/2006 15:38:26 |
| Shim-crawler was written by Shim Wonbo of Chikayama-Taura laboratory.The main goal behind writing the crawler is to collect web pages for researches related to web-search and data mining. Recently, we are planning to use it for crawling weblogs too.The Crawler is used by the members of Chikayama-Taura Laboratory to crawl web-pages only for the research purposes.Our crawling policy distinctly respects the general crawling norm.Though we duely understand the concern of the webmasters, we would like to assure that our crawler is only crawling pages for performing researches and not for any business use.Please have a glance at our crawling policy for better understanding.We sincerely appriciate your co-operation and support. |
| Shiretoko | | | 13/12/2009 2:43:55 |
|
| SHLEE | | | 29/11/2009 21:09:55 |
|
| ShopperReports | | | 25/11/2009 1:01:18 |
|
| shopping.com research | | | 2/05/2006 1:26:35 |
|
| ShopWiki | | | 23/02/2009 0:49:32 |
| ShopWiki finds products using Web crawlers similar to other search engines. This means we look into a Web site's domain for all robots.txt files, which tell our crawlers which files it may search. All Web sites have the ability to define what parts of their domain are off-limits to specific robot user agents. ShopWiki respects and obeys all robots.txt files. |
| should not be there | | | 29/11/2009 21:10:15 |
|
| shoutcastsource | | Yes | 13/09/2006 1:22:06 |
|
| ShowTags | | Yes | 9/02/2004 22:52:09 |
|