Logo
Home
 
User Agents
New Agents
List All
My User Agent
Add New
 
User-Agents Database
User Agents

User Agents

User Agent Date Added
FARKedit7/02/2004 13:55:07
Fast URL Checkeredit6/01/2020 8:45:28
FavOrgedit7/02/2004 13:55:23
Flinchedit7/02/2004 13:55:50
Flinch is a powerful and flexible web link checker that will make your life as a web designer or web server admin easier.
GetterroboPlus Puuedit27/07/2005 22:57:34
Puu robot is used to gater data from registered site in Search Engin "straight FLASH!!" for building anouncement page of state of renewal of registered site in "straight FLASH!!". Robot runs everyday. Purpose of the robot. One or more of: - gathering: gather data of original standerd TAG for Puu contains the information of the sites registered my Search Engin. - maintenance: link validation

This robot patorols based registered sites in Search Engin "straight FLASH!!"
GetURLedit12/02/2004 20:46:59
Its purpose is to validate links, perform mirroring, and copy document trees. Designed as a tool for retrieving web pages in batch mode without the encumbrance of a browser. Can be used to describe a set of pages to fetch, and to maintain an archive or mirror. Is not run by a central site and accessed by clients - is run by the end user or archive maintainer
GFW-URL-checkeredit25/09/2015 0:00:43
Golemedit12/02/2004 20:48:11
Golem generates status reports on collections of URLs supplied by clients. Designed to assist with editorial updates of Web-related sites or products.
HHG Robotedit7/02/2004 13:58:57
HHG Robot is a web robot which checks the listed hotels' home pages and email addresses continously.
ht://checkedit7/02/2004 16:58:31
ht://Check is more than a link checker. It's a console application written for GNU/Linux systems in C++ and derived from the best search engine available on the Internet for free: ht://Dig.
Html Link Validatoredit7/02/2004 17:53:56
Html Link Validator is a tool for checking web pages for broken links on web server, on your local computer, Internet Explorer and Netscape Navigator favorites, internet shortcuts. It can validate thousands HTML documents at once.
HubSpot Links Crawleredit23/10/2015 1:15:12
HubSpot Url Validation Checkedit13/02/2021 6:39:08
IABotedit7/10/2019 17:33:46
IBM_Planetwideedit7/03/2004 23:48:26
Restricted to IBM owned or related domains.
IDS LinkCheckeredit7/02/2004 14:02:30
The Internet Database Service (IDS) provides access to more than 50 databases published by CSA and its publishing partners. Whether you require only the most current resources for a few individuals, or archives to support the needs of an entire organization, academic campus, or consortium, IDS can provide cost-effective access to current research in multiple disciplines.
IE-Favorites-Checkedit2/06/2006 0:57:59
IE Favorites Check (IEFC for short) is a program designed to help the users of Internet Explorer to manage their Favorites. It was tested with IE versions 4, 5.5 and 6 under Windows 95, NT and 2000. It is freeware, fast and hopefully useful.
InAGist URL Resolveredit25/01/2013 17:37:55
InfoLinkedit7/02/2004 14:03:05
Inspector Webedit8/03/2004 0:12:18
Provide inspection reports which give advise to WWW site owners on missing links, images resize problems, syntax errors, etc.
Internet Shinchakubinedit25/07/2005 0:57:01
makes a list of new links and changed pages based on user's frequently clicked pages in the past 31 days. client may run this software one or few times every day, manually or specified time.

shipped for SHARP's PC users since Feb 2000
JoeBotedit8/03/2004 0:44:38
JoeBot is a generic web crawler implemented as a collection of Java classes which can be used in a variety of applications, including resource discovery, link validation, mirroring, etc. It currently limits itself to one visit per host per minute.
JRTS Check Favoritesedit7/02/2004 14:04:27
Check Favorites is a full-featured solution for maintaining all of the Internet-based links in your Favorites list (bookmarks). Check Favorites can check multiple links simultaneously and can optionally remove all of the broken links for you. Check Favorites also supports the ability to export your Favorites in a variety of formats, as well as the ability to extract, check, and export the links contained on any HTML page on your system, or accessible via the Internet (thus acting like a kind of link checker and ripper).
JS-Kit URL Resolveredit8/08/2015 14:02:47
Kaspersky Lab CFR link resolveredit24/01/2017 15:09:22
Larry's Link Checkeredit7/02/2004 14:05:11
Link Checker Proedit7/02/2004 14:07:36
Link Checker Pro is an essential utility for anybody wishing to check internal and external links within their Internet site.
Link Validatoredit8/03/2004 1:09:45
Recursively checks all links on a site, looking for broken or redirected links. Checks all off-site links using HEAD requests and does not progress further. Designed to behave well and to be very configurable.
Link Validity Checkedit20/12/2012 16:02:41
LinkAlarmedit6/02/2004 1:06:53
LinkAlarm scans client sites on their request. The purpose is to check internal and external links on the site. The Link Alarm bot checks external links in our client's site pages. It only checks those specific links and does not broadly scan sites.

LinkAlarm tries hard to be a good player on the internet with low site impact and good bot netiquette.
LinkBotedit7/02/2004 14:09:07
Watchfire WebQA, the next generation of Linkbot, is a website quality testing tool designed for small, medium, and departmental websites.
LinkCheck by Siteimprove.comedit25/06/2014 8:26:15
LinkCheckeredit13/05/2006 13:14:36
LinkChecker - check websites and HTML documents for broken links
linkCheckVedit20/12/2017 10:17:14
LinkExchangeedit10/02/2004 0:59:37
LinkextractorProedit8/09/2006 11:51:36
?
linkfluence.netedit25/01/2016 10:16:52
LinkLintedit7/02/2004 14:10:20
Linklint is an Open Source Perl program that checks links on web sites. It is licensed under the Gnu General Public License.
Linknet.be Link Checkeredit11/10/2006 1:21:28
LinkScanedit7/02/2004 14:12:22
LinkScan is an industrial-strength link checking and website management tool.
LinkScan checks links, validates HTML and creates site maps
LinkSweeperedit7/02/2004 14:13:40
Linksweeper will search through Netscape bookmarks and Internet Explorer favorites and find all of the bookmarks that no longer work.
LinkWalkeredit6/02/2004 1:07:37
Link Walker crawls the web for broken links, offering the 'service' to site owners.
LinkWalker generates a database of links and sends reports of bad ones to webmasters.
Maxamine Web Analystedit7/02/2004 17:00:15
MBCrawleredit1/11/2017 11:28:33
MOMspideredit25/07/2005 0:44:17
to validate links, and generate statistics. It's usually run from anywhere

Originated as a research project at the University of California, Irvine, in 1993. Presented at the First International WWW Conference in Geneva, 1994.
naverbookmarkcrawleredit6/02/2014 15:07:26
NetCarta WebMap Engineedit25/07/2005 0:59:30
The NetCarta WebMap Engine is a general purpose, commercial spider. Packaged with a full GUI in the CyberPilo Pro product, it acts as a personal spider to work with a browser to facilitiate context-based navigation. The WebMapper product uses the robot to manage a site (site copy, site diff, and extensive link management facilities). All versions can create publishable NetCarta WebMaps, which capture the crawled information. If the robot sees a published map, it will return the published map rather than continuing its crawl. Since this is a personal spider, it will be launched from multiple domains. This robot tends to focus on a particular site. No instance of the robot should have more than one outstanding request out to any given site at a time. The User-agent field contains a coded ID identifying the instance of the spider; specific users can be blocked via robots.txt using this ID.
NetMechanicedit25/07/2005 1:00:21
NetMechanic is a link validation and HTML validation robot run using a web page interface.
NetSpideredit8/09/2006 12:18:39
The primary objective of NetSpider is to extract and display all the links and local references from a selected page and to allow the user to download them. All the extracted links to other pages can be processed further in the same manner. The program supports resume and has a facility for sites requiring user names and passwords. It is able to accept pages for processing and files for downloading from clipboard.
NetVisualizeedit2/06/2006 1:17:52
Manage Your Favorites and Bookmarks Visually

Add new user agent

User Agents - Search

Enter keyword or user agent: