Logo
Home
 
User Agents
New Agents
List All
My User Agent
Add New
 
User-Agents Database

User Agents

User Agent Date Added
Link Validatoredit8/03/2004 1:09:45
Recursively checks all links on a site, looking for broken or redirected links. Checks all off-site links using HEAD requests and does not progress further. Designed to behave well and to be very configurable.
Link Validity Checkedit20/12/2012 16:02:41
LinkAlarmedit6/02/2004 1:06:53
LinkAlarm scans client sites on their request. The purpose is to check internal and external links on the site. The Link Alarm bot checks external links in our client's site pages. It only checks those specific links and does not broadly scan sites.

LinkAlarm tries hard to be a good player on the internet with low site impact and good bot netiquette.
LinkBotedit7/02/2004 14:09:07
Watchfire WebQA, the next generation of Linkbot, is a website quality testing tool designed for small, medium, and departmental websites.
LinkCheck by Siteimprove.comedit25/06/2014 8:26:15
LinkCheckeredit13/05/2006 13:14:36
LinkChecker - check websites and HTML documents for broken links
linkCheckVedit20/12/2017 10:17:14
LinkExchangeedit10/02/2004 0:59:37
LinkextractorProedit8/09/2006 11:51:36
?
linkfluence.netedit25/01/2016 10:16:52
LinkLintedit7/02/2004 14:10:20
Linklint is an Open Source Perl program that checks links on web sites. It is licensed under the Gnu General Public License.
Linknet.be Link Checkeredit11/10/2006 1:21:28
LinkScanedit7/02/2004 14:12:22
LinkScan is an industrial-strength link checking and website management tool.
LinkScan checks links, validates HTML and creates site maps
LinkSweeperedit7/02/2004 14:13:40
Linksweeper will search through Netscape bookmarks and Internet Explorer favorites and find all of the bookmarks that no longer work.
LinkWalkeredit6/02/2004 1:07:37
Link Walker crawls the web for broken links, offering the 'service' to site owners.
LinkWalker generates a database of links and sends reports of bad ones to webmasters.
Maxamine Web Analystedit7/02/2004 17:00:15
MBCrawleredit1/11/2017 11:28:33
MOMspideredit25/07/2005 0:44:17
to validate links, and generate statistics. It's usually run from anywhere

Originated as a research project at the University of California, Irvine, in 1993. Presented at the First International WWW Conference in Geneva, 1994.
naverbookmarkcrawleredit6/02/2014 15:07:26
NetCarta WebMap Engineedit25/07/2005 0:59:30
The NetCarta WebMap Engine is a general purpose, commercial spider. Packaged with a full GUI in the CyberPilo Pro product, it acts as a personal spider to work with a browser to facilitiate context-based navigation. The WebMapper product uses the robot to manage a site (site copy, site diff, and extensive link management facilities). All versions can create publishable NetCarta WebMaps, which capture the crawled information. If the robot sees a published map, it will return the published map rather than continuing its crawl. Since this is a personal spider, it will be launched from multiple domains. This robot tends to focus on a particular site. No instance of the robot should have more than one outstanding request out to any given site at a time. The User-agent field contains a coded ID identifying the instance of the spider; specific users can be blocked via robots.txt using this ID.
NetMechanicedit25/07/2005 1:00:21
NetMechanic is a link validation and HTML validation robot run using a web page interface.
NetSpideredit8/09/2006 12:18:39
The primary objective of NetSpider is to extract and display all the links and local references from a selected page and to allow the user to download them. All the extracted links to other pages can be processed further in the same manner. The program supports resume and has a facility for sites requiring user names and passwords. It is able to accept pages for processing and files for downloading from clipboard.
NetVisualizeedit2/06/2006 1:17:52
Manage Your Favorites and Bookmarks Visually
ODP links testedit7/04/2004 17:24:29
online link validatoredit8/12/2009 23:42:26
Ontolicaedit7/02/2004 16:26:55
ow.ly web crawleredit8/08/2015 14:34:03
Pack Ratedit25/07/2005 1:13:56
Used for local maintenance and for gathering web pages so that local statisistical info can be used in artificial intelligence programs. Funded by NEMOnline.
Page Modified Crawleredit14/08/2017 23:59:55
page_verifieredit1/10/2007 23:52:27
Secure Computing Page Verifier
page-checkedit10/06/2012 23:16:52
PostFavoritesedit3/05/2006 1:26:28
Yahoo Search My Web
- Save what you like to build your own personal web
- "Re-find" pages instantly when you need them again
- Share your personal web
- Better than bookmarks
RDS URL Checkeredit7/02/2004 16:28:37
Information Resource Management Tool/Web Portal
REL Link Checkeredit7/02/2004 16:31:31
REL Link Checker Lite is a free easy-to-use link checker tool to help you maintain the accuracy of links on your web site. The program will help you easily locate broken links and links containing syntactic errors.
REL Web Link Validatoredit7/02/2004 16:32:32
Web Link Validator is a powerful site management and link checker tool that helps webmasters automate the process of web site testing. The software performs thorough analysis of a Web site: finds broken links (including those using JavaScript and Flash), orphaned files, slow-loading, deep, outdated and small-sized pages.

http://www.weblinkvalidator.com/
SafeAds.xyz botedit7/11/2015 6:34:42
ShowyouBotedit25/01/2013 17:36:36
A part of the Showyou service is bringing videos into our users' feeds shared on many different social networks. Many social networks include links to external sites, but not direct information about videos. This means that sometimes we need to follow these links to inspect the page and determine if the link is, in fact, a link to a video. We do very aggressive caching so you shouldn't see us in your logs more than once a day for any one URL.
SolomonoLinkCheckeredit4/09/2012 18:59:14
stackexchangebotedit10/06/2012 23:39:13
SuperHTTPedit9/09/2006 0:30:21
A full featured personal web spider. Use it to download entire websites for offline viewing, collect images or other file types off the internet, grab entire collections of files, Query search engines, or check links on your web site.
Surfbotedit9/09/2006 0:32:04
The Jubii Indexing Robotedit8/03/2004 0:46:39
Its purpose is to generate a Resource Discovery database, and validate links. Used for indexing the .dk top-level domain as well as other Danish sites for aDanish web database, as well as link validation.
TulipChainedit8/02/2004 23:34:56
A specialized browser , link checker, and editor for dmoz.org which presents the contents in an explorer view.
Tweakiedit30/04/2006 1:11:08
Tweaki puts several Windows utilities into one easy to use program while adding hundreds of additional tweaks not found in other system tweakers. Tweaki exposes Windows optimizations that make your computer run and boot faster, secure your computer from unauthorized access, tweak Microsoft Office and Internet Explorer, prevent access to web sites, stop users from downloading files from the Internet, manage your Internet Explorer Favorites and add productivity enhancements like forcing Windows Explorer to open in any folder of your choosing or create a right click SendTo menu --even delete a file that you couldn't delete before. Tweaki gives you access to hundreds of hidden Windows features while adding functionality that makes your version of Windows easier to use.
TYPO3-linkvalidatoredit31/05/2014 15:29:21
up.ruedit25/01/2012 1:47:28
URLBlazeedit9/09/2006 0:41:48
URLCheckeredit6/02/2014 14:33:15
URLy Warningedit9/09/2006 0:44:06
Get Notified Instantly When Any Web Page Changes.
And See Exactly What's Been Changed!
ValidURLedit6/02/2014 15:11:41

Add new user agent

User Agents - Search

Enter keyword or user agent: