Web User Agents Listing and Descriptions

My aim for this page is for you to be able to look for a user agent in a server log and find out what it really means. This will mostly be from my own experience, but if you have any corrections, email me on web@mrsneeze.com and I will gladly add in any changes.

I will also attempt to add in enough info to be able to parse a log and work out the user agent. There are examples of all the variation styles I have come accross.

All examples are ones that I have seen somewhere - none of them are created by hand. If I don't consider it relevant, however, I wont put them down - To know that the version numbers change is useful, to know they change in 20 different ways is not :)

This will probably never be up to date - as much as anything it's for my own interest. But feel free to tell me about things...

Web Browsers

Microsoft Internet Explorer

Mozilla/4.0 (compatible; MSIE 6.0; Windows 98)
Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0)
Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)
Mozilla/4.0 (compatible; MSIE 5.01; Windows NT)
Mozilla/4.0 (compatible; MSIE 5.0; Windows 95; DigExt; tco2)
Mozilla/4.0 (compatible; MSIE 4.5; Mac_PowerPC)
Mozilla/4.0 (compatible; MSIE 4.01; Windows 98; Messages.co.uk)
Mozilla/2.0 (compatible; MSIE 3.02; Win32)
Mozilla/2.0 (compatible; MSIE 3.01; Windows 95)


Format appears to be:
Mozilla/version (compatible; MSIE version; Operating system ; Extensions)

It appears that all versions 3.0 and above have Mozilla/version (compatible; MSIE which can distinguish this browser - the version is the equivalent netscape version. Watch out for the variation below for parsing though, and I'd imagine there are other variations.

Variations

This seems to be the AOL or Compuserve integrated version of IE. (Or the MSN provided version, im not too sure about that though) Mozilla/4.0 (compatible; MSIE 5.0; AOL 5.0; Windows 98; DigExt; VNIE4 3.1.814)
Mozilla/4.0 (compatible; MSIE 4.01; MSN 2.5; Windows 98)
Mozilla/4.0 (compatible; MSIE 5.0; MSN 2.5; AOL 4.0; Windows 98; DemoCD1; DigExt)
Mozilla/4.0 (compatible; MSIE 5.0; CS 2000; Windows 95; DigExt)


This format appears to be:
Mozilla/4.0 (compatible; MSIE version; MSN version; AOL version; Operating system; Extensions)

Both AOL and MSN are optional. Both are possible. MSN comes before AOL...

I dont know what this is. But it'd be irritating to parse cos its completely different from the rest... Mozilla/2.0 (compatible; MSIE 3.02; Update a; AK; Windows 95)


Netscape Navigator/Communicator and Mozilla

Netscape

Mozilla/4.7 [fr] (Win98; I)
Mozilla/4.7 [en] (X11; I; Linux 2.2.6 i586)
Mozilla/4.7 (Macintosh; I; PPC)
Mozilla/4.7 [en] (X11; I; HP-UX B.10.20 9000/782)
Mozilla/4.7C-CCK-MCD [en] (X11; I; SunOS 5.6 sun4u)
Mozilla/4.5 [en]C-CCK-MCD {C-UDP;HullUniASC} (Win95; I)
Mozilla/4.5 [en] (X11; I; IRIX64 6.5 IP30) Mozilla/4.08 [en] (Win95; I ;Nav)
Mozilla/4.08 (Macintosh; I; PPC, Nav)
Mozilla/4.04 [en]C-INFOAVE (Win95; U ;Nav)
Mozilla/3.04 (Win16; I)
Mozilla/3.01 (Macintosh; I; 68K)
Mozilla/3.01Gold (Win95; I)
Mozilla/3.01C-KIT (Win95; U)
Mozilla/3.0 (Win95; I; 16bit)
Mozilla/2.02E (Win95; U)
Mozilla (X11; I; Linux 2.0.32 i586)


Format appears to be
Mozilla/version [language encoding]optional info (Windowing system version; Security Level; Platform/other info;Nav (OR) , Nav)

Windowing system may also be operating system related. If the operating system is windows (Win9x, WinNT, Win16) there will be no platform field. The language appears to be on all version 4.0 and above on platforms other than the Mac version. Copies of the stand-alone browser Netscape Navigator have Nav appended (and it appears that it can be either a , or a ; preceding it)

The 16 bit windows version appears to have an 16bit in the platform field. Versions previous to 4.0 are all Navigator, and not Communicator.

The Security level is one of N, I or U - N is No security, I is weak security and U is strong security. This is an indication of the capabilities of your browser.

These are explained in detail on the Mozilla.org website: http://www.mozilla.org/build/revised-user-agent-strings.html - although this applies to mozilla rather than Netscape.

Note the annoying exception at the bottom... id imagine this is probably rare enough to ignore though (along with the people who send their own requests... :)

Mozilla

Mozilla/5.0 (X11; U; Linux i586; en-US; rv:0.9.5+) Gecko/20011101


These are pretty much the same as netscape ones, however, they have the additional version after rv:, and the version of Gecko appended (Gecko is one of the bits of the browser, see mozilla.org if you really want to know all about it.

Mozilla Engine based browsers

For example Galeon or Skipstone

Mozilla/5.0 Galeon/1.1 (Linux i686; U;) Gecko/20011014


This is pretty obvious really... The final Gecko is the version of the Gecko rendering engine, the Galeon bit says it's Galeon, and the bit in brakets is as for Mozilla.

Opera

The Opera browser is a commercial browser available for several different platforms.

Mozilla/4.0 (compatible; MSIE 5.0; Windows 98) Opera 6.0 [en]
Mozilla/4.0 (compatible; MSIE 5.0; Windows ME) Opera 5.12 [en]
Mozilla/4.0 (compatible; MSIE 5.0; Windows NT 5.1) Opera 5.12 [en]
Mozilla/4.0 (compatible; MSIE 5.0; Windows 2000) Opera 5.12 [en]
Mozilla/5.0 (Windows 98; U) Opera 5.12 [en]
Mozilla/5.0 (Windows 2000; U) Opera 5.11 [en]
Opera/5.12 (Windows 2000; U) [en]
Opera/5.12 (Windows NT 4.0; U) [fr]
Opera/5.0 (Linux 2.4.4-4GB i686; U)


I dont know why there's different user agents.

NetPositiove

Mozilla/3.0 (compatible; NetPositive/2.1.1; BeOS)
Mozilla/3.0 (compatible; NetPositive/2.0.1; BeOS)


Format appears to be:
Mozilla/3.0 (compatible; NetPositive/version; BeOS)

Similar to IE, in format at least, I'd guess that this works with more than just BeOS as the OS... but I doubt NetPositive is ported elsewhere, so I'll leave it till I know more. Recognisable by Mozilla/3.0 (compatible; NetPositive/

Konquerer (KFM)

Konqueror/1.1.2
Mozilla/5.0 (compatible; Konqueror/2.0; X11); Supports MD5-Digest; Supports gzip encoding
Mozilla/5.0 (compatible; Konqueror/2.2-11; Linux)


Format appears to be:
Konquerer/Version Mozilla/5.0 (compatible; Konqueror/version; Platform info)

The later versions have apparantly decided to masquerade as Mozilla.

Konqueror also has the ability to supply an arbitrary user agent to specific sites, in order to pretend to be a different browser.

Lynx

Lynx/2-4-2 (Bobcat/0.5 [DOS] Jp Beta04)
Lynx/2.8.1pre.9 libwww-FM/2.14
Lynx/2.8.3dev.20 libwww-FM/2.14FM


Format appears to be:
Lynx/Version Other Info

The Lynx/ bit at the front is pretty destinctive... There are ways of finding the platform out, but I've not seen enough of them to really know what it's sending.

This is slightly tied to the libwww entry that I've not got yet.

The Anonymizer

Mozilla/4.7 [en] (TuringOS; Turing Machine; 0.0)


Helper Programs

Download Managers

Go!Zilla 3.5 (www.gozilla.com)
SmartDownload/1.2.77 (Win32; Aug 17 1999)
SmartDownload/1.2.77 (Win32; Feb 1 2000)
NetZip-Downloader/1.MS0.62 (Win32; Dec 7 1998)
GetRight/3.2
DA 4.0
DA 5.0
DA 4.0 (www.downloadaccelerator.com)


Format appears to be:
Agent Version (info)
Agent/Version (info)


Offline Viewers

Offline Explorer/1.2
Teleport Pro/1.29


Format appears to be:
Agent/Version

Other helper programs

wget

Wget/1.5.3
Wget/1.7

wget is a tool for retrieving pages for whatever purpose, although it is particularly used for mirroring sites or as a site download tool.

Web robots

Spiders

Caching agents

Filtering agents

Dates	User agent string
01/2000	N2H2-BirdDog/flyingace-1.061
The N2H2 robot searches for content which may be used for a filtering program later, as far as I can tell. Not seen this one for ages.

Proxies

Dates	User agent string
11/2001	Mitsu/1.1.A UP.Link/4.2.2.9 (Google WAP Proxy/1.0)
Google's WAP proxy (for browsing the web on a mobile phone).
7/2001-04/2002	MSProxy/2.0
I'd guess that this is Microsoft's HTTP proxy server, but I don't really know.
1/2000-04/2002	Mozilla/4.0 (compatible; BorderManager 3.0)
Novell Border Manager. This is a firewall/proxy program used to filter out specific web sites from being accessed by users of a network.

Survey Robots

Dates	User agent string
09/2001-11/2001	sitecheck.internetseer.com
12/2001	sitecheck.internetseer.com (For more info see: http://sitecheck.internetseer.com)
The Internet Seer is a survey robot which keeps track of the net's connectivity.
11/2001	Mozilla/4.0 (compatible; Netcraft Web Server Survey)
I'd imagine this has been going around a while - this is from the Netcraft web survey.

Libraries and base robots

Sections of other programs used to make robots, or simple robots that dont have any specific purpose.

Dates	User agent string
08/2001	larbin larbin1.1.2@somewhere.com
09/2001	larbin_2.2.0 (crawl@compete.com)
01/2002-02/2002	larbin (samualt9@bigfoot.com)
01/2002-02/2002	larbin samualt9@bigfoot.com
01/2002	larbin_2.5.9 larbin2.5.9@unspecified.mail
Larbin - a multipurpose web crawler. It just downloads the pages, requires something else to parse the content of the pages. Not putting down all the versions ive seen, since they all follow the same sort of format. I've seen larbin in various guises since 08/2001 to 03/2002
?	libwww-perl/5.47
01/2002-04/2002	libwww-perl/5.53
The libwww-perl - a set of perl modules for accessing HTTP servers, generally. These are used in all sorts of other robots. the above are, I think, the default user agents.
04/2002	libwww-perl/5.52 FP/4.0
I'd guess this is some robot based on the perl, I don't know anything about it and it's probably not a regular visitor.
11/2001	lwp-trivial/1.32
11/2001-03/2002	LWP::Simple/5.53
01/2002-03/2002	libwww-perl/5.52 FP/4.0
These are, as far as I know, altered versions of libwww-perl. Hard to find a purpose, however.

Other Robots

Robots that are unknown (but known to be robots), or have a very specific purpose.

Dates	User agent string
?	Best-Ads.com Robot Spider (Web Banner Services), mail info@best-ads.com for information
Sent by the now defunct bestads.com service - I think it's part of a search engine, but it may have things to do with locating good sites for adverts.
?	ProxyHunter1.0
No idea about this one
01/2000	WDG_SiteValidator/1.1
The w3.org HTML site validator.
01/2000	nttdirectory_robot/0.9 (super-robot@super.navi.ocn.ne.jp)
No idea about this one
?	DIIbot/1.0
05/2001-07/2001	DIIbot/1.2 http://www.findsame.com/robot.html
The URL is dead, so I dont know what this bot was after...
06/2001-04/2002	LinkWalker
A product of Seven Twentyfour , this robot checks for broken links on webpages and emails the owner of the page to tell them the link is broken.
11/2001-12/2001	suzuran
Seen getting robots.txt but nothing else... dont know what this is.
01/2002-04/2002	nabot_1.0
02/2002-03/2002	NABOT/5.0
Again, a robot (got robots.txt) and a single directory - but I have no idea as to the purpose...
05/2001-02/2002	Mozilla/3.0 (compatible; Indy Library)
This might not be a robot, but it's very systematic. It ignores robots.txt, from what I can tell. It's requests come from hosts in china, but it's purpose doesnt seem to be known.
10/2001-04/2002	Checkbot/1.63 (modified) LWP/5.50
CheckBot is a robot to check that links on a page work properly.
10/2001-11/2001	Sqworm/2.9.77-BETA (beta_release; 20011016-753; i686-pc-linux-gnu)
11/2001-01/2002	Sqworm/2.9.85-BETA (beta_release; 20011115-775; i686-pc-linux-gnu)
I have no idea what this one is. It seems to ignore robots.txt, and only ever seems to get the root directory.
	IncyWincy(loopimprovements.com/robot.html)
02/2002-03/2002	IncyWincy/2.1(loopimprovements.com/robot.html)
Loop Improvements web spider, this only searches things in the open directory.
04/2002	NetResearchServer/2.2(loopimprovements.com/robot.html)
04/2002	NetResearchServer/2.3(loopimprovements.com/robot.html)
My guess is that this is the development version of the Loop Improvements IncyWincy spider. (see above)
09/2001-04/2002	psbot/0.1 (+http://www.picsearch.com/bot.html)
psbot is a picture search spider for picsearch. It should downlaod images and index them, im not sure yet exactly what else it does.
09/2001-04/2002	Mozilla/2.0 (compatible; T-H-U-N-D-E-R-S-T-O-N-E)
Rash assumption makes this the web spider for Thundestone - a search engine. They do sell their robot, so it could be from something else though.
01/2000-12/2001	Mozilla/3.0 (DreamKey/1.0)
02/2002-04/2002	Mozilla/3.0 (DreamKey/2.0)
Dreamkey is, as far as I know, some sort of browser (the files it gets just don't look like a robot's files). But I don't know any details at all, and it could be a cache or a proxy.

Others

Mozilla/3.0 (compatible; Win95)
Mozilla/3.0 WebTV/1.2 (compatible; MSIE 2.0)
Mozilla/4.0 (compatible; MSIE 4.01; Windows 98) via NetCache version NetApp Release 3.2.1R1D4: Wed Sep 23 12:20:08 PDT 1998¸
WhosTalking/2.00.0
Microsoft URL Control - 6.00.8169
RPT-HTTPClient/0.3-2
Mozilla/4.0 (Windows 4.10;US) Opera 3.60 [en]
VCI WebViewer VCI WebViewer Win32
Mozilla/2.0 (compatible; MS FrontPage 3.0)
EmailWolf 1.00
contype
WhizBang! Lab
MIIxpc/4.1
HLoader
InfoSeek Sidewinder/0.9
Microsoft Internet Explorer/4.40.426 (Windows 95)
NetShift=4.51
OmniWeb/2.7-beta-3 OWF/1.0
DGO/0.1
Mozilla/3.0 (compatible; Webinator-i13.inet911.com/2.53)

08/2001 teomaagent crawler-admin@teoma.com
cosmos/0.8_(robot@xyleme.com)

09/2001

Mozilla/3.04 (compatible; ANTFresco/2.13; NC OS 1.06)
teomaagent crawler-admin@teoma.com
teomaagent1 [crawler-admin@teoma.com]
flunky
Slarp/0.1

10/2001
Mozilla/4.0 (compatible; MSIE 5.01; Windows 98; MSOCD; AtHome020; AtHome0200; MSIECrawler)
Slarp/0.1
flunky
Gulper Web Bot 0.2.4 (www.ecsl.cs.sunysb.edu/~maxim/cgi-bin/Link/GulperBot)
cosmos/0.8_(robot@xyleme.com)

11/2001: Mozilla/1.22 (Compatible; Notes v4.0 OS/2 Server; InterNotes Navigator/4.0)
Mozilla/3.0 (Liberate DTV 1.1)
Mozilla/4.0 (compatible; DnloadMage 1.0)
Mozilla/4.0 WebTV/2.6 (compatible; MSIE 4.0)
RealDownload/4.0.0.40
iCab/2.6 (Macintosh; I; PPC)
Mozilla/3.04 (compatible; ANTFresco/2.13; NC OS 1.06)
MFC_Tear_Sample
Mozilla/4.05
Microsoft URL Control - 6.00.8862
Microsoft URL Control - 5.01.4319
InternetLinkAgent/3.1

12/2002:
Nokia3330/1.0 (04.30) UP.Link/4.2.2.9 (Google WAP Proxy/1.0)
webcollage/1.78
LinkCheck Gizmotech Bot/1.0
ArchitextValidator

01/2002:
Microsoft Data Access Internet Publishing Provider Protocol Discovery
cosmos/0.9_(robot@xyleme.com)
Mozilla/2.0 (compatible; MS FrontPage 5.0)
MSFrontPage/5.0
Mozilla/3.0 (Liberate DTV 1.1)
MFC_Tear_Sample
Mozilla/2.0 (compatible; MS FrontPage 4.0)
PocoMail 2.5 (974) - Registered Version
search.ch V1.4.2 (spiderman@search.ch; http://www.search.ch)
Nokia6210/1.0 (05.17) (Google WAP Proxy/1.0)
Mozilla/4.0 (compatible; MSIE 5.0; www.galaxy.com; www.mrsneeze.com)
Download Demon/3.5.0.11
Mozilla/4.0_(compatible;_MSIE_5.0;_Windows_95)_TrueRobot/1.4 libwww/5.2.8
Xenu Link Sleuth 1.2b
netnose.com/v1.0

02/2002:
Nokia3330/1.0 (04.30) UP.Link/4.2.2.9 (Google WAP Proxy/1.0)
Inet library
UCMore Crawler App
LexiBot/1.00
UIowaCrawler/1.0
DOF-Verify/1.1 (http://www.dreamsoffreedom.co.uk)
Harvest/HARVEST_VERSION
ZoneSurf/2.4 (compatible; NetPositive/3.0d1; BeOS)
ZoneSurf/2.4 (BeOS; U; BeOS 5.0 BePC; en-US; 0.8)
hverify/1.0
PHP/4.0.6

03/2002:
UCmore
Mozilla/4.0_(compatible;_MSIE_5.0;_Windows_95)_VoilaBot/1.6 libwww/5.3.2
Pompos/1.0 pompos@iliad.fr
Mozilla/3.0 (Liberate DTV 1.1)
Mozilla/3.0 (Liberate DTV 1.2)
Robozilla/1.0
SiteCutter/v0.1 (www.psychedelix.com)
Inet library
gazz/2.1 (gazz@nttrd.com)
webcollage/1.78
webcollage/1.82
webcollage/1.87
knowledge/0.5
HLoader
DOF-Verify/1.1 (http://www.dreamsoffreedom.co.uk)
Links SQL (http://gossamer-threads.com/scripts/links-sql/)
indexer0.1b

04/2002:
Bjaaland/0.9 (bjaaland@antarcti.ca)
DOF-Verify/1.1 (http://www.dreamsoffreedom.co.uk)
Links SQL (http://gossamer-threads.com/scripts/links-sql/)
Microsoft URL Control - 6.00.8862
Mozilla/3.0 (DreamPassport/3.0; CAPCOM/MOEROJUSTICEGAKUEN)
Mozilla/3.0 (Liberate DTV 1.1)
Mozilla/3.0 (Vagabondo/1.1 MT; webagent@wise-guys.nl; http://webagent.wise-guys.nl/)
Mozilla/4.0 (compatible; grub-client-0.3.0; Crawl your own stuff with http://grub.org)
Nokia3330/1.0 (04.50) (Google WAP Proxy/1.0)
Pompos/1.0 pompos@iliad.fr
RealDownload/4.0.0.40
RealDownload/4.0.0.42
UCmore
Vagabondo/1.1 MT (webagent@wise-guys.nl)
bumblebee@relevare.com
webcollage/1.87





Back To Main Page