Moteur de recherche

HTML

Combine/2.0 (((vu le 2006-03-15)))
Gigabot/2.0/gigablast.com/spider.html
Mozilla/2.0 (compatible; Ask Jeeves/Teoma; +http://sp.ask.com/docs/about/tech_crawling.html)
Mozilla/4.0 compatible ZyBorg/1.0 Dead Link Checker (wn.dlc@looksmart.net; http://www.WISEnutbot.com)
Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
msnbot/0.9 (+http://search.msn.com/msnbot.htm)
msnbot/1.0 (+http://search.msn.com/msnbot.htm)
NG/2.0
Nokia6820/2.0 (4.83) Profile/MIDP-1.0 Configuration/CLDC-1.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)
NutchCVS/0.7.1 (Nutch running at UW; http://crawlers.cs.washington.edu/; sycrawl@cs.washington.edu)
OrangeSpider
SBIder/0.8-dev (SBIder; http://www.sitesell.com/sbider.html; http://support.sitesell.com/contact-support.html)

RSS

FeedFetcher-Google; (+http://www.google.com/feedfetcher.html)
Feedreader
Liferea/1.0.7 (Linux; fr_FR.UTF-8; http://liferea.sf.net/)
NewsAlloy/1.1 (http://www.NewsAlloy.com; 1 subscribers)
rawdog/2.4

Images

Exabot-Images/1.0