System: Searchable Directory of User Agents: RSS/Atom Aggregators
The following is a directory of user agents, including their source and general
purpose as far as we can determine. Most entries link to an
"official" site containing more detailed information. You can
also paste a UA from your logs into the form below, hit [Go!] and see a
list the relevant agents.
We currently have 946 distinct user agents in our database representing everything from search engines to software components and spambots. These have been collected from our log files over a number of years and researched manually.
Search for User Agent
To use this form just copy and paste an entire User-Agent
string from your server log file into the input box and then submit the
form. The search is case-sensitive so "nokia" will not
Most user agent strings now contain a number of separate components
so the search will return a list of everything that has a match in the
These are browser extensions or search spiders that focus on indexing or aggregating RSS and Atom feeds.
- 1) AideRSS - www.aiderss.com/
- 2) Akregator - akregator.sourceforge.net/
- akregator allows you to browse through thousands of internet feeds without the hassle of using a web browser.
- 3) AppleSyndication - www.apple.com/macosx/features/safari/
- Safari RSS reader
- 4) Blog Conversation Project - gking.harvard.edu/blogconv/
- Our main interest is developing aggregate summaries across millions of blogs, rather than providing information about any individual blogger: We are studying the conversation, not any individual participant in that conversation.
- 5) Bloglines - www.bloglines.com/
- An integrated service for searching, subscribing, publishing and sharing news feeds, blogs, and rich Web content.
- 6) BlogPulse - www.blogpulse.com/
- BlogPulse applies machine-learning and natural-language processing techniques to discover trends in the highly dynamic world of blogs.
- 7) BlogSearch - www.icerocket.com/
- 8) Blogslive
- 9) BlogsSay - www.blogssay.com/
- Blog and Feed Search Engine.
- 10) BottomFeeder - www.cincomsmalltalk.com/BottomFeeder/
- BottomFeeder is a news aggregator client (RSS and Atom) written in VisualWorks Smalltalk.
- 11) CaRP - www.geckotribe.com/rss/carp/
- Caching RSS Parser
- 12) edgeio - www.edgeio.com/
- 13) FacebookFeedParser
- 14) Feed2Imap - home.gna.org/feed2imap/
- Feed2Imap is an attempt to solve the problem most roaming users experience when trying to keep up with their feeds.
- 15) FeedBurner - www.feedburner.com/
- FeedBurner is the leading provider of media distribution and audience engagement services for blogs and RSS feeds.
- 16) Feedfetcher - www.google.com/feedfetcher.html
- Google's Feedfetcher attempts to obtain the content of the feed in order to display it. Since all requests come from humans, Feedfetcher has been designed to ignore robots.txt
- 17) FeedFetcher-Google - www.google.com/feedfetcher.html
- Feedfetcher is how Google grabs RSS or Atom feeds when users choose to add them to their Google homepage.
- 18) Fresh Search - www.terrar.com/
- One of the oldest RSS search engines on the net.
- 19) Hub MetaDataFetcher - www.feedhub.com/
- 20) JetBrains - www.jetbrains.com/omea/reader/
- Free and easy to use RSS reader, NNTP news reader, and web bookmark manager.
- 21) kinjabot - kinja.com/
- Kinja is a weblog portal, collecting news and commentary from some of the best sites on the web.
- 22) Liferea - liferea.sourceforge.net/
- Liferea is an abbreviation for Linux Feed Reader. It is a news aggregator for online news feeds. It supports a number of different feed formats including RSS/RDF, CDF, Atom, OCS, and OPML.
- 23) NetNewsWire - ranchero.com/netnewswire/
- NetNewsWire is an easy-to-use RSS Web news reader for Mac OS X.
- 24) NewsFire - www.newsfirerss.com/
- NewsFire is the ultimate RSS experience for the Mac.
- 25) NewsGator - www.newsgator.com/
- NewsGator is a "news aggregator" that runs in Microsoft Outlook.
- 26) NewsGatorOnline - www.newsgator.com/
- Read all of your favorite news, websites and blogs all in one place
- 27) ping.blo.gs - blo.gs/ping.php
- ping a weblog
- 28) PubSub - www.pubsub.com/
- 29) PulpFiction - freshlysqueezedsoftware.com/products/pulpfiction/
- 30) Raggle - www.raggle.org/
- Open-source console-based RSS aggregator, written in Ruby, for Linux, Unix and Windows.
- 31) rss2email - www.aaronsw.com/2002/rss2email/
- rss2email is a simple Python script that lets you subscribe to a list of XML newsfeeds (RSS or Atom) and get new items sent to you by email.
- 32) RssBandit - www.rssbandit.org/
- An RSS/Atom aggregator for your desktop written with the .NET Framework.
- 33) rss-bot - www.rss-bot.de/
- RSS search engine bot for www.plazoo.com/
- 34) RSS-SPIDER - www.rss-spider.com/fsb.php
- Feed Seeker Bot (FSB) is RSS-Spider's home page crawling robot.
- 35) SharpReader - www.sharpreader.net/
- SharpReader is an RSS/Atom Aggregator for Windows
- 36) SimplePie - simplepie.org/
- SimplePie is a very fast and easy-to-use class, written in PHP.
- 37) Strategic Board - www.strategicboard.com/
- Strategic Board is a feeds search engine.
- 38) topicblogs - www.topicblogs.com/
- 39) UniversalFeedParser - www.feedparser.org/
- Parse RSS and Atom feeds in Python.
- 40) WordPress - wordpress.org/
- WordPress is what you use when you want to work with your blogging software, not fight it.
- 41) Yahoo-Blogs - help.yahoo.com/help/us/ysearch/crawling/crawling-02.html
- YahooSeeker/bsv3.9 is Yahoo!'s blog indexing robot.
- 42) YahooFeedSeeker - my.yahoo.com/s/publishers.html
- The name of the user-agent that refreshes RSS feeds for My Yahoo! is "YahooFeedSeeker."
- 43) YouReadMe - www.youreadme.com/
- There are just too many blogs out there. No mortal can read them all.
For more information on the user agents listed you can click on the
associated link. If you think any of the information here is incorrect
or misleading please let us know using the Feedback link below.
Please be aware that we do not add user agents to the database on
request, but rather wait to see them in our log files.
Browse User Agents by Category
- Browser Extensions (42)
- Browser extensions are programs that change or enhnace your web browser. Some of them also collect data by sending information on your browsing habits back to a central server.
- Content Management (13)
- Data Collection - Commercial (47)
- These are sites that collect information for commercial benefit. As far as we are aware no useful information or reports are provided to the public.
- Data Collection - Research (29)
- These agents are conducting research on the WWW. They may also offer commercial services.
- Devices (23)
- Mobile phones and other gadgets with browser technology.
- Download Managers (39)
- Programs that enable users to download or extract information from a website or web server.
- Indexing Tools (50)
- This is software that enables local or remote indexing of web pages and other content for the purposes of setting up a search engine.
- Link Checking Utilities (41)
- This is software that conducts remote or local link checking.
- Media Players (5)
- Applications for playing music, video and other media over the Internet.
- Other Resources (12)
- Links to online resources relating to robots and spiders.
- Proxies (7)
- If several clients request the same content, the proxy can deliver that content from its cache, rather than requesting it from the origin server each time.
- RSS/Atom Aggregators (43)
- These are browser extensions or search spiders that focus on indexing or aggregating RSS and Atom feeds.
- Search Engine Spiders (220)
- These agents conduct Internet-wide indexing for various search engines.
- Server Platforms (6)
- Server Software (31)
- Site Monitoring Services (15)
- Software Components (58)
- These are code libraries or application development packages that can be used to build Internet-related applications. How they are used depends on the developer.
- Spambots? (45)
- These are programs that are used predominately to harvest email addresses, find open guestbooks to post to, etc. They may also have legitimate uses.
- Unclassified (174)
- The following user agents have either not been identified or do not fit neatly into other categories. New agents appear every day that have limited lifespans. Most (but not all) legitimate user agents identify themselves with a URI or email address.
- Validation Tools (10)
- These are programs and sites that can be used to validate various aspects of your site: HTML, CSS, META tags, etc.
- Web Browsers (36)
Send a message to The Art of Web:
press <Esc> or click outside this box to close