# Feedfetcher-Google Feedfetcher-Google is a specialized web crawler from Google that retrieves RSS and Atom feeds on behalf of users. It is not an autonomous web crawler but a user-triggered fetcher; it only visits a feed URL when a user has explicitly subscribed to it through a Google service like Google News. Its purpose is to efficiently deliver updated feed content to users while reducing bandwidth consumption for publishers. Breadcrumb navigation - [Privacy-focused, simple website analytics](https://plainsignal.com/) - [Agents](https://plainsignal.com/agents "Agents, User-Agents, Crawlers, Browsers") - [Feedfetcher-Google](https://plainsignal.com/agents/feedfetcher-google) ## What is Feedfetcher-Google? Feedfetcher-Google is an official crawler from Google designed specifically to retrieve RSS and Atom feeds from websites. It is classified as a user-triggered fetcher, meaning it does not autonomously discover content. Instead, it activates only when users subscribe to a feed through a Google service, such as Google News, or when publishers use technologies like PubSubHubbub. The bot identifies itself in server logs with the user-agent string `Feedfetcher-Google`. It operates on a distributed system to improve performance and efficiently deliver feed updates. ## Why is Feedfetcher-Google crawling my site? Feedfetcher-Google is visiting your site because one or more users have subscribed to your RSS or Atom feed through a Google service. The visit is always initiated by a user's action and is not part of an automated web crawl. The frequency of its visits depends on how often your feed is updated and the number of subscribers you have through Google's services. It generally should not retrieve feeds more than once per hour on average. Its presence is a sign of direct user interest in your syndicated content. ## What is the purpose of Feedfetcher-Google? The primary purpose of Feedfetcher-Google is to act as an intermediary that delivers requested feed content to users of Google services. It retrieves, stores, and refreshes RSS or Atom feeds on behalf of users. Unlike general web crawlers, it typically does not index the content it collects for Google Search (with the exception of podcasts). By fetching a feed once for multiple subscribers, Feedfetcher helps conserve bandwidth for publishers while still providing timely updates to users. For publishers, its activity indicates an active and engaged audience within the Google ecosystem. ## How do I block Feedfetcher-Google? If you wish to prevent Google's feed fetching service from accessing your RSS or Atom feeds, you can add a rule to your `robots.txt` file. Note that this will prevent users from subscribing to and receiving updates from your feeds through Google's services. To block Feedfetcher-Google, add the following lines to your `robots.txt` file: ``` User-agent: Feedfetcher-Google Disallow: / ``` ## Related agents and operators ## Canonical Human friendly, reader version of this article is available at [Feedfetcher-Google](https://plainsignal.com/agents/feedfetcher-google) ## Copyright (c) 2025 [PlainSignal](https://plainsignal.com/ "Privacy-focused, simple website analytics")