# Mastodon bot

The Mastodon bot is a web fetcher for the decentralized social network Mastodon. It is not a general-purpose crawler but an on-demand agent that activates when a user shares a URL on a Mastodon instance. Its purpose is to retrieve metadata like titles, descriptions, and images to generate the rich link previews that appear in posts. For website owners, this enhances how your content is presented when shared, potentially increasing visibility and click-through rates.

Breadcrumb navigation

- [Privacy-focused, simple website analytics](https://plainsignal.com/)
- [Agents](https://plainsignal.com/agents "Agents, User-Agents, Crawlers, Browsers")
- [Mastodon bot](https://plainsignal.com/agents/mastodon-bot)


## What is the Mastodon bot?

The Mastodon bot is a web fetcher for the open-source, decentralized social network Mastodon. It is not a traditional web crawler; rather, it retrieves content on behalf of a specific Mastodon server (or 'instance') when a user shares a link. It identifies itself with a user-agent string that includes both the Mastodon software version and the domain of the instance making the request, for example: `Mastodon/4.3.2 (+https://mastodon.social/)`. Because Mastodon is a federated network of independent servers, there is no single operator; each server has its own administrators.


## Why is the Mastodon bot crawling my site?

A Mastodon bot is visiting your website because a user on a Mastodon instance has shared a link to one of your pages in a post. The bot is dispatched on-demand to gather metadata—such as the page title, description, and a thumbnail image—to generate a rich link preview. The frequency of visits is directly tied to how often users share your links across the Mastodon network. This is a standard and authorized practice for social media platforms to enhance the user experience.


## What is the purpose of the Mastodon bot?

The primary purpose of the Mastodon bot is to improve the user experience by providing rich previews for links shared within the platform. When a link is posted, the bot fetches metadata to display a preview card with an image, title, and description. This benefits both users, by providing context, and website owners. For site owners, these previews can increase visibility and click-through rates when content is shared across the Mastodon network. The data collected is used solely for generating these previews and not for other purposes like AI training or search indexing.


## How do I block the Mastodon bot?

If you wish to prevent Mastodon from generating link previews for your site, you can block its fetcher using your `robots.txt` file. Note that this will cause links to your site to appear as plain text URLs.

To block the bot, add the following lines to your `robots.txt` file:

```
User-agent: Mastodon
Disallow: /
```


## Related agents and operators


## Canonical

Human friendly, reader version of this article is available at [Mastodon bot](https://plainsignal.com/agents/mastodon-bot)

## Copyright

(c) 2025 [PlainSignal](https://plainsignal.com/ "Privacy-focused, simple website analytics")