# Search engines and AI assistants may read every public page: the home page, the blog, the # comparisons, and the docs. The AI crawlers are named so a stricter default later can't shut them # out by accident; they share the one set of rules below. User-agent: * User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: GPTBot User-agent: Claude-SearchBot User-agent: Claude-User User-agent: ClaudeBot User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended User-agent: Applebot-Extended User-agent: Amazonbot User-agent: DuckAssistBot User-agent: MistralAI-User User-agent: meta-externalagent # The app's own pages hold private chats and projects, which a crawler can't see anyway. Disallow: /c/ Disallow: /chat/ Disallow: /p/ Disallow: /studio Disallow: /report/ Disallow: /r/ # Plugins' sign-ins and the small files they read, which are for the plugins and no search result. Disallow: /plugins/ Sitemap: https://trymorse.ai/sitemap.xml Sitemap: https://trymorse.ai/blog/sitemap.xml