# Everframe — https://everframe.dev
#
# Everything is crawlable. The per-agent blocks below are explicit rather than
# relying on the wildcard, so the intent is on the record for the crawlers that
# actually serve citations in AI search.
#
# NOT disallowed, deliberately: /admin/ and /r/. Those are app shells with no
# content, and they are heavily linked from this site (every "Get started" CTA
# points at /admin/signup). A Disallow would leave them indexed-but-blocked —
# listed in results with no snippet — instead of removed. They carry
# <meta name="robots" content="noindex, follow"> instead, which requires them
# to stay crawlable to work. See apps/admin/index.html.
#
# Training-only crawlers (CCBot, anthropic-ai, cohere-ai) are currently allowed
# by the wildcard. Blocking them would cost no AI-search visibility, since they
# are not the agents that fetch pages to cite — but it is a business call, not
# an SEO one, and it has not been made. Left open on purpose.

User-agent: GPTBot
Allow: /

User-agent: OAI-SearchBot
Allow: /

User-agent: ClaudeBot
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: Googlebot
Allow: /

User-agent: *
Allow: /

# NOTE: sitemap-index.xml, NOT sitemap.xml — /sitemap.xml 404s on this site.
# @astrojs/sitemap emits the index plus sitemap-0.xml.
Sitemap: https://everframe.dev/sitemap-index.xml