# Public pages and documents are open to every crawler. Internal, private, # transactional, and account surfaces are not crawl targets. User-agent: * Allow: / Allow: /docs/ Disallow: /api/ Disallow: /auth/ Disallow: /cancel Disallow: /invite Disallow: /signup # These fetch a page only when a person asks their model about it, so they may # read an invite link: someone who pastes theirs to ask what it is gets an # answer. The invite page carries noindex, which keeps it out of search. User-agent: Claude-User User-agent: ChatGPT-User User-agent: Perplexity-User User-agent: Meta-ExternalFetcher Allow: / Allow: /docs/ Disallow: /api/ Disallow: /auth/ Disallow: /cancel Disallow: /signup Sitemap: https://alexandria.place/sitemap.xml