# Local Waifu — robots.txt # Everyone welcome, including AI answer engines. We WANT to be crawled, # indexed, and cited by generative search (AEO / GEO). User-agent: * Allow: / # --- AI answer engines & training crawlers: explicitly welcome --- # OpenAI / ChatGPT User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / # Anthropic / Claude User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: Claude-Web Allow: / # Perplexity User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / # Google AI (Gemini, AI Overviews) User-agent: Google-Extended Allow: / # Apple Intelligence User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / # Microsoft / Bing (also powers ChatGPT search) User-agent: Bingbot Allow: / # Common Crawl (feeds many open models) User-agent: CCBot Allow: / # Amazon, ByteDance User-agent: Amazonbot Allow: / User-agent: Bytespider Allow: / Sitemap: https://localwaifu.com/sitemap.xml