User-Agent: * Allow: / Allow: /llms.txt Allow: /agent.md Allow: /seo.txt Disallow: /api/ User-Agent: GPTBot User-Agent: ChatGPT-User User-Agent: OAI-SearchBot User-Agent: ClaudeBot User-Agent: Claude-User User-Agent: anthropic-ai User-Agent: PerplexityBot User-Agent: Google-Extended User-Agent: Applebot-Extended User-Agent: CCBot User-Agent: Bytespider User-Agent: Amazonbot User-Agent: meta-externalagent User-Agent: cohere-ai User-Agent: YouBot User-Agent: Diffbot Allow: / Allow: /llms.txt Allow: /agent.md Allow: /seo.txt Disallow: /api/ Host: https://www.subham12r.dev Sitemap: https://www.subham12r.dev/sitemap.xml