User-agent: * Allow: / Disallow: /api/ Disallow: /dashboard Disallow: /payment/ Disallow: /admin/ # AI crawlers: same private paths as all other crawlers User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: PerplexityBot User-agent: CCBot Allow: / Disallow: /api/ Disallow: /dashboard Disallow: /payment/ Disallow: /admin/ Sitemap: https://aiaigenerator.ai/sitemap.xml