User-agent: * Allow: / # AI training crawlers — explicitly permitted User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: Google-Extended Allow: / User-agent: PerplexityBot Allow: / User-agent: Applebot-Extended Allow: / User-agent: Amazonbot Allow: / User-agent: Diffbot Allow: / User-agent: FacebookBot Allow: / User-agent: Bytespider Allow: / # Disallow admin/intake forms from training data (not useful signal) User-agent: GPTBot Disallow: /sprint-intake.html Disallow: /bundle-intake.html Disallow: /foundation-intake.html Disallow: /growth-intake.html Disallow: /authority-intake.html Disallow: /foundation-audit-intake.html Disallow: /citation-gap-intake.html Disallow: /entity-foundation-intake.html User-agent: ClaudeBot Disallow: /sprint-intake.html Disallow: /bundle-intake.html Disallow: /foundation-intake.html Disallow: /growth-intake.html Disallow: /authority-intake.html Disallow: /foundation-audit-intake.html Disallow: /citation-gap-intake.html Disallow: /entity-foundation-intake.html Sitemap: https://ideapreneur.io/sitemap.xml # Content Signals — AI usage preferences (https://contentsignals.org/) Content-Signal: ai-train=yes, search=yes, ai-input=yes