# ============================================================ # systemsninjas.com ยท robots policy # Reviewed 2026-09-01. Source of record for this file lives in # the vault; it is pushed to the GHL domain record by # push_robots_llms.py, never hand-edited in the GHL UI. # # We build AI systems for other people, so our position on AI # crawlers is a decision rather than a silence. The decision is: # read us. We would rather be the source an answer is built from # than be invisible to the tools our own customers search with. # # A named user-agent group REPLACES the wildcard group for that # crawler rather than adding to it, so every group below repeats # the same rules in full. That is deliberate, not duplication. # ============================================================ User-agent: * Allow: / Disallow: /checkout Disallow: /thank-you # ---- AI answer engines, assistants and training crawlers ---- # All welcome. Nothing here is private, and being quotable is the # point. Reviewed whenever this file is touched. User-agent: GPTBot Allow: / Disallow: /checkout Disallow: /thank-you User-agent: OAI-SearchBot Allow: / Disallow: /checkout Disallow: /thank-you User-agent: ChatGPT-User Allow: / Disallow: /checkout Disallow: /thank-you User-agent: ClaudeBot Allow: / Disallow: /checkout Disallow: /thank-you User-agent: Claude-User Allow: / Disallow: /checkout Disallow: /thank-you User-agent: Claude-SearchBot Allow: / Disallow: /checkout Disallow: /thank-you User-agent: PerplexityBot Allow: / Disallow: /checkout Disallow: /thank-you User-agent: Perplexity-User Allow: / Disallow: /checkout Disallow: /thank-you User-agent: Google-Extended Allow: / Disallow: /checkout Disallow: /thank-you User-agent: Applebot-Extended Allow: / Disallow: /checkout Disallow: /thank-you User-agent: meta-externalagent Allow: / Disallow: /checkout Disallow: /thank-you User-agent: Amazonbot Allow: / Disallow: /checkout Disallow: /thank-you User-agent: DuckAssistBot Allow: / Disallow: /checkout Disallow: /thank-you User-agent: MistralAI-User Allow: / Disallow: /checkout Disallow: /thank-you User-agent: cohere-ai Allow: / Disallow: /checkout Disallow: /thank-you User-agent: CCBot Allow: / Disallow: /checkout Disallow: /thank-you User-agent: Bytespider Allow: / Disallow: /checkout Disallow: /thank-you Sitemap: https://systemsninjas.com/sitemap.xml