# robots.txt for podform3d.com # # IMPORTANT, read before editing: a crawler obeys ONLY the most specific # user-agent group that matches it. It does NOT inherit rules from the # "User-agent: *" group. So every Disallow below has to be repeated inside # every named group, or that crawler is exempt from all of them. # # This bit us once: the AI groups used to contain nothing but "Allow: /", # which left GPTBot and friends free to crawl the thank-you URLs and /api/. # If you add a Disallow, add it to EVERY group in this file. # # /plans is deliberately NOT disallowed. Since 2026-10-07 it is the plan # comparison (it was /pricing), which is noindex: Google has to be able to # crawl it to see that noindex. The old /plans prototype it replaced is gone. User-agent: * Allow: / Disallow: /password Disallow: /*.backup$ Disallow: /*.bundle$ Disallow: /api/ Disallow: /free-trial/thank-you/ Disallow: /free-trial/activate Disallow: /savings/thank-you/ Disallow: /pricing/thank-you/ Disallow: /*?route= Disallow: /*?li_fat_id= # Legacy Shopify paths that no longer exist on this site are intentionally # NOT disallowed. They return a hard 404 (see 404.html) so Google can crawl # them, see the 404, and drop them from the index. Adding Disallow directives # would leave them stuck as "indexed, though blocked by robots.txt" forever. # ───────────────────────────────────────────────────────────────────────── # AI crawlers and answer engines are WELCOME, subject to the same rules. # Being cited by ChatGPT, Claude, Perplexity and Gemini is a goal here, so # these are Allow, not Disallow. Each group repeats the Disallow block above # because of the no-inheritance rule explained at the top of this file. # ───────────────────────────────────────────────────────────────────────── # OpenAI User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User Allow: / Disallow: /password Disallow: /*.backup$ Disallow: /*.bundle$ Disallow: /api/ Disallow: /free-trial/thank-you/ Disallow: /free-trial/activate Disallow: /savings/thank-you/ Disallow: /pricing/thank-you/ Disallow: /*?route= Disallow: /*?li_fat_id= # Anthropic User-agent: ClaudeBot User-agent: Claude-Web User-agent: Claude-SearchBot User-agent: anthropic-ai Allow: / Disallow: /password Disallow: /*.backup$ Disallow: /*.bundle$ Disallow: /api/ Disallow: /free-trial/thank-you/ Disallow: /free-trial/activate Disallow: /savings/thank-you/ Disallow: /pricing/thank-you/ Disallow: /*?route= Disallow: /*?li_fat_id= # Perplexity User-agent: PerplexityBot User-agent: Perplexity-User Allow: / Disallow: /password Disallow: /*.backup$ Disallow: /*.bundle$ Disallow: /api/ Disallow: /free-trial/thank-you/ Disallow: /free-trial/activate Disallow: /savings/thank-you/ Disallow: /pricing/thank-you/ Disallow: /*?route= Disallow: /*?li_fat_id= # Google AI (separate from Googlebot, which is covered by * above) User-agent: Google-Extended User-agent: Google-CloudVertexBot Allow: / Disallow: /password Disallow: /*.backup$ Disallow: /*.bundle$ Disallow: /api/ Disallow: /free-trial/thank-you/ Disallow: /free-trial/activate Disallow: /savings/thank-you/ Disallow: /pricing/thank-you/ Disallow: /*?route= Disallow: /*?li_fat_id= # Apple, Meta, Amazon User-agent: Applebot-Extended User-agent: Meta-ExternalAgent User-agent: Amazonbot Allow: / Disallow: /password Disallow: /*.backup$ Disallow: /*.bundle$ Disallow: /api/ Disallow: /free-trial/thank-you/ Disallow: /free-trial/activate Disallow: /savings/thank-you/ Disallow: /pricing/thank-you/ Disallow: /*?route= Disallow: /*?li_fat_id= # Common Crawl, which seeds many model corpora User-agent: CCBot Allow: / Disallow: /password Disallow: /*.backup$ Disallow: /*.bundle$ Disallow: /api/ Disallow: /free-trial/thank-you/ Disallow: /free-trial/activate Disallow: /savings/thank-you/ Disallow: /pricing/thank-you/ Disallow: /*?route= Disallow: /*?li_fat_id= # Other assistants User-agent: DuckAssistBot User-agent: MistralAI-User User-agent: cohere-ai User-agent: YouBot Allow: / Disallow: /password Disallow: /*.backup$ Disallow: /*.bundle$ Disallow: /api/ Disallow: /free-trial/thank-you/ Disallow: /free-trial/activate Disallow: /savings/thank-you/ Disallow: /pricing/thank-you/ Disallow: /*?route= Disallow: /*?li_fat_id= Sitemap: https://podform3d.com/sitemap.xml Sitemap: https://podform3d.com/help-center/sitemap.xml