# Robots policy for cancion-regalo.es # Auto-generated by server/seo/discovery.ts at build time. # AI bots are explicitly welcomed — see notes in source. User-agent: GPTBot Allow: / Disallow: /api/ Disallow: /dashboard Disallow: /pedido/ Disallow: /crear/ Disallow: /regalo/ User-agent: ChatGPT-User Allow: / Disallow: /api/ Disallow: /dashboard Disallow: /pedido/ Disallow: /crear/ Disallow: /regalo/ User-agent: OAI-SearchBot Allow: / Disallow: /api/ Disallow: /dashboard Disallow: /pedido/ Disallow: /crear/ Disallow: /regalo/ User-agent: ClaudeBot Allow: / Disallow: /api/ Disallow: /dashboard Disallow: /pedido/ Disallow: /crear/ Disallow: /regalo/ User-agent: anthropic-ai Allow: / Disallow: /api/ Disallow: /dashboard Disallow: /pedido/ Disallow: /crear/ Disallow: /regalo/ User-agent: Claude-Web Allow: / Disallow: /api/ Disallow: /dashboard Disallow: /pedido/ Disallow: /crear/ Disallow: /regalo/ User-agent: Claude-SearchBot Allow: / Disallow: /api/ Disallow: /dashboard Disallow: /pedido/ Disallow: /crear/ Disallow: /regalo/ User-agent: CCBot Allow: / Disallow: /api/ Disallow: /dashboard Disallow: /pedido/ Disallow: /crear/ Disallow: /regalo/ User-agent: PerplexityBot Allow: / Disallow: /api/ Disallow: /dashboard Disallow: /pedido/ Disallow: /crear/ Disallow: /regalo/ User-agent: Perplexity-User Allow: / Disallow: /api/ Disallow: /dashboard Disallow: /pedido/ Disallow: /crear/ Disallow: /regalo/ User-agent: Google-Extended Allow: / Disallow: /api/ Disallow: /dashboard Disallow: /pedido/ Disallow: /crear/ Disallow: /regalo/ User-agent: Bytespider Allow: / Disallow: /api/ Disallow: /dashboard Disallow: /pedido/ Disallow: /crear/ Disallow: /regalo/ User-agent: Applebot-Extended Allow: / Disallow: /api/ Disallow: /dashboard Disallow: /pedido/ Disallow: /crear/ Disallow: /regalo/ User-agent: Meta-ExternalAgent Allow: / Disallow: /api/ Disallow: /dashboard Disallow: /pedido/ Disallow: /crear/ Disallow: /regalo/ User-agent: DuckAssistBot Allow: / Disallow: /api/ Disallow: /dashboard Disallow: /pedido/ Disallow: /crear/ Disallow: /regalo/ # Google Ads landing-page crawlers. AdsBot IGNORES the User-agent: * block, # so without naming it here none of the rules below apply to the very # crawler that decides whether an ad destination is policy-compliant. User-agent: AdsBot-Google Allow: / Disallow: /api/ Disallow: /dashboard Disallow: /order/ Disallow: /cadou/ User-agent: AdsBot-Google-Mobile Allow: / Disallow: /api/ Disallow: /dashboard Disallow: /order/ Disallow: /cadou/ # Default catch-all for traditional search crawlers + everything else. User-agent: * Allow: / # Advertised landing pages. These carry no personal data. The # Disallow: /crear/ below still blocks /crear///, # which is a real customer checkout URL — longest match wins. Allow: /crear/gen Allow: /crear/artist Allow: /crear/demo Disallow: /api/ Disallow: /dashboard Disallow: /pedido/ Disallow: /crear/ Disallow: /regalo/ Sitemap: https://cancion-regalo.es/sitemap.xml Sitemap: https://cancion-regalo.es/sitemap-songs.xml