# FasciaElettrica - robots.txt # Allow all crawlers including AI bots for GEO optimization # LLM-specific documentation # See /llms.txt for concise AI instructions # See /llms-full.txt for comprehensive context # AI Crawlers - Explicitly allowed for GEO optimization # (Listed first so they match before general wildcard) User-agent: GPTBot User-agent: Claude-Web User-agent: PerplexityBot User-agent: Anthropic-AI User-agent: Google-Extended User-agent: CCBot User-agent: ChatGPT-User User-agent: Bytespider User-agent: cohere-ai Allow: / # All other crawlers (single block with all rules) User-agent: * Allow: / Disallow: /_astro/ Disallow: /api/internal/ # Sitemaps Sitemap: https://fasciaelettrica.it/sitemap-index.xml Sitemap: https://fasciaelettrica.it/sitemap # HTML Sitemap (human-readable) # https://fasciaelettrica.it/sitemap