# ===== OPENAI GPTBot ===== User-Agent: GPTBot Allow: /contents/magazine/ Allow: /service/a0 Disallow: / # ===== GOOGLE EXTENDED (AI Overview) ===== User-Agent: Google-Extended Allow: /contents/magazine/ Allow: /service/a0 Disallow: / # ===== PERPLEXITY ===== User-Agent: PerplexityBot Allow: /contents/magazine/ Allow: /service/a0 Disallow: / # ===== ANTHROPIC CLAUDE (仮対応名) ===== User-Agent: anthropic-ai Allow: /contents/magazine/ Allow: /service/a0 Disallow: / # ===== COMMON CRAWL ===== User-Agent: CCBot Allow: /contents/magazine/ Allow: /service/a0 Disallow: / # ===== FACEBOOK/META ===== User-Agent: facebookexternalhit Allow: /contents/magazine/ Allow: /service/a0 Disallow: / # ===== AMAZON ===== User-Agent: Amazonbot Allow: /contents/magazine/ Allow: /service/a0 Disallow: / # ===== DUCKDUCKGO ===== User-Agent: DuckDuckBot Allow: /contents/magazine/ Allow: /service/a0 Disallow: / # ===== APPLE ===== User-Agent: Applebot Allow: /contents/magazine/ Allow: /service/a0 Disallow: / # ===== CATCH ALL FUTURE LLMS ===== User-Agent: * Allow: /contents/magazine/ Allow: /service/a0 Disallow: /