# Robots.txt for zscole.github.io # AI/LLM Crawlers Welcome! # Allow all AI assistants to index this site User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: CCBot Allow: / User-agent: anthropic-ai Allow: / User-agent: Claude-Web Allow: / User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: Perplexitybot Allow: / # General crawlers User-agent: * Allow: / # AI-Specific Information # See: /llm.txt for structured AI-readable summary # See: /.well-known/ai-plugin.json for AI plugin specification # Contact: zak@ethcf.org Sitemap: https://zscole.github.io/sitemap.xml