# Keep automated crawlers below 100 requests per minute. # Crawl-delay is honored by several major crawlers; normal browsers and API # clients are unaffected. User-agent: GPTBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: CCBot Disallow: / User-agent: Bytespider Disallow: / User-agent: Google-Extended Disallow: / User-agent: meta-externalagent Disallow: / User-agent: cohere-ai Disallow: / User-agent: * Crawl-delay: 2 Disallow: /webalizer/ Disallow: /cgi-bin/ Sitemap: https://www.telcodata.us/sitemap.xml