User-agent: * Disallow: # Added 2026-06-24 (hosting): throttle aggressive AI crawlers to cut ModSecurity rate-limit hits User-agent: ClaudeBot Crawl-delay: 30 User-agent: Meta-ExternalAgent Crawl-delay: 30 User-agent: meta-externalagent Crawl-delay: 30