# Rate Limit Crawl-delay: 5 # Used for AI Training User-agent: CCBot Disallow: / # ChatGPT User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / # Google Bard and Vertex AI User-agent: Google-Extended Disallow: / # Facebook User-agent: FacebookBot Disallow: / # Multipurpose and LLM User-agent: Omgilibot Disallow: /