User-agent: * Allow: / Disallow: /404.html Disallow: /blog-post.html Disallow: /posts/ User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / Sitemap: https://tegvo.com/sitemap.xml # AI / LLM crawlers # See https://tegvo.com/llms.txt