# * User-agent: * Allow: / # AI-training crawlers. Blocked because they generate the vast majority of # bot traffic (ClaudeBot alone was 99% of all requests in a 2026-05 audit) # without driving any user-facing search referrals, and their volume was # pushing Edge Middleware + ISR Writes past the Vercel free-tier limits. # Search-index crawlers (Googlebot, Bingbot, Applebot, etc.) are unaffected. User-agent: ClaudeBot Disallow: / User-agent: GPTBot Disallow: / User-agent: meta-externalagent Disallow: / # Sitemaps Sitemap: https://islamicprayerstimes.com/sitemap-index.xml