# Robots.txt for karanbansal.in # # One standard sitemap, no invented directives (no crawler reads those). # AI search and answer bots are explicitly allowed; blocking them removes # this site from AI answers. User-agent: * Allow: / # AI answer and search crawlers, explicitly welcome (they cite, they don't just train) User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Claude-User Allow: / User-agent: PerplexityBot Allow: / Sitemap: https://karanbansal.in/sitemap.xml