User-Agent: * Allow: / Disallow: /api/ Disallow: /admin/ Disallow: /search User-Agent: Google-Extended User-Agent: GPTBot User-Agent: PerplexityBot User-Agent: ClaudeBot User-Agent: Applebot User-Agent: Applebot-Extended Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /download-mandi-app Allow: /mandi-bhav-map Allow: /about-us Disallow: /api/ Disallow: /admin/ Disallow: /search Sitemap: https://manditoday.com/sitemap.xml