# Mindcup Robots Configuration # https://mindcup.in User-agent: * Allow: / # Prevent search engines from crawling system static build folders & error pages Disallow: /_astro/ Disallow: /dist/ Disallow: /404/ Disallow: /404 # Link to the dynamic Astro sitemap index Sitemap: https://mindcup.in/sitemap-index.xml