This document specifies which parts of this website are not accessible to web crawlers or robots.
User-agent: *
Disallow: /admin/
Disallow: /private/
Disallow: /temp/
Disallow: /search?q=*
Disallow: /cgi-bin/
Disallow: /api/v1/debug/
Allow: /assets/
Sitemap: https://yourdomain.com/sitemap.xml
For more information about the robots.txt standard, please refer to the official documentation.