# General rules for all crawlers User-agent: * # 1. Block country-specific subfolders Disallow: /us Disallow: /us/ Disallow: /us/* Disallow: /fr Disallow: /fr/ Disallow: /fr/* Disallow: /br Disallow: /br/ Disallow: /br/* # 3. Block everything under /account Disallow: /account/ Disallow: /account/* # 4. Block monitoring Disallow: /monitoring Disallow: /monitoring/ Disallow: /monitoring/* # 5. Block specific non-SEO/sensitive pages Disallow: /pages/login_submit Disallow: /pages/checkout Disallow: /pages/googleAuth Disallow: /pages/ Disallow: /pages/* # 5. Sitemap declaration(s) Sitemap: https://simplestudy.com/sitemap.xml