User-agent: ia_archiver Disallow: / User-agent: * Disallow: /api Disallow: /user Disallow: */orders Disallow: */enroll Disallow: /goon/ Allow: /user/*/profile sitemap: https://www.bitdegree.org/sitemap-en.xml Sitemap: https://www.bitdegree.org/online-learning-platforms/sitemap.xml Sitemap: https://www.bitdegree.org/crypto/sitemap.xml