User-Agent: Yandex Disallow: /search/ Disallow: */private/ Disallow: */personal/ Disallow: /personal/ Disallow: */auth/ Disallow: *page_by= Disallow: *FAST= Disallow: *set_filter= Disallow: *sort_by= Disallow: *from= Disallow: *admitad_uid= Disallow: *geo_city= Disallow: *fast= Disallow: *frommarket= Disallow: *_openstat= Disallow: *bc_s_section= Disallow: */arkhiv/ Disallow: */test111/ Disallow: */*?* Allow: /css/ Allow: /js/ Allow: /upload/*.jpg Clean-param: q /catalog Sitemap: https://becompact.ru/sitemap/sitemap.xml Host: https://becompact.ru User-agent: Googlebot Disallow: /search/ Disallow: */search/ Disallow: */private/ Disallow: /personal/ Disallow: */personal/ Disallow: */auth/ Disallow: /*page_by= Disallow: /*FAST= Disallow: *set_filter= Disallow: *sort_by= Disallow: *from= Disallow: *geo_city= Disallow: *fast= Disallow: *frommarket= Disallow: *admitad_uid= Disallow: *_openstat= Disallow: *bc_s_section= Disallow: */arkhiv/ Disallow: */test111/ Disallow: */*?* Allow: /css/ Allow: /js/ Allow: /upload/*.jpg Sitemap: https://becompact.ru/sitemap/sitemap.xml User-agent: AhrefsBot Disallow: / User-agent: - Disallow: / User-agent: BSP Spider (contact: markizko@gmail.com), Googlebot compatible Disallow: / User-agent: Riddler (http://riddler.io/about) Disallow: / User-agent: Go-http-client/1.1 Disallow: / User-agent: DataparkSearch/4.54-2016-10-26 (+http://dataparksearch.org/bot) Disallow: / User-agent: wsdl2objc Disallow: / User-agent: Python-urllib/2.6 Disallow: / User-agent: python-requests/2.10.0 Disallow: /