# https://www.robotstxt.org/robotstxt.html User-agent: * Disallow: /category/ Disallow: /sections/ Disallow: /tags/ Disallow: /history/ Sitemap: https://kurer-sreda.ru/feeds/sitemap