# robots.txt for portal 'Apotheken Umschau' User-Agent: * Disallow: /uploads/ Disallow: /ajax/ Disallow: /services/ Disallow: /external/polls/ Disallow: /vendor/ User-Agent: LinkChecker Disallow: /uploads/ Disallow: /ajax/ Disallow: /services/ Disallow: /external/polls/ Disallow: /vendor/ User-Agent: sitebot Disallow: / User-Agent: Linguee Disallow: / # Yahoo Slurp crawler User-Agent: Slurp Disallow: /uploads/ Disallow: /ajax/ Disallow: /services/ Disallow: /external/polls/ Disallow: /vendor/ User-Agent: ChatGPT-User Disallow: / User-Agent: GPTBot Disallow: / User-Agent: Google-Extended Disallow: / #User-Agent: Screaming Frog SEO Spider #Disallow: / Sitemap: https://www.apotheken-umschau.de/sitemap_news/ Sitemap: https://www.apotheken-umschau.de/sitemap/sitemap_articles/ Sitemap: https://www.apotheken-umschau.de/sitemap_video/ Sitemap: https://www.apotheken-umschau.de/sitemap_index