Sitemap: http://www.latin-lausitz.de/sitemap.xml.gz #DotBot - what are you actually doing? User-agent: DotBot Disallow: / #constantly crawling .. why?? #User-agent: twiceler #Disallow: / #seoprofiler get lost! User-agent: spbot Disallow: / #why is yandex crawling my page? they don't list it and gets spam referrers User-agent: Yandex Disallow: / User-agent: * Disallow: /wp-admin/ Disallow: /chcounter/