## robots.txt User-agent: * Disallow: /cgi-bin/ # various scripts that should not be indexed Disallow: /perl/ Disallow: /statistic/ Disallow: /kunden/ Disallow: /login