# All robots will spider the domain

User-Agent: SimilarPages Nutch Crawler
Disallow: *

User-agent: *
Disallow: /webmail/