#robots.txt file http://richard.olivetree.net/sherman #all robots will spider the domain User-agent: * Disallow: #Disallow directory private User-agent: * Disallow: private