# Robots are very welcome to index our site, # # there are some bits we wish not indexed User-agent: Slurp Crawl-delay: 10 Disallow: /default_html Disallow: /admin User-agent: * Disallow: /default_html Disallow: /admin