# Robots.txt Structure Copyright 2009 file All rights reserved For domain: http://www.cleaning-agency.co.uk/ # All robots will spider the domain User-agent: * Allow: / Disallow: Disallow: Disallow: /sitemap-key/