# robots.txt file for preventing indexing by search engine spiders # all landing pages (or any other files not to be indexed) must be in the 'norobots' folder User-Agent: * Disallow: /norobots/