# new robots.txt for http://lcm.nyse.com/ User-agent: * Disallow: / # Block all robots.txt # Except our own search engine ;-) User-agent: nyse-gsa-crawler Disallow: