# Robots.txt file from http://www.proworldinc.com # # All robots will spider the domain User-agent: * Disallow: User-agent: Slurp Disallow: /*?source=google User-agent: twiceler Disallow: /