# robots.txt for http://www.gain.net/ #User-agent: * #Disallow: /eweb/docs/ # excluding the docs folder # go away User-agent: * Disallow: / # allow Googlebot #User-agent: googlebot #Disallow: