## This file controls which webcrawlers/spiders see which files ## For more info -> http://info.webcrawler.com/mak/projects/robots/robots.html ## ## Default access rule ## block all spiders #User-agent: * #Disallow: / User-agent: * Disallow: /ProbSets