# 98-05-24 webmaster@ite.gmu.edu # http://www.kollar.com/robots.html # http://www.robotstxt.org/wc/robots.html # valid for all robots and individuals User-agent: * # mostly mirrored or copied Disallow: /icons # too many for robot searching Disallow: /idx-icons Disallow: /images Disallow: /manual Disallow: /photos # changing information Disallow: /cgi-bin # only indirect access welcome Disallow: /server-errors Disallow: /server-info Disallow: /server-status Disallow: /new # IT&E internal Disallow: /DE Disallow: /labs/sun/ Disallow: /labs/nt/ Disallow: /backup/ Disallow: /flash/ Disallow: /forms/ Disallow: /admin/ Disallow: /uploads/ Disallow: /editor/ Disallow: /volgenau/ Disallow: /admincouncil/ Disallow: /bsit-old/ Disallow: /bsit.old/ Disallow: /bsit-disabled/ Disallow: /debbieparty/ Disallow: /palmer/ Disallow: /DetectionandEstimationTheory/ Disallow: /degree/ Disallow: /undergraduate/ # and now these spammers User-agent: CherryPickerSE CherryPickerElite EmailCollector EmailWolf Crescent Disallow: /