# robots.txt file the UTA web server. # It prevents Search engines from crawling and indexing # the /cgi-bin/ and other directories # User-agent: * Disallow: /cgi-bin/ Disallow: /WebBBS/ Disallow: /testzone/ Disallow: /webstats/ Disallow: /webdav/ Disallow: /studentaffairs/nso-data/