User-agent: * Disallow: 403.htm Disallow: 404.htm Disallow: 500.htm Disallow: textform.txt DIsallow: usc.html Disallow: /cgi-bin/ Disallow: /pages/