# Robots.txt - Exclude robots from crawling National Semiconductor's site User-agent: * Disallow: /cgi-bin Disallow: /ads-cgi Disallow: /search Disallow: /profile Disallow: /order Disallow: /wwwlib Disallow: /userprice Disallow: /an Disallow: /ds Disallow: /ds.cgi Disallow: /ftp Disallow: /notifications Disallow: /appinfo/webench/registration/signon.cgi Disallow: /appinfo/webench/scripts/ Disallow: /appinfo/webench/power/SS/ Disallow: /commerce/ShoppingBasket/index.html/ Disallow: /livewire/ Disallow: /webench/ Disallow: /fserver/ Disallow: /ss1/ Disallow: /ss2/