User-agent: Googlebot-Image Disallow:/ User-agent: yahoo-mmcrawler Disallow:/ User-agent: psbot Disallow:/ User-agent: yahoo-blogs/v3.9 Disallow:/ User-agent: archive.org_bot Disallow:/ # Begin Exclusion From Directories from robots.txt Disallow: /cgi-bin/ Disallow: /shop/pc/catalog/ Disallow: /CustviewPast.asp Disallow: /customer_showorder.asp Disallow: /Checkout.asp Disallow: /CustviewPast.asp Disallow: /shop/pcadmin Disallow: /shop/pccatalog Disallow: /viewcart.asp