# a standard robots exclusion file that excludes all # but the most significant robots from visiting your site # the default Disallow rule permits all of your web to be # crawled by the allowed agents, you will want to change this # see http://info.webcrawler.com/mak/projects/robots/exclusion.html # for further details User-agent: * Disallow: /goodies/ Disallow: /wholesale/ Disallow: /cards/ Disallow: /webstat/ Disallow: /crystalsshop/ Disallow: results.html Disallow: search.html Disallow: /sneakpeek/ Disallow: /test/ Disallow: /private/ Disallow: /private1/ Disallow: /vip/ Disallow: /wprtest/ Disallow: /goodies/ Disallow: /Library/ Disallow: /Templates/ Disallow: /gc/ Disallow: /giftcertificates/ Disallow: /jewelry-supplies/old/ Disallow: /newsletterspecials/