# File to tell which (or all) scanning robots can access what # # User-agent: can also specify by name; "*" is for everyone # Disallow: disallow if this matches first part of requested path # # This can be modified for individual robots if required but User-agent must be known. # User-agent: * Disallow: /cgi-bin/ Disallow: /App_Data/ Disallow: /Bin/ Disallow: /css/ Disallow: /shopAdmin/ Disallow: /admin/ Disallow: /images/ Disallow: /sec/ Disallow: /control/ Disallow: /ctrl/ Disallow: /glasses/ Disallow: /customer-account/ Disallow: basket.aspx Disallow: pageRedirect.aspx Disallow: redirector.aspx