# Exclude crawlers from our demos since there is no reason for crawlers to index those pages. # What motivated the creation of this file (its a good idea anyway): # WLP 9.2 had a bug in that jsessionid parameter name was overridden as PORTAL_TAU # The Microsoft crawler was programmed to ignore jsessionid as a significant parameter. # It did not recognize PORTAL_TAU as a ignorable parameter, so each time it visited and got a new session id # it thought it was getting entirely new pages. # This caused it to over time hammer the demo site, each time increasing the set of identical pages to request # with each request having a different session id. User-agent: * Disallow: /wlpBEAWeb Disallow: /beijing Disallow: /pcc Disallow: /wlp10 Disallow: /bighorn Disallow: /alcsStore