User-agent: * # folders & pages not to be entered Disallow: /cgi-bin/ Disallow: /owners/ Disallow: /images/ Disallow: /pdf/ Disallow: /Library/