User-agent:*
Disallow:/cgi-bin
Disallow:/css
Disallow:/images
Disallow:/js
Disallow:/pdfs