User-agent: * 
Disallow: /css/
Disallow: /images/
Disallow: /lib/
Disallow: /html/
Disallow: /data/