# robots.txt (deny) for all - except googlebot, yahoo-slurp, msnbot, fusionbot. # deny index and follow for all bots. Generate this syntax within the tags. User-agent: * Disallow: / User-agent: Googlebot Disallow: User-agent: yahoo-slurp Disallow: User-agent: msnbot Disallow: User-agent: baiduspider Disallow: User-agent: fusionbot Disallow: