# $Id$ # robots.txt RFC: http://www.robotstxt.org/wc/norobots-rfc.html # Validated by http://www.searchengineworld.com/cgi-bin/robotcheck.cgi # User-agent: Mediapartners-Google* User-agent: * Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /nuke* Disallow: /doc/ Disallow: /docs/ Disallow: /bbs_* Disallow: /auto/ Disallow: /uc/ Disallow: /zhidao/ Disallow: /nuke/language/ Disallow: /new/ Disallow: /news/ Disallow: /adm* Disallow: /cache/ Disallow: /help/ Disallow: /includes/ Disallow: /language/ Disallow: /media/ Disallow: /templates/ Disallow: /install* #yahoo User-agent: Slurp Crawl-delay:2000 #tencent User-agent: Sosospider Disallow: / #yodao User-agent: Mozilla/5.0+(compatible;YodaoBot-Image/1.0;http://www.yodao.com/help/webmaster/spider/;) Disallow: / #sina User-agent: Mozilla/5.0 (compatible; iaskspider/1.0; MSIE 6.0) Disallow: / # Sogou User-agent: Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07) Disallow: / User-agent: Sogou web spider Disallow: / User-agent: sogou spider Disallow: /