User-agent: Googlebot Disallow: /amabook/ore3/ Disallow: /amabook/ore4/ Disallow: /amabook/ore5/ # Below CommonPart Disallow: /aff/ Disallow: /amazon/ Disallow: /amabook/amacom/ Disallow: /amabook/amapub/ Disallow: /amabook/amalib/ Disallow: /anlog*/ Disallow: /bbs/bbs2/etc/ Disallow: /bbs/bbs2/politic/joren/ Disallow: /bbs/bbs2/politic/renraku/ Disallow: /bbs/bbs2/politic/woman/ Disallow: /cgi-bin/ Disallow: /etclink/ Disallow: /lib/ Disallow: /libpub/ Disallow: /org/ Disallow: *.js Disallow: */admin.cgi Disallow: */printenv.cgi Disallow: */rank.cgi Disallow: */regist_ys.cgi User-agent: Slurp # Below CommonPart Disallow: /aff/ Disallow: /amazon/ Disallow: /amabook/amacom/ Disallow: /amabook/amapub/ Disallow: /amabook/amalib/ Disallow: /anlog*/ Disallow: /bbs/bbs2/etc/ Disallow: /bbs/bbs2/politic/joren/ Disallow: /bbs/bbs2/politic/renraku/ Disallow: /bbs/bbs2/politic/woman/ Disallow: /cgi-bin/ Disallow: /etclink/ Disallow: /lib/ Disallow: /libpub/ Disallow: /org/ Disallow: *.js Disallow: */admin.cgi Disallow: */printenv.cgi Disallow: */rank.cgi Disallow: */regist_ys.cgi User-agent: Baiduspider crawl-delay:60 Disallow: /bbs/ Disallow: /cgi-bin/ # Below CommonPart Disallow: /aff/ Disallow: /amazon/ Disallow: /amabook/amacom/ Disallow: /amabook/amapub/ Disallow: /amabook/amalib/ Disallow: /anlog/ Disallow: /anlog2/ Disallow: /anlog3/ Disallow: /anlog4/ Disallow: /etclink/ Disallow: /lib/ Disallow: /libpub/ Disallow: /org/ User-agent: Yeti crawl-delay:60 Disallow: /bbs/ Disallow: /cgi-bin/ # Below CommonPart Disallow: /aff/ Disallow: /amazon/ Disallow: /amabook/amacom/ Disallow: /amabook/amapub/ Disallow: /amabook/amalib/ Disallow: /anlog/ Disallow: /anlog2/ Disallow: /anlog3/ Disallow: /anlog4/ Disallow: /etclink/ Disallow: /lib/ Disallow: /libpub/ Disallow: /org/ User-agent: * # Below CommonPart Crawl-delay: 60 Disallow: /aff/ Disallow: /amazon/ Disallow: /amabook/amacom/ Disallow: /amabook/amapub/ Disallow: /amabook/amalib/ Disallow: /anlog*/ Disallow: /bbs/ Disallow: /cgi-bin/ Disallow: /etclink/ Disallow: /lib/ Disallow: /libpub/ Disallow: /org/ Disallow: *.js Disallow: */admin.cgi Disallow: */printenv.cgi Disallow: */rank.cgi Disallow: */regist_ys.cgi