User-agent: * Disallow: Disallow: /cgi-bin/ Disallow: /privacy/ Disallow: /spider/ Disallow: /site/article/ Disallow: /feed/ Disallow: /category/ Disallow: /article.php