Wordpress Duplicate Content Prevention with robots.txt
To prevent the Wordpress Duplicate Content in Google that may arise when you use any versions of Wordpress, here is the typical content of the robots.txt file:
User-agent: *
Disallow: /comments/feed/
Disallow: /feed/
Disallow: /feed/atom/
Disallow: /feed/rss/
Disallow: /rss/
Disallow: /trackback/
Disallow: /wp/
Disallow: /*/comments/feed/$
Disallow: /*/feed/$
Disallow: /*/feed/atom/$
Disallow: /*/feed/rss/$
Disallow: /*/rss/$
Disallow: /*/trackback/$
The above code is based on the following assumptions:
The WordPress address (URL) is in the […]
Read the full article...
