Category: Wordpress

Wordpress Duplicate Content Prevention with robots.txt

To prevent the Wordpress Duplicate Content in Google that may arise when you use any versions of Wordpress, here is the typical content of the robots.txt file:

User-agent: *
Disallow: /comments/feed/
Disallow: /feed/
Disallow: /feed/atom/
Disallow: /feed/rss/
Disallow: /rss/
Disallow: /trackback/
Disallow: /wp/
Disallow: /*/comments/feed/$
Disallow: /*/feed/$
Disallow: /*/feed/atom/$
Disallow: /*/feed/rss/$
Disallow: /*/rss/$
Disallow: /*/trackback/$

The above code is based on the following assumptions:

The WordPress address (URL) is in the […]

Read the full article...
Posted on Apr 2nd, 2007 by VK  6 comments