Duplicate pages appearing in Googles search engine results.

Apr 15, 2009 at 8:49 PM
Edited Apr 15, 2009 at 8:51 PM

I created a new page by selecting pages and added a title and text. I made this the front page by selecting the tick box “Is front page” and not selecting “Show in list”.

 

When I do a search on google and my home page appears it will list other pages on my home page that contain the same search phrase.

 

This is great because it enables people to find other pages on my website containing the same key words.

 

However one of the pages it lists contains exactly the same title and content but is shown as a separate page.

 

So I have the same content on two different pages.

http://www.creativemindmapping.com/

 

http://www.creativemindmapping.com/page/Mind-mapping.aspx

 

Googles search engine results also show two separate pages with duplicate content in the search engine results

 

I’ve read from “SEO experts” that duplicate content on a website is not good because it dilutes the ranking power between two pages.

 

Do I need to add a nonfollow or noindex line in the robots.txt file or is there another way around this problem?

 

Thank you

Coordinator
Apr 16, 2009 at 10:03 PM
There's probably a few ways to handle this such as using robots.txt.  One programmatic solution is to do a 301 redirect to the homepage if someone tries accessing the page via the /page/Mind-mapping.aspx URL.  To do this, in the page.aspx.cs file in the root of your blog, there's a ServePage() method.  If you add the bolded code below, it will do the 301 redirect if the page (or any page marked as a Front Page) is being requested when going through the /page/pageName.aspx URL.

private void ServePage(Guid id)
{
    this.Page = BlogEngine.Core.Page.GetPage(id);

    if (this.Page == null || (!this.Page.IsVisible))
        Response.Redirect(Utils.RelativeWebRoot + "error404.aspx", true);

    if (this.Page.IsFrontPage &&
        Request.RawUrl.ToUpperInvariant().Contains(this.Page.RelativeLink.ToUpperInvariant()))
    {
        Response.Clear();
        Response.StatusCode = 301;
        Response.AppendHeader("location", Utils.RelativeWebRoot);
        Response.End();
    }


    .... remaining code ....
May 5, 2009 at 7:46 PM

I’ve noticed on my other site at http://www.cheapromancoins.com/ which is held on a different shared hosting account it redirects a user to http://www.cheapromancoins.com/default.aspx if they click on the “Home” button.

 

Is there any way of creating a 301 redirect so it redirects the user to the home page without the default.aspx extension as I have heard that search engines treat …../ and …../default.aspx as two separate pages. The ‘link juice’ is therefore split between two pages which is not good for SEO.

 

I tried creating a 301 redirect in the web.config page but was not successful

 

Thanks

May 5, 2009 at 8:42 PM
Edited May 5, 2009 at 8:43 PM
Its ok. I fixed the problem.

I simply altered the link for the home button on the master page of the MarketPlace1-0 theme from ~/default.aspx to ~/. I altered the wrong master page. Thats why it didn't work the first time.