Google not caching all pages




We currently run a number of sites on EpiServer 4.6. Recently, the number of pages that Google cache's has dropped dramatically.  We believe this may be related to URL re-writing, has anyone experienced similar issues?

We have not yet tested the problem on EpiServer 5 sites, but can do.

Any help would be great,





#24158 Sep 25, 2008 16:33
  • Nicklas Israelsson
    Member since: 2007


    It might be related to this issue perhaps?


    Here are some more information about that issue:

    #24187 Edited, Sep 26, 2008 11:58



    I have checked the sites as per the instructions in the blog, but all seems to be fine.

    We have looked through the server logs and there is nothing abnormal there.


    Any other ideas?




    #24205 Sep 26, 2008 17:50
  • Peter Sunna
    Member since: 2002
    Have you created an xml sitemap and submitted it to google via webmaster tools? If so, check the statuses of the links in the webmaster central. They should however be the same as the statuses you got from fiddler when identifying yourself with googlebot's user agent string.
    #24244 Sep 29, 2008 10:15
  • Jacob Khan
    Member since: 2008

    As Peter said there is a module which generates a sitemap for google bot. We have one for 4.6 and one for a later version Hopefully this will help you


    #24250 Sep 29, 2008 13:54

    We have created and submitted a sitemap to Google but are getting some unusual results.


    Total URLs in sitemap: 121

    Indexed URLs in sitemap: 11


    I can't understand why there is such a differnce?


    Thanks for your help, Tom



    #24724 Oct 06, 2008 13:27
  • Jacob Khan
    Member since: 2008

    Hi Again Tom
    I was wondering if the url's in the sitemap are friendly or not. Is there a correlation between friendly and not. Also, do you use a lot of redirects or in EPiServer Shortcut to another page in EPiServer. Also state the sitemap in the robots.txt file

    #24732 Oct 06, 2008 16:40
  • Johan Kronberg
    Member since: 2005

    I had a similiar problem on an old 4.6 site... Dotnet-error was: Cannot use a leading .. to exit above the top directory.

    Solved it by adding a browser file from post #:3504161. I would like to know if it's possible to add a Browser-file that shuts all variations off and always serve the same way?

    <browser refID="Mozilla">
    <capability name="cookies" value="true" />

    #27305 Edited, Jan 26, 2009 10:08