Webmasters in online forums reported an unusual Google behavior. New web pages of some sites are indexed with a longer delay. Is it a new Google penalty? Or is it just a bug that affects only certain websites?

What is the exact problem?

The websites that reported the problem were used to immediate inclusion of their pages in Google’s search results.

If your website has a certain number of inbound links and if it has been indexed by Google, Google usually indexes new pages very quickly. That does not mean that the new pages get high rankings for any keyword but that the new pages can be found in Google’s results if you search for the exact web page title or other unique elements that appear on the new web page.

These websites that were used to immediate inclusion now observed a 7 day delay for new website content:

"My blog has been afloat for almost 1.5 years, was always indexed by Google fast and smooth, and was ranked pretty high by main keywords in its niche. However, it’s been several weeks that Google seems to have stopped indexing my new posts. [...]

It seems as if [Google is] applying an algorithm like ‘posting day + 7 days’ or something when indexing my new posts."

Is this really a new Google penalty? What can you do against it?

Many of the web pages that have the 7 day indexing problem are WordPress blogs. There are several theories why these blogs aren’t indexed as quickly as before:

1. The affected websites all seem to use the same SEO plugin for WordPress that screws up the code and prevents Google from indexing the website pages correctly.
   If you use an SEO plugin, consider if you really need it. These plugins don’t do real SEO. They hide certain pages on your website from search engine spiders and they allow you to edit the header information of your web pages. This can also be done through the regular WordPress interface.
2. Although the new blog post wasn’t listed for 7 days on Google, the index page of the blog was listed in Google’s search results.
   As the index page of a blog often shows the latest blog posts, it is likely that Google uses the 7 day delay for the blog page because the post can only be found on the blog index page during that time.
3. Some of the affected blogs publish press releases on their websites. As the same press release can also be found on many other websites, Google might return the first publisher of the press release in the search results and discard all other pages with the same content.
4. Other affected websites seem to be AdSense scraper websites. These websites have very little unique content and they have been built to attract visitors that then click on the AdSense ads on the website.
5. Some of the affected websites installed user agent sniffers on their server. These programs return different pages to different user agents (human web surfers, Googlebot and other bots).
   Using such a script on your server can easily prevent Google’s indexing robot from indexing your website and it can be misinterpreted as a spamming (cloaking) attempt. This is very similar to the SEO plugin problem above.

It looks as if the 7 day delay might be related to two different website types: websites that use server scripts that return different pages to different user agents and websites that contain little or no unique content.

The 7 day delay for blogs that display the content both on the blog index page and the blog posting page is not a penalty but a Google feature that prevents duplicate results.

If your website is a Made-For-AdSense scraper website then it’s probably time to think about a new business model. Google might give these websites lower rankings in the future.

If you use bot blocking scripts or other server scripts that change the content that is delivered to visitors of your website then you should make sure that you’re not accidentally blocking Google. It’s better not to use these scripts at all.

Source: Axandra.com

Related posts:

1. How to outrank your competitors on Google To get high rankings on Google, it is not necessary to have everything that Google expects from a great website. You just have to be...
2. The effect of your URL structure on your Google rankings Does Google care about the position of a web page on your server? Does it make a difference if a web page is in the...
3. Google’s human reviewers: real people judge about your Google rankings Most people think that Google purely ranks websites by using mathematical formulas. Google even has an official statement about the way that search results are...
4. How the bounce rate of your website can affect your Google rankings Bounce rate is the percentage of single-page visits (i.e. visits in which the person left your site from the entrance page). Bounce rate is a...
5. How to get listed in Google’s search results for many keywords Source: Axandra.com Targeting several keywords on your website is crucial if you want to get high rankings on Google. The more keywords that are related...
6. Google’s Search Engine Optimization guide for webmasters If you avoid the following things, it will be easier for Google to index your web pages: Things that you should not do in your...
7. How to get indented listings for your website on Google Wouldn’t it be great if your website was listed twice in Google’s top 10 results for your most important keywords? Although Google usually shows only...
8. How Google analyzes the top keywords on your website Source : Axandra.com Google recently filed a patent application that deals with the keywords that Google finds on your web pages. Google’s new patent filing...