Google last night announced they have completed their migration to their new web indexing system known as ‘Caffeine’.
This new system basically allows them to push anything Googlebot finds into the main index in seconds rather than weeks.
Previously Googlebot would crawl the web, find a site, then submit its content to another system for processing. This other system would then sort and process the content and work out what its all about. It would then pass it to another system for inclusion in the index. This was a time consuming process and was also done in batches, which means your site would have to wait for all the other sites in the same batch to be processed before being submitted to the index.
The new system is different, rather than doing things in large batches, it will work on smaller portions, more portions at the same time and submit them all to the index straight away, allowing users of the search engine to see information much much quicker, and this is just the start!
There are several rumours floating around about what lies in store next for Google users and their shot of caffeine. But for now we will have to wait and just enjoy our new “real-time” search results.
You can real the full article on the Google Webmaster Blog