Wednesday, August 12, 2009

Google Caffeine is Coming!

Have you Noticed this? Google is launching a new, upgraded version of its search engine soon. Google has annouced a new version of its core engine is now in testing. Code named Google Caffeine, the new engine in our tests has some dramatic changes both good and bad.

Google promises that the new search tool (codename “Caffeine”) will improve the speed, accuracy, size, and comprehensiveness of Google search.

Remember normally Google is about users not webmasters, but in this case, Google is opening their Sandbox to the public (and us). You can visit the web developer preview of Google’s new infrastructure at http://www2.sandbox.google.com/ and try searches there. While the developer version is a pre-beta release, it’s completely usable.

Comparison Of Old Google Results and New Google Results:

I here list comparison of Old Google Results and New Google Results from two websites namely mashable.com and mark8t.com

From mashable.com:

"While the developer version is a pre-beta release, it’s completely usable. Thus, we’ve decided to put the new Google search through the wringer. We took the developer version for a spin and compared it to not only the current version of Google Search, but to Bing as well.

The categories we tested the new search engine on are as follows: speed, accuracy, temporal relevancy, and index size. Here’s how we define those:

Speed: How fast can the new search engine load results?

Accuracy: Which set of results is more accurate to the search term?

Temporal Relevancy: Is one version of search better at capturing breaking news?

Index Size: Is it really more comprehensive than the last version of Google?

So without further ado, here’s the test:


1. Speed


The first category is incredibly important. How fast do these Google search results come at you anyway? Even a tenth of a second can mean millions for the search company as the longer it takes the load, the more likely someone will go look for results somewhere else.

So how fast is the new search? Lightning fast. As you probably know, Google tells you how long it takes to load results. We tried a few search terms, starting with “Dog.” Here’s the speed result:


Compare that to the original Google search:


0.12 vs. 0.25 seconds? They doubled the speed! That’s tremendous. We tried it with a variety of search terms (”The end of the universe is not here,” “There is no way that you cannot find ben parr. He is hiding back behind the tv,” “FriendFeed,” etc.), and in every instance, the new Google won.

The only potential weak spot was when we added search commands like quotes, subtraction signs, and more. In this case, it was a 50/50 shot as to which Google search was faster.

As for comparing it to Bing: Well, they don’t display how fast it generates results. It’ll have to sit out this speed test for now.

Winner: The New Google


2. Accuracy


While more subjective, accuracy is probably the issue that users care about most. Does the search engine find what you want on the first try? Well, we did our subjective test. New version:


Old version:


You’ll notice that many of the blended search options, like image search and news, don’t appear in the new version. It’s more likely that the features haven’t all been implemented, but it does decrease its relevancy. FriendFeed ranks much higher in the new search than Twitter or Facebook. Our bet is that the new Google has seen a burst of activity on FriendFeed and thus pushes up that result.

Both sets are very accurate, but subjectively, the set displayed by the new Google search more accurately reflect what a user would be looking for. If you’re wondering about Bing, it didn’t even bring up my personal website.

The next search, “Are social media jobs here to stay?” focused on getting my first Mashable article. The result? The new search cares more about keywords than the last. You could clearly see it cared about the full title and brought up more results with those keywords. Both brought a different set of results, but the new search was more relevant.

Winner: The New Google (tentatively)


3. Temporal Relevancy


How good is each at breaking news? The answer: about the same. FriendFeed results were identical, including the top news items. Searches for “Hall of Fame Game” got better news results on the new search. A search for “China Landslide” also got the same Yahoo and BBC news articles – although we did notice that the new search seems to change faster with new articles. It put an MSNBC article up high for updating the death toll:


We also give credit to Bing – on each search, it brought up great results.

Winner: Draw


4. Index Size:


Perhaps the easiest to test, we can tell the index size based on how many results come up for specific search. Here are searches once again for “dog:”

New:


Old:


Bing:


Searches for “Ben Parr” proved that the new Google is better than the old Google in terms of result size. Bing claims 2,210,000 for my name compared to 183,000 for my name, which is strange. Searches for “Tim Burton’s Alice in Wonderland Trailer” also show Bing > New Google > Old Google

Winner: Bing, it seems


Conclusion


While this test was nowhere near scientific, we do have some solid takeaways:

New Google is FAST: It often doubled the speed of Google classic.

New Google relies more on keywords: SEO professionals, your job just got a lot harder. The algorithm’s definitely different. It has more reliance on keyword strings to produce better results.

Search is moving into real-time: Being able to get info on breaking events is clearly a priority for Google and Bing. With both Twitter and Facebook launching real-time search engines, they needed to respond.

It’s partially a response to Bing: At least, that’s how we feel. This new search has a focus on increasing speed, relevancy, accuracy, and the index volume, things that Microsoft really hit on when it released Bing. It feels as if Google “Caffeine” is meant to shore up any deficiencies it may have when compared to Microsoft’s offering, though it’s been in the works long before Bing launched.

The new Google will only get better as features are implemented and developed. The end result is a better search experience for the user. Competition really does breed innovation."

From mark8t.com:

"Right now, we only want feedback on thedifferences between Google’s current search results and our new system. We’re also interested in higher-level feedback (”These types of sites seem to rank better or worse in the new system”) in addition to “This specific site should or shouldn’t rank for this query.” Engineers will be reading the feedback, but we won’t have the cycles to send replies.”

So how do you share the feedback? Do a search with and look on the search result Google.com and at Google’s Sandbox Caffeine engine. If you find something you wish to report head to the bottom of the page and click “Dissatisfied? Help us improve.” Type your feedback in the text box and then include the word caffeine somewhere in the text box. We highly recommend you check out your site, key industry terms for you and share your feedback. On our searches we found some interesting results and important changes. We wanted to share with you to see how “Caffeine” will change your Google experience.

Term: mark8t
Old Google: : 5190 results and no sitelinks
New Google:4680 results and sitelinks

Term: Montreal
Old Google: Tourism for Montreal is more prominent.
New Google: The official city of Montreal site is more prominent.

Term: Michael Jackson
Old Google: Very clear results, about Michael Jackson, focused on him and fan related sites.
New Google: A site about Michael’s face is on the first page of results, high up."

You can also test New Google Here

Cheers,

Jenson


No comments:

Post a Comment

AB

Your Ad Here

If You Wish To.....

Google.com is a(n)

Freelancer

Search This Blog

Knt

Followers