Google Caffeine is born
Did you hear? Google’s launching a new, upgraded version of its search engine soon. And just as important, the search giant released the developer’s preview of it today. Google (Google) promises that the new search tool (codename “Caffeine”) will improve the speed, accuracy, size, and comprehensiveness of Google search.
While the developer version is a pre-beta release, it’s completely usable. Thus, we’ve decided to put the new Google search through the wringer. We took the developer version for a spin and compared it to not only the current version of Google Search, but to Bing (Bing) as well.
The categories we tested the new search engine on are as follows: speed, accuracy, temporal relevancy, and index size. Here’s how we define those:
- Speed: How fast can the new search engine load results?
- Accuracy: Which set of results is more accurate to the search term?
- Temporal Relevancy: Is one version of search better at capturing breaking news?
- Index Size: Is it really more comprehensive than the last version of Google?
So without further ado, here’s the test:
Speed
The first category is incredibly important. How fast do these Google search results come at you anyway? Even a tenth of a second can mean millions for the search company as the longer it takes the load, the more likely someone will go look for results somewhere else.
So how fast is the new search? Lightning fast. As you probably know, Google tells you how long it takes to load results. We tried a few search terms, starting with “Dog.” Here’s the speed result:
Compare that to the original Google search:
0.12 vs. 0.25 seconds? They doubled the speed! That’s tremendous. We tried it with a variety of search terms (”The end of the universe is not here,” “There is no way that you cannot find ben parr. He is hiding back behind the tv,” “FriendFeed (FriendFeed),” etc.), and in every instance, the new Google won.
The only potential weak spot was when we added search commands like quotes, subtraction signs, and more. In this case, it was a 50/50 shot as to which Google search was faster.
As for comparing it to Bing: Well, they don’t display how fast it generates results. It’ll have to sit out this speed test for now.
Winner: The New Google
2. Accuracy
While more subjective, accuracy is probably the issue that users care about most. Does the search engine find what you want on the first try? Well, we did our subjective test. New version:
Old version:
You’ll notice that many of the blended search options, like image search and news, don’t appear in the new version. It’s more likely that the features haven’t all been implemented, but it does decrease its relevancy. FriendFeed ranks much higher in the new search than Twitter or Facebook. Our bet is that the new Google has seen a burst of activity on FriendFeed and thus pushes up that result.
Both sets are very accurate, but subjectively, the set displayed by the new Google search more accurately reflect what a user would be looking for. If you’re wondering about Bing, it didn’t even bring up my personal website.
The next search, “Are social media jobs here to stay?” focused on getting my first Mashable article. The result? The new search cares more about keywords than the last. You could clearly see it cared about the full title and brought up more results with those keywords. Both brought a different set of results, but the new search was more relevant.
Winner: The New Google (tentatively)
3. Temporal Relevancy
How good is each at breaking news? The answer: about the same. FriendFeed results were identical, including the top news items. Searches for “Hall of Fame Game” got better news results on the new search. A search for “China Landslide” also got the same Yahoo and BBC news articles – although we did notice that the new search seems to change faster with new articles. It put an MSNBC article up high for updating the death toll:
We also give credit to Bing – on each search, it brought up great results.
Winner: Draw
4. Index Size:
Perhaps the easiest to test, we can tell the index size based on how many results come up for specific search. Here are searches once again for “dog:”
Searches for “Ben Parr” proved that the new Google is better than the old Google in terms of result size. Bing claims 2,210,000 for my name compared to 183,000 for my name, which is strange. Searches for “Tim Burton’s Alice in Wonderland Trailer” also show Bing > New Google > Old Google
