After some recent incidents in which Samsung was found to have engineered their devices to perform in an exceptionally strong manner when being measured for benchmark tests with common tools, some folks have been searching for a way to minimize what they see as “cheating” by smartphone manufacturers. One of those searching for a better way is a startup company called GameBench. They claim to have created a test that focuses on gaming capabilities, primarily screen performance and battery drain, that cannot be tricked because it uses actual game titles for the testing. The app is still in beta with a projected release date sometime during the first quarter of 2014. However, GameBench has already put the Samsung Galaxy S 4 and the HTC One through the paces.
When it was discovered earlier this week that Samsung may be artificially inflating the benchmark scores for the new Samsung Galaxy Note 3, it seemed like a repeat of what happened earlier this year with the Samsung Galaxy S 4. Thus, it should be no surprise that, just like back then, Samsung has publicly responded to the criticism with the same answer. According to an official statement:
“The Galaxy Note 3 maximises its CPU/GPU frequencies when running features that demand substantial performance…This was not an attempt to exaggerate particular benchmarking results. We remain committed to providing our customers with the best possible user experience.”
Considering the testing that Ars Technica did in creating a duplicate, but differently named, benchmarking program that would invoke the same “features that demand substantial performance,” the defense from Samsung does not seem to be very solid.
Do you think Samsung will suffer for these incidents? How do you think Samsung should handle the issue?
The on again, off again saga of the Motorola X Phone continues with a new entry today courtesy of graphic benchmarking site GFXBench. Going by the codename “Ghost” a Motorola XT1058 showed up sporting an 1196 x 720 screen resolution and Android 4.2.2. The device lists a MSM8960 chipset, which makes it seem likely it is running a Snapdragon S4 Pro or Snapdragon 600, although the testing results may reveal something more.
Benchmarking is one of those tech subjects these days that gets a lot of people worked up. From fan-boys of certain devices or carriers to the family guy a few cubicles down from you at work, you’ve no doubt been approached by someone either in person or online flaunting their latest benchmark scores. But admit it, there’s something about running those tests that we just gravitate to. It’s just in our blood.
Enter Vellamo’s updated benchmarking app from Qualcomm. Vellamo has completely revamped the UI, which is gorgeous by the way, and now features everything from CPU performance to networking capabilities via simulated 3G/4G/WiFi, HTLM5, and web browsing all while comparing your results to other devices. We all know these benchmarks do not mean much in the real world with each and every phone literally being set up differently once it’s in users’ hands. However, Vellamo makes it very appealing to run their app with the latest update, if only to view the gorgeous interface – and maybe grab a glance of how your device still stacks up compared to that new device that just launched. Check it out and let us know what you think of it.
Play Store Download Link
It was during my trip into London for the Galaxy S III unveiling that I noticed an interesting trend amongst the crowd as they pawed Samsung’s new flagship phone for the first time. What do you think was the first thing most people did; check out the browser, fire up the camera, have a play with S Voice? Some people did, however the most common activity the majority of people indulged in was to download and run a benchmarking application. It seems that a lot of Android enthusiasts are interested in how their new baby measures up against the competition when it’s being put through its paces. It’s long been said that benchmarking applications aren’t actually as accurate as they should be, some are optimised better for a certain version of the OS or even a particular processor. Furthermore to get the full range of results you may find yourself using 2 or 3 different applications. Qualcomm reckons it might just have the answer to this problem.
What is the most stress you can put your phone under at any one time? Well according to Qualcomm it’s running an Augmented Reality (AR) application. AR applications utilise close to all of the major components in the phone all at once including CPU, GPU, DSP, ISP, GPS, gyroscope, compass, accelerometer, barometer, microphone and camera. An AR benchmark application “would be as close as one could come to a total test of a smartphone”
We’re potentially at the Dawn of a new era for technology with the fabled Project Glass prototype already in the hands of some Android developers. Qualcomm, it seems, are ready to help us check to see if our devices are up to the job.
For all you hardcore benchmark fans out there, we have a new one for you to play with. Qualcom and Qualcomm Innovation Center just released Vellamo which is a benchmarking tool for evaluating mobile Web performance.
So the next time you are in a store shopping for a new phone you can compare scores from different devices, or maybe you want to compare scores with your friends or spouse. It could even make a good party game, and if you don’t have another device to compare it with, it will show you comparable scores from different devices in the same category starting with a low tiered smartphone all the way up to a tablet.
Check out the video and download links after the break.
At CES 2011, talkandroid was there and got to play with the impressive Motorola Droid Bionic. It is a sweet little device, as you can tell in our Hands-On video here. To add to it’s awesomeness, some others got to run some benchmarks on it, and not surprisingly, it put up some kick butt numbers in comparison to other “top devices” currently on the market as you can see below.
There’s many tools out there to benchmark an Android device, but Quadrant seems to be the favorite, scoring the Droid Bionic 2284 putting it well above other previously released Android smartphones.
Check the full test video from CES below.