Here are the new benchmark tests we will be using in our reviews

45comments
Here are the new benchmark tests we will be using in our reviews
Synthetic benchmarks should be approached with care, because putting too much trust in those numbers may result in unnecessarily high (or low) expectations of a device's performance. Indeed, it is real-world usage that counts, but still, benchmarking shouldn't be ignored altogether. After all, there are some tests that can actually give us a pretty good picture about certain aspects of a phone or a tablet.

We think you know where this is going. Ladies and gents, allow us to introduce our new benchmarks! Let us elaborate: we've come up with a number of somewhat more scientific tests that we'll use to study the devices' displays, system performance, camera speed, audio output and... that's right - battery life! The results will be easily visible in the respective device's review. Here's a glimpse of how the new benchmarks are going to look!

  • When it comes to displays, we'll be providing you with quite a lot of information. For example, you'll be able to see a display's maximum and minimum brightness, contrast, color temperature, Delta E, color gamut and more. We've tried to make it all easy to use and understand.


  • Up next, we'll continue to check performance of Android phones by running some of the most popular performance benchmarks out there, but we'll be displaying the results in a new, more appealing type of visualization.
QuadrantHigher is better
Sony Xperia Z Ultra18158
HTC One12481
Samsung Galaxy S412078
AnTuTuHigher is better
Sony Xperia Z Ultra29732
HTC One23308
Samsung Galaxy S424701
GFXBench Egypt HD 2.5 onscreen(fps)Higher is better
Sony Xperia Z Ultra52
HTC One31
Samsung Galaxy S439
Vellamo MetalHigher is better
Sony Xperia Z Ultra1153
HTC One781
Samsung Galaxy S4704
Vellamo HTML 5Higher is better
Sony Xperia Z Ultra2937
HTC One2395
Samsung Galaxy S41702


  • We'll be testing camera speeds in a couple of ways. The first one is our custom "Taking a pic" test, which will measure the time needed for a camera to launch, focus, take a picture, and get ready to take the next one. This test will also have a separate result for HDR photo-taking. We'll also post the scores we've got using the cross-platform Camspeed benchmarking app.
Taking a picLower is betterTaking an HDR pic(sec)Lower is betterCamSpeed scoreHigher is betterCamSpeed score with flashHigher is better
Apple iPhone 52.7
3.7
544
286
Sony Xperia Z3
4
987
948
Google Nexus 42.8
4.3
434
395


  • Moving on to the audio output, there are two things we're going to measure in this regard. The first is the output power of the 3.5 mm headphone jack (in volts), and the second one is the loudspeaker's loudness (in decibels).
Headphones output power(Volts)Higher is better
Apple iPhone 50.54
Sony Xperia Z0.37
Google Nexus 40.28
Loudspeaker loudness(dB)Higher is better
Apple iPhone 571
Sony Xperia Z67
Google Nexus 480


Recommended Stories
  • Finally, we've created a custom battery life benchmark to test phones with. It's a special script, designed to replicate real-life usage. The results for each handset or tablet will be provided in hours and minutes.
We measure battery life by running a custom web-script,designed to replicate the power consumption of typical real-life usage.All devices that go through the test have their displays set at 200-nit brightness.
hoursHigher is better
Sony Xperia Z
4h 48 min(Poor)
Apple iPhone 5
4h 22 min(Poor)
Google Nexus 4
4h 47 min(Poor)

Of course, keep in mind that all of these benchmarks are quite new, so we might continue polishing and improving them during the days ahead.

Recommended Stories

Loading Comments...
FCC OKs Cingular\'s purchase of AT&T Wireless