[q] how much reliabe are benchmarks - General Questions and Answers

I just want to know that if we can trust on benchmark scores. How much reliable are they???
If bechmark scores are very good then is it sure that it will perform better and if benchmarks are not that good then will that device be give good performance inspite of its bad benchmarks. I just want to know

ashish2193 said:
I just want to know that if we can trust on benchmark scores. How much reliable are they???
If bechmark scores are very good then is it sure that it will perform better and if benchmarks are not that good then will that device be give good performance inspite of its bad benchmarks. I just want to know
Click to expand...
Click to collapse
Don't count on benchmarks, they don't compare with day to day use. I would never purchase a phone based on benchmarks alone, but rather some hands on time with it.

So how can we make decision about good phone??
Sent from my LT18i using xda premium

ashish2193 said:
So how can we make decision about good phone??
Sent from my LT18i using xda premium
Click to expand...
Click to collapse
Just Google reviews on the phones and see which one fits your needs
Sent from my Pink Unicorn stable

Related

Bad quadrant scores

I have recently purchased my g2x and even though it seems fast it post really bad quadrant scores on all of the different quadrant test. On the benchmark test it was up to 2400 no can't get past 1300. Does this mean one of the processors went out.
Sent from my LG-P999 using XDA App
zackyzack said:
I have recently purchased my g2x and even though it seems fast it post really bad quadrant scores on all of the different quadrant test. On the benchmark test it was up to 2400 no can't get past 1300. Does this mean one of the processors went out.
Sent from my LG-P999 using XDA App
Click to expand...
Click to collapse
No. But how do you check that?
Sent from my LG-P999 using XDA Premium App
Quadrant Standard sucks for benchmarks. It is inconsistent and gives odd scores, like the time I scored 24000 with my ZIO.... yeah right, this phone is lucky to hit 1080 with our new overclocked kernel
Use AnTutu Benchmark and you should get more consistent scores.
Sent from my Zio using XDA Premium App
Mattix724 said:
Quadrant Standard sucks for benchmarks. It is inconsistent and gives odd scores, like the time I scored 24000 with my ZIO.... yeah right, this phone is lucky to hit 1080 with our new overclocked kernel
Use AnTutu Benchmark and you should get more consistent scores.
Sent from my Zio using XDA Premium App
Click to expand...
Click to collapse
Well I get constant 2400 scores. Froyo stock.
Sent from my LG-P999 using XDA Premium App
zackyzack said:
I have recently purchased my g2x and even though it seems fast it post really bad quadrant scores on all of the different quadrant test. On the benchmark test it was up to 2400 no can't get past 1300. Does this mean one of the processors went out.
Sent from my LG-P999 using XDA App
Click to expand...
Click to collapse
Does the phone feel laggy during normal use? If not I wouldn't wory too much about quadrant scores. Try running a Linpack benchmark. Your score should be in the low 30's.
No it feels like its running great just really low scores all around. Im getting about 18 on linpqck
Sent from my LG-P999 using XDA App
Yeah i'm experiencing the same thing can't even get past 2000 and when i check quadrant about phone option it says i have one core pretty sure no one screwed up my phone when they shipped it... T__T
I think peoples experiences with Quadrant seem to vary a great deal. I tend to get pretty consistent results from it.

Quadrant Scores

My Skyrocket gets way higher quadrant scores than a friend of mine's OGS2.
3500vs3100
Yet... On every visual test he gets 20fps MORE than I do? Why is his score lower? the phone feels faster than mine.
Thoughts?
Overall I found the OGS2 to be smoother with the animations, etc.
Graphic tests (2D and 3D) are only some parts from the overall Quadrant test (CPU, Memory, I/O, Graphic). If you're using Quadrant Advanced, you could see scores from each test performed.
What if you try other benchmark app such as Antutu ? You'll get more detailed result.
---------------------------------
Sent from my Samsung Galaxy Mini GT-S5570 via xda-dev app
CyanogenMod 7.2.0-RC3-KANG by squadzone
Most probably...
I was shocked to see the results. but in "3d" test, the S2 simply blew the SR out of the water.
And the OS itself seemed more fluid than the skyrocket.
I got 4000 on quadrant with stock Rom.....
Take that OGS2!
both phones are fast in there own way.
but let the pissing contest continue, as you were.
They have different processors or chip sets. (one or both of them. I forget.)
Sent from my SAMSUNG-SGH-I897 using XDA App
Was that the score from just one part of the test? I ran a couple.. the total score was a little over 6000 for each?
I had read that these scores don't mean that much?? But, hey I'm new to Android..
Sent from my SGH-I727R using XDA App
shaggyskunk said:
Was that the score from just one part of the test? I ran a couple.. the total score was a little over 6000 for each?
I had read that these scores don't mean that much?? But, hey I'm new to Android..
Sent from my SGH-I727R using XDA App
Click to expand...
Click to collapse
Its just a way to measure your e-peen. Antutu is much better.
Sent from my SGH-I727 using xda premium
Strange Observation
Today I received my replacement SR from Amazon and I ran few Quadrant tests and was constantly getting 3000+ score, with highest being 3360. Without installing anything else I just rooted the phone with Easy Root and then re-ran Quadrant test few times and did not get 3000+ score even once. The best I got was 2500. All other scores were between 2200 - 2300.
Any idea why rooting the phone can cause this drop? I also noticed that after rooting, the phone does not feel as snappy as stock.
ajamils said:
Today I received my replacement SR from Amazon and I ran few Quadrant tests and was constantly getting 3000+ score, with highest being 3360. Without installing anything else I just rooted the phone with Easy Root and then re-ran Quadrant test few times and did not get 3000+ score even once. The best I got was 2500. All other scores were between 2200 - 2300.
Any idea why rooting the phone can cause this drop? I also noticed that after rooting, the phone does not feel as snappy as stock.
Click to expand...
Click to collapse
Its not the root.. Quadrant tests are pointless and the more you run them the less they get.. they are very erratic...
Antu or Cf Bench are much more accurate and true to form.
Longcat14 said:
Its just a way to measure your e-peen. Antutu is much better.
Sent from my SGH-I727 using xda premium
Click to expand...
Click to collapse
I have been using Antutu, just not really sure what to make of the numbers?
Sent from my SGH-I727R using XDA App
GalaxySkyrocket500 said:
Its not the root.. Quadrant tests are pointless and the more you run them the less they get.. they are very erratic...
Antu or Cf Bench are much more accurate and true to form.
Click to expand...
Click to collapse
Antutu or CF might be more accurate but since I use one tool to compare the different ROMS / Phones..... that shouldn't matter.
ajamils said:
Antutu or CF might be more accurate but since I use one tool to compare the different ROMS / Phones..... that shouldn't matter.
Click to expand...
Click to collapse
This is UNTRUE if quadrant its self is not accurate it will only make ur Baseline for tests just as in accurate and false.
Sent from my SAMSUNG-SGH-I727 using xda premium
Exactly. If you run 10 tests and get 10 greatly varying results then something is wrong haha.
I have this argument with people all the time on quadrant and sleedtest.net (xtremelabs speed test is more consistent)
the2rrell said:
This is UNTRUE if quadrant its self is not accurate it will only make ur Baseline for tests just as in accurate and false.
Sent from my SAMSUNG-SGH-I727 using xda premium
Click to expand...
Click to collapse
Sent from my SAMSUNG-SGH-I727 using XDA App
The problem with quadrant is as if it somehow doesn't scale the processor to full speed. For me it has always been consistent...

Urgent Advice needed..!!

selling my G2x to buy Xperia neo v because of good support of sony and already ics on it.. is it a wise decision to go to single core after using a dual core??
Dude I would stick with G2x Sony sucks!!!!
Sent from my LG-P999 using XDA
vipaman said:
Dude I would stick with G2x Sony sucks!!!!
Sent from my LG-P999 using XDA
Click to expand...
Click to collapse
why it sucks?.. there is no hope of ics on G2x even t-mobile has stopped its production
Its a downgrade!
PS. Its not even 4g -__-
Sent from my LG-P999 using Tapatalk 2
Yeh. Plus, its just an os. Just wait for Ics like everyone here
Sent from my LG-P999 using XDA
First of all, I would definitely recommend sticking to the G2x. Ics isn't THAT big of a deal, plus we've already got AMAZING devs here at xda that are very close to having almost perfect builds of ics ready for us.
Sent from my LG-P999 using xda premium
Our dual cores aren't even utilized properly. There are a lot of phones that out perform dual cores with single cores
Sent from my LG G2X running AOKP ICS using XDA App
barqers said:
Our dual cores aren't even utilized properly. There are a lot of phones that out perform dual cores with single cores
Sent from my LG G2X running AOKP ICS using XDA App
Click to expand...
Click to collapse
Proof? Like to see a single core score 8.4k on antutu. There are not lots lol....
Stick with your g2x for now. Our gb rom's are flawless and ics will be here sooner than later.
Pin it to Win it.
i am buying Xperia ray a decent specs mobile with ics and not too much xpensive.. the main reason of selling g2x is very bad camera quality no future support not good audio .. heats up .. etc otherwise its a good set
Who the f cares about benchmark shizz. Its how the phone actually runs when ur using it. Fk numbers
Sent from my LG-P999 using XDA
eHow does the camera suck? Who cares about ics? There's at least 5 different builds here. I beg to differ on the cores being utilized efficiently, now with the update everything runs pretty efficiently. Battery life will show that. Its so hard having grown up in the 1970's -1980's to understand how younger generations appreciate nothing and expect perfection. It has to do with the internets. When I got my Atari 2600 in 1980, I was sooooo happy with it. There was no forum to chew the Developers asses. Not to mention, its just rude. Could you imagine the 2600 being released today? 90% of ya would kill yourselves.
Sent from my LG-P999 using xda premium
mustangtim49 said:
eHow does the camera suck? Who cares about ics? There's at least 5 different builds here. I beg to differ on the cores being utilized efficiently, now with the update everything runs pretty efficiently. Battery life will show that. Its so hard having grown up in the 1970's -1980's to understand how younger generations appreciate nothing and expect perfection. It has to do with the internets. When I got my Atari 2600 in 1980, I was sooooo happy with it. There was no forum to chew the Developers asses. Not to mention, its just rude. Could you imagine the 2600 being released today? 90% of ya would kill yourselves.
Sent from my LG-P999 using xda premium
Click to expand...
Click to collapse
Lol I still have my Atari
Sent from my LG G2x using Tapatalk 2
I honestly don't even like ICS that much, Gingerbread works fine for me, it's blazing fast.
g1user101 said:
Who the f cares about benchmark shizz. Its how the phone actually runs when ur using it. Fk numbers
Sent from my LG-P999 using XDA
Click to expand...
Click to collapse
Well for one I care about the "benchmark shizz"
But its always been about how the phone runs. That's why they invented benchmark programs to score each phones performance so you can compare how the hardware/software combination you are using performs. Using that tool you can actually get a tangable number for each setup you run therefore giving you the higher number for higher performance. So think about what you say before you go contradicting yourself in public.
P.s
Why F*ck numbers? Pretty sure binary is numbers..... you got a bad attitude.
Pin it to Win it.
I.R.Chevy said:
Well for one I care about the "benchmark shizz"
But its always been about how the phone runs. That's why they invented benchmark programs to score each phones performance so you can compare how the hardware/software combination you are using performs. Using that tool you can actually get a tangable number for each setup you run therefore giving you the higher number for higher performance. So think about what you say before you go contradicting yourself in public.
P.s
Why F*ck numbers? Pretty sure binary is numbers..... you got a bad attitude.
Pin it to Win it.
Click to expand...
Click to collapse
Hehe
Sent from my LG-P999 using XDA
g1user101 said:
Hehe
Sent from my LG-P999 using XDA
Click to expand...
Click to collapse
Jus' Saying
Pin it to Win it.
I.R.Chevy said:
Jus' Saying
Pin it to Win it.
Click to expand...
Click to collapse
I was just saying too
Sent from my LG-P999 using XDA
g1user101 said:
Hehe
Sent from my LG-P999 using XDA
Click to expand...
Click to collapse
Agree with Chevy, attitude is kinda poor haha. Especially with no rebuttal to what was said, just a "Hehe" looks like you just wanted some attention.
Sent from my LG-P999 using xda premium
mt3g said:
Agree with Chevy, attitude is kinda poor haha. Especially with no rebuttal to what was said, just a "Hehe" looks like you just wanted some attention.
Sent from my LG-P999 using xda premium
Click to expand...
Click to collapse
Haha OK. Well I was just saying.
Sent from my LG-P999 using XDA
I.R.Chevy said:
Well for one I care about the "benchmark shizz"
But its always been about how the phone runs. That's why they invented benchmark programs to score each phones performance so you can compare how the hardware/software combination you are using performs. Using that tool you can actually get a tangable number for each setup you run therefore giving you the higher number for higher performance. So think about what you say before you go contradicting yourself in public.
P.s
Why F*ck numbers? Pretty sure binary is numbers..... you got a bad attitude.
Pin it to Win it.
Click to expand...
Click to collapse
If F*ck number was the case....
Let's give him a
0.00000000040 Inch Screen phone..
0.1 Mhz Single Core processor.
1Kilobit ram
....
k cool

1.85 worse quadrant scores?

So I just updated from 1.73 to 1.85... And my quadrant scores are like 600 less, at 4400 compared to ~4970 on 1.73.. already factory reset, disabled a bunch of apps, etc. Not really sure what the deal is, anybody else experience this?
Sent from my HTC One X using XDA
Is your phone noticeably slower? No? Then who cares...?
Sent from my HTC One X using xda premium
Homescreen feels a little sluggish..
Sent from my HTC One X using XDA
Did it feel that way before you saw the quadrant score?
Sent from my HTC One X using xda premium
Haha I don't know.. it could be my mind telling me that it is, but the score that took the biggest hit is CPU, significantly lower than what quadrant says my device should be. I/o, 2d, and 3d graphics are slightly lower while memory is much higher..
Sent from my HTC One X using XDA
rfree2340 said:
Haha I don't know.. it could be my mind telling me that it is, but the score that took the biggest hit is CPU, significantly lower than what quadrant says my device should be. I/o, 2d, and 3d graphics are slightly lower while memory is much higher..
Sent from my HTC One X using XDA
Click to expand...
Click to collapse
its been said that quadrant doesnt relate to real world performance very well. for example i lost 50% after update on quadrant back with the evo and the phone actually felt faster. Run quadrant if you want but just dont put a lot of faith in the score vs your user experience. What is important is how it feels to YOU, not quadrant. Most all of the early reports say 1.85 feels a good bit faster than the others..
Yeah, I do realize that, but I also want to compare scores with others who updated to 1.85 because if everyone else is getting better scores still then maybe there's something wrong with my device, though I bet that is highly unlikely as it is just software.
Sent from my HTC One X using XDA
I can concur with the OP. I had scores of 5200, when I updated, they went down to about 4600. Doesn't make a difference as the phone is a little smoother now.
happened to me too. pisses me off!
I had scores anywhere from 4700-5150 now I can't get any higher than 4500 after the update.

Samsung Distorting Benchmarks

http://www.androidpolice.com/2013/0...ively-changing-gpu-frequency-in-certain-apps/
Interesting. This may be why I only get 6800-7500 in Quadrant on AOSP roms, but on Samsung touchwiz roms I get a MUCH higher score.
I just finished reading this thread when I saw this new thread. Sorry
http://forum.xda-developers.com/showthread.php?t=2385991
Samsung "Cheats" To Gain Benchmark Performance Edge Over Competition
It is intriguing, but I don't worry to much about benchmarks.
Sent from my SAMSUNG-SGH-I337 using xda app-developers app
We all already knew this...and its been said many times here in the forums not to trust benchmarks for that exact reason...and samsung isnt the only one doing it...all the manufacturers do it
Sent from my SAMSUNG-SGH-I337 using Tapatalk 2
That does make sense. I remember after I first flashed paranoid android I was worried because it's benchmarks were so low in comparison to stock. If Samsung is doing this then I believe the htc one has to do the same thing considering it's benchmarks are about the same as the s4 running touch wiz.
Sent from my SGH-I337 using xda premium
lodidarkening said:
That does make sense. I remember after I first flashed paranoid android I was worried because it's benchmarks were so low in comparison to stock. If Samsung is doing this then I believe the htc one has to do the same thing considering it's benchmarks are about the same as the s4 running touch wiz.
Sent from my SGH-I337 using xda premium
Click to expand...
Click to collapse
I too agree that benchmark doesn't mean much to user experience. A custom ROM can mean a whole lot more in term of smoothness

Categories

Resources