Related
Hi would like to know if smartbench is accurate. Cause my games index point seems to be higher than other device by alot. 3095 pts
Sent from my Nexus S using XDA Premium App
dplate07 said:
Hi would like to know if smartbench is accurate. Cause my games index point seems to be higher than other device by alot. 3095 pts
Sent from my Nexus S using XDA Premium App
Click to expand...
Click to collapse
i dont trust smartbench. i get games indexes from 6000-1000 while overclocked at 1.544ghz. generally, benchmarks do not mean anything, but are nice to use just to compare devices.
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
Oh that's interesting. simms22, do you get that result every time you run the app or just occasionally? That is a bug that needs to be fixed!
Thanks.
Acei said:
Oh that's interesting. simms22, do you get that result every time you run the app or just occasionally? That is a bug that needs to be fixed!
Thanks.
Click to expand...
Click to collapse
i get a constant 5000-10000. but it ranges between 5000-10000 on every run. its not consistent around a certain score.
Acei said:
Oh that's interesting. simms22, do you get that result every time you run the app or just occasionally? That is a bug that needs to be fixed!
Thanks.
Click to expand...
Click to collapse
i figured theres something wrong, so i havent been publicizing these.
lol, heres a few more
Acei said:
Oh that's interesting. simms22, do you get that result every time you run the app or just occasionally? That is a bug that needs to be fixed!
Thanks.
Click to expand...
Click to collapse
Are you going to throw out all results and go reestablish a new baseline for every device?
Acei said:
Oh that's interesting. simms22, do you get that result every time you run the app or just occasionally? That is a bug that needs to be fixed!
Thanks.
Click to expand...
Click to collapse
morfic said:
Are you going to throw out all results and go reestablish a new baseline for every device?
Click to expand...
Click to collapse
i have to wonder the same the same thing. are ALL results invalid now? if there is a bug, then it cant be trusted with any device until the bug is squashed. who knows which results are valid or not.
Results are relatively easy to hash out, at least so far. These high index scores are caused by one or more sub-tests that somehow fails and ends up with unrealistic scores (well into millions). The server submit script rejects these results so they don't really make it to the DB (although I will check it out manually to make sure this is the case). I do have a script that runs nightly and looks for other anomalies as well.
As you can see in this link, you won't find your scores in the DB:
http://smartphonebenchmarks.com/ind...bench2011:Games&filter_cpu=all&filter_gpu=all
The real question though is why it is reporting these high values - I need to know which test fails and reports false numbers when it is performing the final calculation.
Going back to the same question - is it happening to you on every single test run, or does it only happen occasionally? You are the first person to report this so far.
Thanks again.
morfic said:
Are you going to throw out all results and go reestablish a new baseline for every device?
Click to expand...
Click to collapse
I would do this gladly if I find any evidences that the results contain garbage. So far though, the results either look good or they are close to infinite (very small % of the runs cause this though) so it's pretty easy to figure out which ones are wrong.
Acei said:
I would do this gladly if I find any evidences that the results contain garbage. So far though, the results either look good or they are close to infinite (very small % of the runs cause this though) so it's pretty easy to figure out which ones are wrong.
Click to expand...
Click to collapse
Do you have a way to proof that a 3600 when usual avg is 3400 is not caused by a minor glitch?
Why not change the app behavior to not submit anything when something failed?
How much can the current results be trusted if we rely on "i think nothing else but the 'obvious' ones went through"?
Acei said:
Results are relatively easy to hash out, at least so far. These high index scores are caused by one or more sub-tests that somehow fails and ends up with unrealistic scores (well into millions). The server submit script rejects these results so they don't really make it to the DB (although I will check it out manually to make sure this is the case). I do have a script that runs nightly and looks for other anomalies as well.
As you can see in this link, you won't find your scores in the DB:
http://smartphonebenchmarks.com/ind...bench2011:Games&filter_cpu=all&filter_gpu=all
The real question though is why it is reporting these high values - I need to know which test fails and reports false numbers when it is performing the final calculation.
Going back to the same question - is it happening to you on every single test run, or does it only happen occasionally? You are the first person to report this so far.
Thanks again.
Click to expand...
Click to collapse
i get them every time. but the lower the ghz kernel i use, the lower the score.
as far as i remember(i can be wrong) i had to submit my scores to the site to get added to the DB, but that was months ago. btw, i did get these scores a few weeks ago, but never posted them anywhere because they are just too ridiculous.
morfic said:
Do you have a way to proof that a 3600 when usual avg is 3400 is not caused by a minor glitch?
Click to expand...
Click to collapse
I can't guarantee that every single test run results stored in DB are accurate of course. That's one of the reason why I am continuously capturing more results to determine more accurate average results. But you are right, 3600 vs 3800, there is no way to prove that.
Why not change the app behavior to not submit anything when something failed?
How much can the current results be trusted if we rely on "i think nothing else but the 'obvious' ones went through"?
Click to expand...
Click to collapse
Yes, I have been doing this for a while now. Smartbench is an app written by a human after all. Just as other apps I have written since the past 15 years, this one has bugs too. I have been fixing bugs and I am determined to fix new ones that get discovered as well, that's why I am here right now.
The server-side scripts are there just in case more bugs are discovered on the client-side code. The goal is, as you mentioned here already, fix it at the root which is in the app itself.
simms22 said:
i get them every time. but the lower the ghz kernel i use, the lower the score.
Click to expand...
Click to collapse
Hmm, that is indeed interesting.
Did you get this from day 1 or after some mods?
as far as i remember(i can be wrong) i had to submit my scores to the site to get added to the DB, but that was months ago. btw, i did get these scores a few weeks ago, but never posted them anywhere because they are just too ridiculous.
Click to expand...
Click to collapse
Yes those scores are too ridiculous and I do intend to find out why it is reporting them, on your particular phone and not on others.
Do you let them run without any interruptions?
A while back, some have found a way to "cheat" the app by performing certain actions so I had to add some code to check for those.
Going back to your run, I just had a look in the DB. I can see one of your runs - you got high scores because your JellyFish score was really high. Did your Jelly Fish test run properly from the beginning to the end? All I'm doing here is capturing a time before the test and another one at the end, down to a nano-second accuracy. I could easily reject these results on the client side and report invalid runs but I would prefer to find out why it is causing this in the first place...
Hi guys,
I have just released a v1.2.1 which fixed the problem described here.
If you are interested, you can check out the following article (I wrote it) here:
http://bit.ly/lfxS1a
Thanks!
EDIT: For some strange reason, I don't see the latest version in the Android Market yet. In the past, the update has always been instantaneous. I hope this one gets updated soon.
EDIT2: I see the update now!
Acei said:
Hi guys,
I have just released a v1.2.1 which fixed the problem described here.
If you are interested, you can check out the following article (I wrote it) here:
http://bit.ly/lfxS1a
Thanks!
EDIT: For some strange reason, I don't see the latest version in the Android Market yet. In the past, the update has always been instantaneous. I hope this one gets updated soon.
EDIT2: I see the update now!
Click to expand...
Click to collapse
Coming to think of it, we saw similar in the past, where high scores caused a rejection of the scores even if everything finished through.
Why not add a failed score as a zero, total number of scores / number of scores == avg
Not just succeeded scores, this way devices where tests fail will score low, as would be expected.
BUT, if tests fail, can you be verbose what failed, how far it got before it failed?
I have not seen 2011 complete on my phones in a long time (i mean not gotten a "valid score") and i would like to know where the problem is. And none of those with gfx show signs of early exits, numerical tests i can't get visual clues from.
Thanks,
Daniel
Acei said:
Hi guys,
I have just released a v1.2.1 which fixed the problem described here.
If you are interested, you can check out the following article (I wrote it) here:
http://bit.ly/lfxS1a
Thanks!
EDIT: For some strange reason, I don't see the latest version in the Android Market yet. In the past, the update has always been instantaneous. I hope this one gets updated soon.
EDIT2: I see the update now!
Click to expand...
Click to collapse
i just updated and tested. im still getting high scores.for example, overclocked to 1.1ghz i just scored a 12000+ on games. lol, thats just funny. but i do see the jellyfish test as faster than id expect. but not that much. interesting to note, i had a few failed benchmarks this time. but more high scores after.
morfic said:
Coming to think of it, we saw similar in the past, where high scores caused a rejection of the scores even if everything finished through.
Why not add a failed score as a zero, total number of scores / number of scores == avg
Not just succeeded scores, this way devices where tests fail will score low, as would be expected.
Click to expand...
Click to collapse
I'm pretty sure I'll get arguments from both sides on this. Some units will overclock better than others (even if they are the same devices/models), so for those lucky owners with more headroom will want to see results that don't include failed results. Or at least that is my opinion. At the end of the day, you guys will need to tell me which makes more sense.
In the worst case, I can implement both, and allow you to select which "mode" you want to see.
BUT, if tests fail, can you be verbose what failed, how far it got before it failed?
I have not seen 2011 complete on my phones in a long time (i mean not gotten a "valid score") and i would like to know where the problem is. And none of those with gfx show signs of early exits, numerical tests i can't get visual clues from.
Thanks,
Daniel
Click to expand...
Click to collapse
This is definitely possible. There are currently several checks I do to see if test runs are valid:
1. If an app has lost its focus, I assume the test is invalid. This was done to prevent people from switching out of the app during the test run and end up with some funky scores. Somehow users were getting interesting scores!
2. If any of the test suit throws exceptions (i.e. crashes), then I assume the test is invalid. As you mentioned here already, it is possible to find out at least which test suit failed.
It appears that it is still possible to end the test early without crashing as I have witnessed in this thread. So I will look further into other possibilities as well.
simms22 said:
i just updated and tested. im still getting high scores.for example, overclocked to 1.1ghz i just scored a 12000+ on games. lol, thats just funny. but i do see the jellyfish test as faster than id expect. but not that much. interesting to note, i had a few failed benchmarks this time. but more high scores after.
Click to expand...
Click to collapse
Very interesting! So that means your result is caused by not one but two issues. I may have to go as far as checking to see if it has completed rendering the right # of frames during the test.
simms/morfic, would you guys mind testing for few more scenarios for me? I can produce a special build to do some further experiment.
Thanks much!
Acei said:
Very interesting! So that means your result is caused by not one but two issues. I may have to go as far as checking to see if it has completed rendering the right # of frames during the test.
simms/morfic, would you guys mind testing for few more scenarios for me? I can produce a special build to do some further experiment.
Thanks much!
Click to expand...
Click to collapse
I've always been a fan of your work actually being on the forums and working bugs out. There aren't many devs dedicated like you so anything you want to test, hit me up as well, fortunately/unfortunately mine hasn't shown one of these erroneous scores so I'm not sure if my phone will help, my game index score is always in the 3000 range.
Sent from my Nexus S 4G using Tapatalk
dreamsforgotten said:
I've always been a fan of your work actually being on the forums and working bugs out. There aren't many devs dedicated like you so anything you want to test, hit me up as well, fortunately/unfortunately mine hasn't shown one of these erroneous scores so I'm not sure if my phone will help, my game index score is always in the 3000 range.
Sent from my Nexus S 4G using Tapatalk
Click to expand...
Click to collapse
Thanks for the offer.
Even a positive confirmation that the latest build works is helpful.
http://www.xda-developers.com/android/cf-bench-for-android-devices/
Anyone check it out yet?
You gotta scroll all the way down in the results page to get your overall score.
i installed this program scored a 2210 not bad i guess
FBis251 said:
http://www.xda-developers.com/android/cf-bench-for-android-devices/
Anyone check it out yet?
You gotta scroll all the way down in the results page to get your overall score.
Click to expand...
Click to collapse
Apparently the dev just wants to get some initial data before tweaking the app. I think it'll eventually get to be more accurate than Quad. I saw a post about someone getting a 10k score with only a 1.5ghz OC using CM7 on a tablet... Yeah, made the dev post up a comment saying that he'd fix the bug... Haha.
Well here's my first benchmark test using cm with two pages of widgets and auto brightness...
That's slow......
D85010d Antutu score = 41252
D85010f Antutu score = 41671
How are you guys getting such good scores?
I only got 38k
Dandreas2015 said:
How are you guys getting such good scores?
I only got 38k
Click to expand...
Click to collapse
I turn off auto sync accounts, turn off gps location, use wifi location for Lookout, turn off Google reporting. There are 50 play store apps in addition to system apps. I disable most of the at&t apps. Turn off quick circle case if not using.
Well I got up 1k, this is without turning anything off.
Running liquid smooth 3.2
bigfdaddy2 said:
Well here's my first benchmark test using cm with two pages of widgets and auto brightness...
Click to expand...
Click to collapse
I'd be mostly concerned about storage IO at this point. The new Nexus 6 is weak in this area and seems the N5 beats it in every-day use scenarios.
Dandreas2015 said:
How are you guys getting such good scores?
I only got 38k
Click to expand...
Click to collapse
My score score was when I was running CM 4.4.4. When I'm running stock, I got 38,900. However I don't do anything special to run the scores. I don't turn anything off or even close out recent apps. I figure I want the score to represent my normal usage, not some "test environment."
Im running Resurrection remix 5.0.2 on mine.
45k for AT&T's Lolliipop.
For real? Dang
Its simple...I've made this Thread to whoever wants to share their Antutu Benchmark scores, also please share any modification you've done to the device, thanks:fingers-crossed:
LG V10 ***Rooted***
Stock, of course no custom ROM, kernel, etc etc available just yet...
Just freezed bunch of apps with Titanium Backup
"I don't have a **** about benchmark scores..."
*proceeds to make a thread asking for benchmark scores*
I can't load antutu or geekbench. Tells me to disable my network connection, but it still won't work
Sent from my iPad using Tapatalk
Bootup said:
"I don't have a **** about benchmark scores..."
*proceeds to make a thread asking for benchmark scores*
Click to expand...
Click to collapse
yeiiii!!! you earned a "like"...:highfive:
I forgot, im not a benchmark guy, if you want to make fun, go ahead, im just trying to see the performance of each device, ive seem people talking about getting 39k, this and that, why don't you just run the benchmark and post your results come on man, just for fun:fingers-crossed:
digitallure said:
I can't load antutu or geekbench. Tells me to disable my network connection, but it still won't work
Sent from my iPad using Tapatalk
Click to expand...
Click to collapse
Now, that's weird, try rebooting the phone!!!
yoniinfante said:
Now, that's weird, try rebooting the phone!!!
Click to expand...
Click to collapse
I tried that too
digitallure said:
I tried that too
Click to expand...
Click to collapse
Damn, try uninstalling the app and re install, and try again
yoniinfante said:
Damn, try uninstalling the app and re install, and try again
Click to expand...
Click to collapse
I take that back, I put it in airplane mode and it's working. But still, I shouldn't have to do that...."Kanye shrug"
Sent from my iPad using Tapatalk
digitallure said:
I take that back, I put it in airplane mode and it's working. But still, I shouldn't have to do that...."Kanye shrug"
Sent from my iPad using Tapatalk
Click to expand...
Click to collapse
yeah I know, still weird
I only get 50k.
mingkee said:
I only get 50k.
Click to expand...
Click to collapse
Remember this benchmark runs better when phone is cold, Can you share some screenshots?
That's pretty low, as the note 4 with the right rom will do 52,000, anyone have a quadrant score to report? One stock and maybe one with xposed installed?
Got about 52,800. I didn't expect this phone to perform. It works fantastic in day-to-day use. I don't 3D game. Can't ask for much more from it (except more battery life - but removable battery is its saving grace).
Nitemare3219 said:
Got about 52,800. I didn't expect this phone to perform. It works fantastic in day-to-day use. I don't 3D game. Can't ask for much more from it (except more battery life - but removable battery is its saving grace).
Click to expand...
Click to collapse
For a 6 cores phone basically 2 high performance cores, these results are not bad, im coming from a Note 4 with Exynos Octa Core, this phone is much smoother, also after rooting and freezing some apps with Titanium Backup, I was able to get 27 hours and 4+ SOT, I say, once developers gets their hand on this phone, it only will get better :fingers-crossed:
Amd4life said:
That's pretty low, as the note 4 with the right rom will do 52,000, anyone have a quadrant score to report? One stock and maybe one with xposed installed?
Click to expand...
Click to collapse
---------- Post added at 09:48 PM ---------- Previous post was at 09:46 PM ----------
yoniinfante said:
Remember this benchmark runs better when phone is cold, Can you share some screenshots?
Click to expand...
Click to collapse
Yikes those scores are low. The s6 edge smokes this thing with 70k plus antutu scores.
marvi0 said:
Yikes those scores are low. The s6 edge smokes this thing with 70k plus antutu scores.
Click to expand...
Click to collapse
Congrats man, you want a cookie?
yoniinfante said:
Remember this benchmark runs better when phone is cold, Can you share some screenshots?
Click to expand...
Click to collapse
Why don't you run a successive antutu a second and then a third time back to back and post the scores.
Nobody runs a phone cold, its already warm and then they want to do more stuff.
Lets see how this thing does.
An 808 should not drop below 45k. The 810 throttles much more.
One Twelve said:
Why don't you run a successive antutu a second and then a third time back to back and post the scores.
Nobody runs a phone cold, its already warm and then they want to do more stuff.
Lets see how this thing does.
An 808 should not drop below 45k. The 810 throttles much more.
Click to expand...
Click to collapse
Im not getting 45k..and i didnt mean to run the benchmark inside a freezer!!!
yoniinfante said:
Im not getting 45k..and i didnt mean to run the benchmark inside a freezer!!!
Click to expand...
Click to collapse
Not on the first run, what about the third ?
New update out, I received it with OTA.
Changlelog : -System performance optimization
- Bug fixes
I hope low scores in benchmarks have been fixed for everyone and it seems that GBOARD keyboard isn't laggy anymore !
Croatian language added in new update
Poslano sa mog Mi MIX 2S koristeći Tapatalk
I still got 170K on AnTuTu and about 3200 on 3dmark slingshot extreme... And I still feel some fps drops in PUBG Mobile (it don't happen on OnePlus 6).
Bryandu13 said:
New update out, I received it with OTA.
Changlelog : -System performance optimization
- But fixes
I hope low scores in benchmarks have been fixed for everyone and it seems that GBOARD keyboard isn't laggy anymore !
Click to expand...
Click to collapse
Here's the download link:
http://bigota.d.miui.com/V9.5.20.0.ODGMIFA/miui_MIMIX2SGlobal_V9.5.20.0.ODGMIFA_87e657be32_8.0.zip
Bryandu13 said:
I still got 170K on AnTuTu an about 3200 on 3dmark slingshot extreme... And I still feel some fps drops in PUBG Mobile (it don't happen on OnePlus 6).
Click to expand...
Click to collapse
My AnTuTu-Score is 187k
MainderX said:
Here's the download link:
http://bigota.d.miui.com/V9.5.20.0.ODGMIFA/miui_MIMIX2SGlobal_V9.5.20.0.ODGMIFA_87e657be32_8.0.zip
My AnTuTu-Score is 187k
Click to expand...
Click to collapse
For me its 270k, which is normal for the cpu I guess. But weird that you guys have these smaller scores.
Thanks, I requested the update via de OTA updater and it is downloading now.
Bryandu13 said:
I still got 170K on AnTuTu an about 3200 on 3dmark slingshot extreme... And I still feel some fps drops in PUBG Mobile (it don't happen on OnePlus 6).
Click to expand...
Click to collapse
That's odd because I read an article on XDA yesterday about frame drops on the One Plus 6. Not a user post--an article by someone with programming knowledge who talked about the poor EAS implementation on the OnePlus 6. But he also specifically mentioned the frame drops on that phone.
9.5.20.0 is still MIUI 9 or MIUI 10?
ody.zady said:
9.5.20.0 is still MIUI 9 or MIUI 10?
Click to expand...
Click to collapse
9.5.20.0
Need to flash this using TWRP if unlocked XA version? Edit : TWRP worked.
Bryandu13 said:
New update out, I received it with OTA.
Changlelog : -System performance optimization
- But fixes
I hope low scores in benchmarks have been fixed for everyone and it seems that GBOARD keyboard isn't laggy anymore !
Click to expand...
Click to collapse
- But fixes
Haha sorry I couldn't resist
How's battery holding up with this update?
vinnik said:
For me its 270k, which is normal for the cpu I guess. But weird that you guys have these smaller scores.
Click to expand...
Click to collapse
Same "issue" was reported by ppl when update from .4 to .19. The solution is to wipe all data. Probably it will work again this time.
I did not get this update until now.
Bill Power said:
Same "issue" was reported by ppl when update from .4 to .19. The solution is to wipe all data. Probably it will work again this time.
I did not get this update until now.
Click to expand...
Click to collapse
I did the wipe when I was on .19 and benchmarks scores was normal first day and fall again to 2016 flagships scores.
Bryandu13 said:
I did the wipe when I was on .19 and benchmarks scores was normal first day and fall again to 2016 flagships scores.
Click to expand...
Click to collapse
This is a good thing to know because with this information you gave we can be almost certain that it is something with the benchmark program and the ROM. Probably after the first uses something messes up and you will have to keep wiping in order to maitain the scores.
Can anyone confirm that hidden folders in the gallery will be deleted with the Update? I lost one folder...
i have bad perfomance and low score in all benchmarks with 9.5.20.0 global estable i did hard reset and works good one or two day and broken perfomance again, this is a fking ****
broken performance on a SD845 ???
This is just ridiculous!
If you bought this phone just to show your friends who has the highest score...well you´re screwed.
But you can change that....try Miui 10 latest global stable BETA....nothing changes if you ask me as a user...but your eyes will pop out seeing 260tsd+ scores.
Kids... deactivate animation and run useless AnTuTu, than you will get your useless score.