[Q] Benchmarking whats really the point? - General Questions and Answers

I do not understand why people make a big deal about the benchmarks for. I mean does it really prove anything? For example the HTC sensation is rocking a. 1.2 processor and the atrix only a 1 but yet the atrix will smash the sensation on a benchnark. How, so I guess I'm just wondering
A. What does a benchmark prove?
B. Shouldn't a 1.2GHZ processor be faster than a 1GHZ
I mean the atrix opens apps and scrolls faster than the sensation. How could this be and are processors just a joke?

It does not prove anything.
The most common use of benchmarks is e-penis comparison.
It can be an indicator for somewhat improvements, but that is all quite relative and subjectiv.

Then what would show processor quality?

How good a processor is should be determined by its processing power, its heat production, size and power consumption.
There is no app for that.
For testing raw processing power and getting some numbers LINPACK is okay.

Dark3n said:
How good a processor is should be determined by its processing power, its heat production, size and power consumption.
There is no app for that.
For testing raw processing power and getting some numbers LINPACK is okay.
Click to expand...
Click to collapse
so 1.2 dual core or in my case 1.56 would'nt necessarily be faster at opening apps and loading pages than say a 1ghz? or is it that is has more stamina? so to speak

I am basically trying to get the answers i know people have questions to. especially more so now than ever since the development of dual core. also now that custom ROMS such as revolution HD are claiming faster processing speeds but yet there isn't an indefinite way to prove such claims. so far it seems to be up to the user and opinion.

rddocke said:
so 1.2 dual core or in my case 1.56 would'nt necessarily be faster at opening apps and loading pages than say a 1ghz? or is it that is has more stamina? so to speak
Click to expand...
Click to collapse
App opening speak is not only determined by CPU clock speed.
Cpu caches, memory, system buses.
Its a whole bunch of things that determine the "speed" of a device.

In my point of view android has not been fully optimized for dual core processing, and I expect to see an improvement with icecream or what ever comes after that. Also the processors build quality, reliability and productivity is very important. As for now its just a leech sucking on the battery.

DroidFreek said:
In my point of view android has not been fully optimized for dual core processing, and I expect to see an improvement with icecream or what ever comes after that. Also the processors build quality, reliability and productivity is very important. As for now its just a leech sucking on the battery.
Click to expand...
Click to collapse
Exactly what I was thinking. Long term effects are what count. Consistency is the most important it goes hand in hand with battery life.. stamina stamina stamina

Related

Just showin off a bit : )

So after reading nearly 5 hours and spending my time in the wee hours of morning, I finally did all the "stable" mods for the phone... If you haven't been reading, make sure you guys check out the stuff in the development forum.
After all modifications, I was able to get 2701 points in quadrant benchmark. What mods did I do?
-i9000 eclair flash (JM5)
http://forum.xda-developers.com/showthread.php?t=734871
-Alternative mimocans lag fix
(one click installer http://forum.xda-developers.com/showthread.php?t=749495)
-One click root (googled it for i9000)
-Overclock kernel 1.0Ghz to 1.2Ghz
(http://forum.xda-developers.com/showthread.php?t=746343)
This stuff really does help out your phone folks. Bench it now with quadrant, then take a peak at the other stuff and make magic happen. If anyone needs any additional help setting up their captivate, I'm more than happy to help.
I agree those fixes help speed a lot. But the quadrant score is meaningless. the speed hack creates an io loopback. The loopback just tells quadrant what it wants to hear.
Does your BT work on the european ROM. For me all people hear is a gargeled mess on there end?
Sent from my SAMSUNG-SGH-I897 using Tapatalk
Can you post the results of these tests:
Neocore
Linpack
CPU Benchmark
I keep hearing about this quadrant, does it actually improve real world performance? Or is just for the sake of scores?
jhego said:
I keep hearing about this quadrant, does it actually improve real world performance? Or is just for the sake of scores?
Click to expand...
Click to collapse
Quadrant is just benchmarking software that takes the cpu, gpu and memory read/write speeds into account. It runs a series of tests and spits a score number out at the end, so you can compare your device to others (like comparing boner sizes, but less gay).
It doesn't actually do anything to speed up the device though.
modest_mandroid said:
Quadrant is just benchmarking software that takes the cpu, gpu and memory read/write speeds into account. It runs a series of tests and spits a score number out at the end, so you can compare your device to others (like comparing boner sizes, but less gay).
It doesn't actually do anything to speed up the device though.
Click to expand...
Click to collapse
This is correct and to be honest there is way to much weight in the I/O tests. That is the only reason that the stock Droid X bests the Gal X. It has more weight than cpu and gpu so you can't put to much into those scores. They really don't mean anything more than bragging rights. What I am interested in is real world usage.
Real world use with the hack provides amazing speed gains opening and switching apps. Io heavy apps are very much improved while open too. It's finally as fast as the iphone.
Whats your battery life like after the overclock?
The score ended up getting lower and lower every time i used quadrant. 2701 is the highest I was able to get so far, but that's with a fresh install of the rom and all the stuff before I started loading on apps. Everytime I ran the benchmark, I of course killed the apps beforehand.
The battery life is the same- to be honest. This is me comparing a rooted stock ROM to the somewhat fresh install of the eclair i9000. The phone is very snappy. I came from an iPhone 4 and one of the biggest eye sores to me was the less-fluidness of changing programs, response to buttons (homescreen-back button) and pinch to zoom. After all these changes, it's a whole different story. Browsing is very appealing, especially since pinch to zoom isn't jagged or slow. The smoothness of this functionality is on par to an iPhone. And there is no waiting when I press the home button or back button.
True, maybe these numbers aren't considerably accurate (as far as the lag fix and EXT2) but at least it shows raw computing capability in it's current state... meaning, the usage of a virtual EXT2. Never the less, the phone is still all around faster, even if it isn't exactly the proper way of going about it.
The only problem I've seen so far is that it likes to randomly shut off. Won't respond to anything unless if I soft reset it. I haven't really found what causes it, since the consistency of it happening goes about in a non set pattern.
I didn't see any real world increase .. so I reverted back in about 4 hours.... I'd rather have the memory than a number that don't transfer to real world speeds...

Overclocking difference

I use the phone overclocked and non overclock and i cant seem to notice a difference at all in the phones preformance. At stock speeds it is just as fast as overclocked. There doesnt seem any difference in noticable speed of overclocking to me. Do any of you notice a difference.
i see a difference on some of the more laggy roms but it is small. think about it, the most you can see is a posible 20% at 1200mhz and with cpu scaling it isn't that often it usses 1200. although that is significant you still have the same memory bandwidth and file read/write speeds. the responsiveness difference in the kernel has more to do with available ram and kernel hz. as well as aggressiveness in cpu throttling.
overclocking is more for benchmarks and bragging rights. it's for those that need to tweak and whatever or those that need to say theres is better. i can turn the phone down to 600mhz on the old 2.1 kernels that had that step added in before i could notice and it still wasnt laggy much beyond the normal touchwiz. even 400 was usable.
now if the phone is older and the os and apps push the boundries of its capabilities by all means overclock to keep up with the times. otherwise it is preference for your own personal reasons. i do it to test what the phone is capable of. but i often have it disabled.
there is power locked away in these phones that we havent seen yet, the 3d processor can run opengl at framerates better than older laptops i have used and after all these months no other manufacturer has felt the need to compete with it. some open gl benchmarks are fully twice as high as a droid 2/x and 20% better than the newest htc phones running qualcom chips and even the motorolas are considered to have a power gpu. it is a great gaming platform as is and the gpu is stable at 11% overclock, some phones at 25% overclock and maybe beyond. if you flash a custom rom that doesnt lag and do the whole ext4 or jfs conversion you should be happy with the performance of the phone untill your contract is up and maybe beyond. the technology is accelerating faster than the software.
after honeycomb and dualcore platforms hit the shelves then the software that will take advantage of our hidden power will start to roll out. at this time too many android phones are running at 500-600 mhz with little opengl capability, even the popular 1ghz snapdragon phones like the evo as well as they benchmark cant run 3d applications very well and there popularity is holding up software devlopment is some way. there isnt much money in apps that only run on the top 5% of the phones out there. we will have to wait till the droid2/x galaxy s and g2 and mt4g are the norm and there are faster platforms available before we see great differences in overclocking. maybe honeycomb or whatever comes after that will use some opengl in the ui or something, who knows.
Dani897 said:
i see a difference on some of the more laggy roms but it is small. think about it, the most you can see is a posible 20% at 1200mhz and with cpu scaling it isn't that often it usses 1200. although that is significant you still have the same memory bandwidth and file read/write speeds. the responsiveness difference in the kernel has more to do with available ram and kernel hz. as well as aggressiveness in cpu throttling.
overclocking is more for benchmarks and bragging rights. it's for those that need to tweak and whatever or those that need to say theres is better. i can turn the phone down to 600mhz on the old 2.1 kernels that had that step added in before i could notice and it still wasnt laggy much beyond the normal touchwiz. even 400 was usable.
now if the phone is older and the os and apps push the boundries of its capabilities by all means overclock to keep up with the times. otherwise it is preference for your own personal reasons. i do it to test what the phone is capable of. but i often have it disabled.
there is power locked away in these phones that we havent seen yet, the 3d processor can run opengl at framerates better than older laptops i have used and after all these months no other manufacturer has felt the need to compete with it. some open gl benchmarks are fully twice as high as a droid 2/x and 20% better than the newest htc phones running qualcom chips and even the motorolas are considered to have a power gpu. it is a great gaming platform as is and the gpu is stable at 11% overclock, some phones at 25% overclock and maybe beyond. if you flash a custom rom that doesnt lag and do the whole ext4 or jfs conversion you should be happy with the performance of the phone untill your contract is up and maybe beyond. the technology is accelerating faster than the software.
after honeycomb and dualcore platforms hit the shelves then the software that will take advantage of our hidden power will start to roll out. at this time too many android phones are running at 500-600 mhz with little opengl capability, even the popular 1ghz snapdragon phones like the evo as well as they benchmark cant run 3d applications very well and there popularity is holding up software devlopment is some way. there isnt much money in apps that only run on the top 5% of the phones out there. we will have to wait till the droid2/x galaxy s and g2 and mt4g are the norm and there are faster platforms available before we see great differences in overclocking. maybe honeycomb or whatever comes after that will use some opengl in the ui or something, who knows.
Click to expand...
Click to collapse
agreed
overclocking seems pretty pointless at this point other than bragging rights
the only situation i can see it being handy are game emulators
Don't forget HQ flash streams on the browser, like some on justin.tv. My personal experience was that at 1 ghz it was a little bit choppy, and according to the rom as well, somewhere between 1.2 and 1.4 it becomes really smooth. Though if I used skyfire to watch it is smooth at stock speed, but some quality is lost in the optimization.
Am I the only one that thinks there is a difference at this? I also think the performance on heavy flash web pages improves when I use oc.
I have not seen any real difference in other than flash performance though... But I was kind of expecting this since in my desktop I had to use oc for it to work smoother as well.

[Q] Battery Life - dual core vs single core

Hi,
Does anyone know if there will be any perceivable difference in battery life between the latest batch of smartphones based on single core 45nm SoCs and the new 45 nm dual core versions.
All manufacturers state state improved performance AND lower power consumption with the dual cores, but I am wondering how this will affect my day-to-day battery life. I actually read somewhere that e.g. Tegra 2 phones may drain the battery quicker instead of saving power.
I was planning to buy the Desire Z or Galaxy S, but I may also wait for their upgrades if this will mean better battery life. I am not too eager about the performance improvements as I am not a gamer and will likely not feel the benefits (I mostly browse 3G or WiFi/use GPS/occasionally may play a movie + a couple of calls a day).
I'm expecting the battery life to be a bit low seeing that they have a "lot" of things in them.... I reckon it maybe the same as current smartphones?
Apparently battery times will be better, let´s see...
what i have learned that dual cores will save energy. (well atleast tegra 2) that soc has sth like 7 different cores if i remember right, each and every one of them made for a specific purpose (audio play/ video encode/ decode/ gpu....a nd other things i dont remember) so the soc it self will use only what YOU need at that very moment, lets say ur watching a vid, so only the video decode core will work whereas other should be in standby or sth.
(imo battery life should increase cuz of this, not sure how much tho)
and excuse me if my knoweledge isnt exatcly correct on this matter
There are two train of thoughts here:
1) as the die gets smaller (65nm[1st gen snaps] to 45nm[2nd gen snaps] to 40nm [tegra2] to 28nm[3rd gen snaps], etc), the processor tends to draw less energy. So yes, most dual cores (having a smaller die) SHOULD be more energy efficient.
2) With dual core, executions get carried out a lot faster than they were on single core. As evident by the benchmark done on dual cores (+2000 and up), it'll take less time to start/process a program and UI, in theory, should be a lot faster and smoother (that is if manufacturers don't start ****ing around with a UI and make it sluggish). Being that it's faster and a lot more versatile than single core, people will tend to youtube a lot, play games a lot, and generally use a lot more multimedia applications. Being that we don't have a self-sustaining energy source that isn't radioactive, the battery will drain from excessive use.
So at the end of the day, it depends on your use. Yes, dual cores are more energy efficient than single core, but in the hands of a 15yo teenage girl with more life than paris hilton, they probably get the same battery life as any other phone out there.
Hi guys,
thanks for the comments and predictions. My prediction would be that there would be hardly any noticeable change between the single & dual core 45 nm chips (given same usage of course), similar to how there was almost no change when switching from 65nm to 45nm chips - which are more energy efficient as well.
the better energy efficiency seems to be quickly soaked up by more power hungry hardware and software. so it all boils down to whether one needs the better performance as the battery life will likely stay the same.
But this of course is only a prediction based on past observation. I hope I am wrong and I am still considering if it is worth waiting for the dual core devices to hit the market. In the meantime if anyone has had a chance to play with such a device (tablet?), any additional info will be welcome

[Q] Can this be done? Cpu related

I read a lot of comments about the processor used by qualcomm being asymmetrical thus one core is doing the heavy lifting most of the time while the other is at a lower clock speed and it affects overall performance but enhances battery life. Now that this is a big factor on why the performance and benchmarks are lower than tegra and exynos because its running on one core most of the time.
NOW.... When we get s-off and are able to mess with the kernel, cpu speeds and such. Can there be the possibility where we can use a tool like setcpu to force both cores to run at the same clock speed always? This might level the playing field and show some drastic performance enhancements imo.
Theoretically... Is there a slightest chance something like this can be done? I suppose so since we can manipulate the cpu so easily with kernel access
Please input
nothing? lol
this might be harder than i thought...
mike21pr said:
nothing? lol
this might be harder than i thought...
Click to expand...
Click to collapse
I don't think gingerbread has the capability even if the kernel was modified.
We can only wait and see
IMHO, with proper kernel, system will manage cores better and there will not be any lag. Asymmetrical core scaling will yield much better battery life then symmetrical one, just need better implementation.

[Q] Stock ROM much faster processor speeds than custom ROMs?

I'm struggling to get my head around this drastic difference in speed.
Stock ROM on linpack scores about 100Mflops on single thread, and 200Mflops on multi thread similar to this video at 2:50 http://www.youtube.com/watch?v=Zh5quKyypw8
However since flashing CM10 my linpack scores have more than halved! I never get over 80Mflops now on multi thread, and rarely over 40Mflops on single thread. Also in quadrant it shows my cpu scoring really low, but my RAM scoring very high. I was wondering if my the ROMs are effecting my processor speeds?
I am about to go back to the stock ROM to see if linpack scores shoot back up!
If you don't notice a difference who cares about benchmark scores?
Sent from my HTC VLE_U using xda app-developers app
Well I do agree with what you are saying, and it still seems very fast. But I used it for less than a day on the stock ROM, so I don't really have anything to compare it to.
I am wondering more if these benchmarks are giving false readings, or if they are actually picking up on some poor processor optimisations, which whilst may not be noticeable day to day, could have a greater impact on CPU hungry tasks such as making and restoring large backups etc.
But benchmarks for the sake of benchmarks I agree are pointless.
RichardW1992 said:
Well I do agree with what you are saying, and it still seems very fast. But I used it for less than a day on the stock ROM, so I don't really have anything to compare it to.
I am wondering more if these benchmarks are giving false readings, or if they are actually picking up on some poor processor optimisations, which whilst may not be noticeable day to day, could have a greater impact on CPU hungry tasks such as making and restoring large backups etc.
But benchmarks for the sake of benchmarks I agree are pointless.
Click to expand...
Click to collapse
I pretty much stopped using custom roms that aren't based on official sense based roms because of low benchmark numbers, questionable battery life and terrible camera support.
HTC has most if not all drivers for the hardware closed source, so developers are trying their best but I just use the stock ROM
RichardW1992 said:
Well I do agree with what you are saying, and it still seems very fast. But I used it for less than a day on the stock ROM, so I don't really have anything to compare it to.
I am wondering more if these benchmarks are giving false readings, or if they are actually picking up on some poor processor optimisations, which whilst may not be noticeable day to day, could have a greater impact on CPU hungry tasks such as making and restoring large backups etc.
But benchmarks for the sake of benchmarks I agree are pointless.
Click to expand...
Click to collapse
Your not getting false readings... That's just how it is.. Bench marks don't mean anything... Cm will always have a lower score than stock but is just as fast.. If your worried about scores flash a ROM based on sense ota...
Sent from my HTC One S using xda premium

Categories

Resources