MeeGo Netbook Performance: It's Beating Ubuntu & Co
Phoronix: MeeGo Netbook Performance: It's Beating Ubuntu & Co
The last time we ran a performance comparison of different Linux distributions on netbooks was in late November when benchmarking Chromium OS, Moblin, Fedora, openSUSE, and Ubuntu Netbook Remix. The results were interesting, but now we have a new set of Linux distributions out there, so we have carried out a new comparison. In particular, we are looking closely at how the MeeGo distribution -- which marries Intel's Moblin and Nokia's Maemo projects -- is performing now that it has reached version 1.0. Also in the testing mix are Ubuntu Netbook Remix 10.04 LTS, Moblin 2.1, and Fedora 13.
Michael, I wonder how do you install distros for all the tests? Do you do disk images, automated installs, just click through manually, or something else?
Just go through the install process as any normal user would, while selecting all of the default options and doing clean installs that occupy the entire drive each time.
Originally Posted by curaga
How many times do you run each test?
Look at the Phoronix Test Suite source. It varies by test and the std variation between runs.
Originally Posted by crispy
Hi Michael. I'd like to suggest that you perform some Analysis of Variance to your results, because simply performing however many tests are required to get the standard deviation below a certain threshold is, unfortunately, useless.
Originally Posted by Michael
For example, what happens if you do two test runs which happen to produce almost the same average FPS? The PTS just blindly accepts that result as long as it is below the standard deviation threshold, despite the fact that the confidence in that result is totally unknown.
ANOVA would also allow calculation of confidence intervals which would give meaning to your results. For example, in the Blowfish benchmark, performance varies by only ~1.8% between the top performer MeeGo, and worst performer Moblin. I strongly suspect that this is not a statistically significant result however you "call" it for MeeGo.
I suppose Meego is optimized for Atom processors and that's why it won in encoding tests, right?
Very nice article! This comes at a great time since I'm in the process of testing several distros on my Eee PC to see which one works the best for me. 8 seconds boot time is just amazing!
Anyway, Apopas, moblin was also supposed to be optimized for atom cpus and it's performance is not so great. The guys behind meego are doing something right, that's for sure. This could be the distro that manages to outcast that awful windows 7 starter from netbooks.
Oh, I forgot something.
My only concern with meego is installing software. I know there is the garage, but I suppose it's software library is not as extensive as ubuntu's. Can we still install software from other sources? What about the package format it uses? I've seen these same questions on the meego forum but no straight answer.
What I'd really like to see in a future Phoronix article is a benchmark of the most popular (and new) lightweight linux distros.
Distros like Puppy, SliTaz, Zenwalk, TinyMe, Lubuntu and Quirky Linux.