I think it would be cool to see a benchmarking deathmatch between different libc implementations:
Something like this:
(e)Glibc (dynamic) vs (e)Glibc (static) vs uclibc (static) vs dietlibc (static) vs bionic (metasploit port, static).
The Sta.li guys claim that static binaries are much faster. It would be nice to have some benchmarks on how big an influence different libc:s have on final performance sort of like how different compilers have been compared previously.
I'd like to see compositing window managers benchmarked whenever games are benchmarked too. I do not play games very often but I use the WM all the time, and the video drivers do affect it a lot, so a WM benchmark would be much more relevant to me.
I know at least kwin has a show_fps plugin and scripting support, so it shouldn't be hard to devise a benchmark for it. Not sure wether compiz and others have scripting support, or how you would create a benchmark without that.
I checked out OpenBenchmarking.org a couple of times before I posted my original comment. It has a bunch of data on the site but I have a hard time condensing it into useful information or purchasing recommendations, though I'm sure it makes prefect sense to the site developers. It's about time Linux had something like that.
I've been messing with Linux and the X Windows System since the days when you had to manually set modlines to get anything to work and, frankly, I'd just as soon have something that mostly "just works". I think the best cards I've ever used under Linux were the Matrox G200 and G400 cards....
It seems that every few years I do a bunch of research to try and find a solid video card under Linux, but I can never seem to find definitive answers.
Benchmarks alone do not take into account subjective issues like ease of install. I worry that if I buy based on benchmarks alone, I'll get blazingly fast hardware, but will have to compile a custom kernel and a few other packages to realize the performance. That's not so bad, but I've been down that path and recompiling the kernel and/or drivers every time there's a new kernel release just isn't worth the effort to me any more.
I was thinking thinking of something along the lines of StorageReview.com's Leader Board but with more than just performance, like Best for Stock Ubuntu, Best for Stock Fedora, etc and/or Best for Open Drivers, Best with ATI Driver and Best with NVidia Driver.
It's so easy to find good hardware for Windows (Go to Newegg and select Most Reviews in your price range) I think Linux users deserve a easier hardware selection process. I also think that the manufacturers that provide better Linux support should be rewarded for their effort.