1. Computers
  2. Display Drivers
  3. Graphics Cards
  4. Memory
  5. Motherboards
  6. Processors
  7. Software
  8. Storage
  9. Operating Systems


Facebook RSS Twitter Twitter Google Plus


Phoronix Test Suite

OpenBenchmarking.org

The New Linux Hardware, Software Playground

Phoronix

Published on 24 October 2011 04:45 PM EDT
Written by Michael Larabel in Phoronix
14 Comments

Here's some new features and other upcoming work that may excite Linux enthusiasts in the Phoronix software/hardware playground.

Over at openbenchmarking.org/linux I have been experimenting with some improvements to OpenBenchmarking.org for the past few weeks. What's shown at the user-interface level is quite simple: it's serving as just a directory of Linux hardware (right now the public version just shows motherboards and processors, but the graphics card category will be enabled next). It's similar to the OpenBenchmarking.org Performance Index where it lists all detected hardware components of a certain type, as it discovers new hardware from the crowd-sourced benchmarking process. From there you can explore the product, find benchmark results, etc.

The openbenchmarking.org/linux hardware directory takes advantage of some new code-paths in determining hardware model numbers, product series, etc. Of course, it's all automated and self-learning. Once complete, it will be folded back into the main OpenBenchmarking.org area to provide greater search and hardware indexing capabilities.

The New Linux Hardware, Software Playground


There are some visible differences though when reaching a product page. For example, the ASUS Crosshair IV Formula motherboard. Some of the new information exposed from my "experimental playground" that's not currently shown from the main OpenBenchmarking.org web-site when conducting a similar motherboard search is showing comparable motherboards (on the basis of the motherboard chipset and other matching PCI devices), a cleaner appearance for the Linux distributions where the given product has been tested, and some of the detected on-board devices.

The New Linux Hardware, Software Playground


Users can subsequently click on one of the detected integrated devices (e.g. a motherboard's USB controller), which will then reveal the Linux distributions where that specific ASIC has been used, other motherboards also using the given ASIC, and the detected Linux driver(s) for that particular component.

The New Linux Hardware, Software Playground


The lspci information and example dmesg outputs for the given controller/device is also available from this page. It's all automatically handled by OpenBenchmarking.org.

The New Linux Hardware, Software Playground


The CPU area also displays new information nicely. Comparable CPUs (in terms of performance by compositing all of the Phoronix Test Suite results for each processor) are shown and there's also more detailed CPU information: the CPU core/thread counts, L2 cache size, special instruction sets (e.g. SSE4, SSE5, AVX, XOP, FMA4), whether AES encryption is supported on the hardware, if an Energy Performance Bias is supported, and the hardware virtualization method supported. Popular motherboards for the given CPU are also shown as well as what Linux distributions the CPU has been tested with. The /proc/cpuinfo is also available. Everything is generated automatically from the data that's captured by the Phoronix Test Suite when opting to submit the results and system hardware/software information to OpenBenchmarking.org. An example is the brand new AMD FX-8150 Bulldozer Eight-Core CPU.

This already offers up some more information beyond what's easily reachable from the main OpenBenchmarking.org search area right now, but it will all be integrated when the interfaces are settled. Besides playing around with these new features in the /linux area right now due to the features still being in-development, it's also separate from the main site right now to help me determine the external API requirements for OpenBenchmarking.org in finishing the public API for this trove of Linux hardware and software data.

The New Linux Hardware, Software Playground


Part of the next phase of the OpenBenchmarking.org conquest becomes even more interesting. With most people likely going to such a Linux hardware directory when shopping for new Linux hardware or experiencing a hardware functionality/performance issue, a new OpenBenchmarking.org component will be coming to provide greater assistance. When viewing a product (like the Intel Core i5 2500K), new information that will also be pulled in provide information on outstanding Linux bug-reports covering the hardware and/or the driver it uses. Important commits from the Linux kernel relevant to that product, with the corresponding version where the change was introduced, is also to be displayed.

This new capability will be turned on soon (as in perhaps this week, I'm just working on some more enhancements first), but for any graphics card, motherboard, CPU, PCI device, and hard drive (perhaps other components too) it will add in this extra information it finds about the product and/or device driver it utilizes. The BugZilla databases of popular Linux distributions and upstream software projects will be polled automatically by OpenBenchmarking.org, depending upon the type of hardware component. OpenBenchmarking.org will automatically attempt to find any relevant open bug reports, without displaying every single bug report, such as for issues that may be trivial or irrelevant to most users.

The Git repository of the Linux kernel is monitored as well using new OpenBenchmarking.org infrastructure in attempting to identify commits that implement new functionality for the given hardware/software, correct serious bugs, or other noteworthy changes. This can allow the user to see Linux version requirements or what they would need for an ideal level of support. Conquering mailing lists is next to offer similar functionality to this OpenBenchmarking.org smart crawling of Git repositories and bug reports. Monitoring the Git repositories of Mesa and the DDX drivers is also on my road-map to implement, which should be easy as well and coming shortly.

Having this bug/commit information correlated to hardware components isn't solely for the user's benefit with being able to see rough version requirements or how Linux support has matured for a given driver and piece of hardware. OpenBenchmarking.org and the Phoronix Test Suite are already well integrated and designed to be extremely extensible and all interfaces abstracted. When pairing that architecture with already existing features like being able to automatically find regressions within code-bases (such as the Linux kernel, or the Phoronix Test Suite can be used for actively monitoring for regressions as is used by CodeWeavers/Wine.) and even changes in power consumption and other functional areas, new opportunities arise. This new data from parsing bug reports and commit histories can likely be used for speeding up the auto-bisecting process.

There's already hundreds of thousands of test runs and over one million component configurations that's recorded by OpenBenchmarking.org, and when pairing this growing data-set with these other pools of information (Git, BugZilla, mailing lists), I'm also hoping OpenBenchmarking.org will be able to organically narrow down bugs based upon detected test result differences and how the hardware/software combinations vary with their matching issues. Since the Phoronix Test Suite / OpenBenchmarking.org captures the dmesg, xorg.conf, and other important system information, this should be quite feasible in the very near future. On the opposite side, it's also working to providing auto-recommended optimization strategies for users.

This also comes in to play with another long-standing OpenBenchmarking.org action item I've had of basically the crowd-source benchmarking (in a faintly similar manner to how Folding@HOME works) where your system's excess compute time could be donated to a particular project to run functional/performance tests in an automated manner to help uncover regressions or other anomalies.

With OpenBenchmarking.org becoming more aware of how Git repositories relate to certain hardware/software components and smart parsing of mailing lists, another item on my TODO list is support in the soon-to-be-done Phoromatic-on-OpenBenchmarking.org-implementation that would allow for the automated benchmarking of new patch-sets as they hit a mailing list. Rather than just running Phoromatic on a timed basis or per code commit, Phoromatic could support monitoring any mailing lists and then via the Phoromatic account hooks set to apply the patch(es) to a code-base and then run a given set of test profiles/suites. Regressions could be caught sooner before they even hit the tree and are just going through initial code review.

Well, that's just some of what's coming up in the near future. Due to these new features and other upcoming work, as I mentioned on Twitter, I'm not ruling out the possibility that OpenBenchmarking.org could be pulling in even more traffic than Phoronix.com in 2012. I'm also aspiring to make creating a PTS/OpenBenchmarking.org test profile to illustrate a bug (whether it be performance related or not), one of the most valuable contributions an end-user can do to solve an issue. Phoronix Test Suite 4.0 will also be delivered in H2'2012 with more ground-breaking work, just not for Linux but any operating system.

Feedback and other thoughts are always welcome. I will also be at the Ubuntu Developer Summit next week in Orlando. I'll also be around Germany and Austria next month for any meetings.

About The Author
Michael Larabel is the principal author of Phoronix.com and founded the web-site in 2004 with a focus on enriching the Linux hardware experience and being the largest web-site devoted to Linux hardware reviews, particularly for products relevant to Linux gamers and enthusiasts but also commonly reviewing servers/workstations and embedded Linux devices. Michael has written more than 10,000 articles covering the state of Linux hardware support, Linux performance, graphics hardware drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org automated testing software. He can be followed via and or contacted via .
Latest Linux Hardware Reviews
  1. NVIDIA GeForce GTX 970 Offers Great Linux Performance
  2. CompuLab Intense-PC2: An Excellent, Fanless, Mini PC Powered By Intel's i7 Haswell
  3. From The Atom 330 To Haswell ULT: Intel Linux Performance Benchmarks
  4. AMD Radeon R9 285 Tonga Performance On Linux
Latest Linux Articles
  1. Ubuntu 14.10 XMir System Compositor Benchmarks
  2. Btrfs RAID HDD Testing On Ubuntu Linux 14.10
  3. Ubuntu 14.10 Linux 32-bit vs. 64-bit Performance
  4. AMD Moves Forward With Unified Linux Driver Strategy, New Kernel Driver
Latest Linux News
  1. GTK+ 3.16 To Bring Several New Features
  2. Debian 8.0 Jessie Has Many Multimedia Improvements
  3. What Linux Benchmarks Would You Like To See Next?
  4. Open-Source, Linux Support For Corsair Link Devices Slowly Materializing
  5. Cairo-Dock 3.4 Shows A Lot Of Progress, Works Toward EGL/Wayland Support
  6. Mesa 10.4 Tentatively Planned For Early December
  7. SteamOS Update 145 Brings Compositor, Update Fixes
  8. GStreamer 2014 Conference Videos Posted: Wayland, HTML5, 3D
  9. Nouveau Now Supports DRI3 Without GLAMOR
  10. Features Of The Linux 3.18 Kernel
Latest Forum Discussions
  1. Updated and Optimized Ubuntu Free Graphics Drivers
  2. Linux hacker compares Solaris kernel code:
  3. HOPE: The Ease Of Python With The Speed Of C++
  4. Users/Developers Threatening Fork Of Debian GNU/Linux
  5. Ubuntu 16.04 Might Be The Distribution's Last 32-Bit Release
  6. AMD Releases UVD Video Decode Support For R600 GPUs
  7. Proof that strlcpy is un-needed
  8. xbox one tv tuner