Opening The Gates To Our Daily Open-Source Linux Benchmark Results

For a few months now I've been talking about the LinuxBenchmarking.com initiative to provide daily benchmark results of the latest development Git/SVN code for various open-source projects in a fully-automated manner... Among the projects being tracked have been the Linux kernel, GCC, LLVM Clang, etc. There's dozens of systems at Phoronix Media in "the basement server room" doing nothing but running these upstream benchmarks day in and day out. The data flow is now open at LinuxBenchmarking.com.

See the original LinuxBenchmarking.com information page for more details and background information; this work has been a long time coming in working towards this publicly viewable instance. This test infrastructure is powered entirely by the latest Phoronix Test Suite and Phoromatic code in conjunction with OpenBenchmarking.org. It's taken a few months to open up this data stream since it's taken quite a while building out all of the systems and giving them time to assemble sufficient test data. Plus I had to write an exporter for Phoromatic to send its results from our internal Phoromatic Server and off onto LinuxBenchmarking.com along with assembling a basic, read-only result viewer. That's now done and is part of Phoronix-Test-Suite on GitHub.

Turning A Basement Into A Big Linux Server Room + The New Linux Performance Test Lab Is Already Being Expanded

There's no big jaw droppers out of the results viewable today on LinuxBenchmarking.com, which are the trackers for GCC, LLVM Clang, the mainline kernel, Fedora's Rawhide kernel, and the latest open-source Linux graphics drivers. Over the past few months there's been some downtime when transitioning to the new server room, re-configuring a few of the systems, taking care of some early thermal problems, and making other changes. Some schedules and some of the contained tests were added late to the game. So in terms of finding any huge regressions today, you probably won't be able to mine anything right now, but moving forward to Q2'2015 the data should get much more interesting and there's plans to add even more systems and additional trackers too (there's been experiments with Arch and other configurations). All of the infrastructure though is now in place to keep rolling with all of this automated testing that's fully streamlined from start-to-finish via the Phoronix Test Suite and Phoromatic.

Part of the full Phoromatic experience when deploying it via the Phoronix Test Suite.

For any open-source projects wishing to get test coverage, please contact us. For organizations and commercial entities wishing to deploy the Phoronix Test Suite / Phoromatic or are in need of commercial support, custom engineering services, or other offerings, please contact us for further information. For the community wishing to get involved or if you'd like to add any features to the result viewer, etc, the code is available via Phoronix-Test-Suite on GitHub and contributions are welcome. In terms of anyone wanting to improve the results viewer with the data exposed at LinuxBenchmarking.com, it's very easy to get started and specifically that code is here. This viewer complements the full-blown Phoromatic Server that offers already immense options for enterprise users and those deploying their own instance. If you're new to the Phoronix Test Suite, you should read about Reasons To Make A Test Profile For Your Software.

Expect more improvements and other changes in the days ahead leading up to the official release of Phoronix Test Suite 5.8 in the next few weeks. If you'd like to support the work done by Phoronix Media on enriching the Linux hardware experience and advancing open-source benchmarking, consider subscribing to Phoronix Premium or making a PayPal tip (if you prefer Bitcoin, 1HefBsdstoALrbV3a3cLsVv5b5YLPLLvWn). In fact, 100% of any tips/donations received between now and 5 June (Phoronix's 11th birthday!) will be used for buying additional systems to dedicate to the LinuxBenchmarking.com farm for this automated open-source performance monitoring. With all of that said, go checkout LinuxBenchmarking.com and be sure to share your feedback and suggestions.