Updates To OpenBenchmarking (Search & Comparisons)
For those using OpenBenchmarking.org, the web-based component to the Phoronix Test Suite that provides a centralized and collaborative platform for facilitating automated tests, result comparisons, test analysis, and a whole lot more, there's some enhancements that were pushed onto the public server this morning.
Much of the work comes down to changes you might not notice immediately as an end-user but there's lots of underlying improvements to yield better result analysis capabilities, more accurate search results, etc.
- Similar test results available for comparison when viewing a result file (e.g. a result file with the "Compare Test Results" on the left-hand side) should now be displayed much quicker and more accurately, especially for larger result sets. There's some new hashes at the result file level that are now used plus some intermediary caching to speed-up the process with there being hundreds of thousands of individual results to scan. Here's a larger test result example (courtesy of the guys at CloudHarmony; for those that haven't noticed, their public cloud benchmarking is powered mostly via the Phoronix Test Suite / OpenBenchmarking.org) where the matching results are now more easily detected.
- Continued refinements on the search code paths. For those using OpenBenchmarking.org search, if you still run into any "bogus" results of a hardware/software component not appearing correctly, please let us know via the forums. There's still further improvements and tweaking planned, but if anything is not appearing right, check with us to verify the data. With gigabytes of data flowing in from the community from all sorts of different platforms, it's a continued process of ensuring everything is valid and working accordingly.
- Faster processing throughout the site should be noticeable thanks to optimizing some hot code paths plus some caching enhancements.
- Continued work towards preparing a public OpenBenchmarking.org API for third-parties, but this is still likely several months out.
Still coming up in the next few days will be some more OpenBenchmarking.org commits with more of the search work, minor usability enhancements, potentially a new home-page with more useful features, better shopping-cart-like comparisons, and other to-be-announced items.
Coming out next week will also likely be a 4.0.1 point release to the recently-released Phoronix Test Suite 4.0-Suldal with a compile of minor enhancements and fixes.
For more of what's going on in this leading open-source benchmarking environment, see the recent Suldal Is Out; Randaberg & Unterschleissheim Are Next and Nearing Autonomous Linux Benchmark Selections postings.