Seeking Feedback On Better Visualizing Benchmark Results
Written by Michael Larabel in Phoronix on 27 May 2014 at 09:30 PM EDT. 25 Comments
Phoronix
In preparation for next week's 50+ way Linux graphics comparison, I am working on some visualization improvements to better represent data from this vast assortment of graphics cards... Thus, your feedback is kindly appreciated.

With the ten year anniversary of the Phoronix.com coming up on 5 June and the six year anniversary of the Phoronix Test Suite 1.0 release I am working on putting out the 5.2-Khanino release plus a lot of interesting benchmarks. As a result, for better visualizing the vast amount of data, I'm working on some Phoronix Test Suite graph rendering enhancements.

The most prominent change with the upcoming 5.2 release and will impact the upcoming 50-way results is the graphs when rendering the frame latency/timing... Now there's box plots turned on.


Some preliminary data from the upcoming comparison...


Now when viewing results from a number of test runs when it comes to comparisons, it's rendered to a box plot. Thus expressed is the minimum frame time, maximum frame time, first and third quartile frame time, and the median frame time quite easily... With the text descriptors is also the minimum, average, and maximum frame times for each run. Up to now when rendering results from many test runs it would just condense down into a bar chart with the average result.


With both the old and new code, when having a minimal number of runs, it will render the frame timings out to a line graph for best representation, e.g:


If anyone has any feedback for better representing the data, making it more useful, etc, it's much appreciated. Or for anyone that has any other visual feedback or other features for the traditional result graphs, that too is appreciated:


Simple feedback, new mock-ups, or code patches are welcome for everyone's benefit. The code is on GitHub for anyone wishing to optimize the pts_Graph display code.

Aside from these result display improvements, Phoronix Test Suite 5.2 when released next week also has built-in Phoromatic Server capabilities, improved line graphs, various other enhancements, and a few bug-fixes.

Update: Some improvements.

About The Author
Author picture

Michael Larabel is the principal author of Phoronix.com and founded the web-site in 2004 with a focus on enriching the Linux hardware experience and being the largest web-site devoted to Linux hardware reviews, particularly for products relevant to Linux gamers and enthusiasts but also commonly reviewing servers/workstations and embedded Linux devices. Michael has written more than 10,000 articles covering the state of Linux hardware support, Linux performance, graphics hardware drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org automated testing software. He can be followed via Twitter or contacted via MichaelLarabel.com.

Related Phoronix News
Popular News
Trending Reviews & Featured Articles