1. Computers
  2. Display Drivers
  3. Graphics Cards
  4. Memory
  5. Motherboards
  6. Processors
  7. Software
  8. Storage
  9. Operating Systems


Facebook RSS Twitter Twitter Google Plus


Phoronix Test Suite

OpenBenchmarking Benchmarking Platform
Phoromatic Test Orchestration

Seeking Feedback On Better Visualizing Benchmark Results

Phoronix

Published on 27 May 2014 09:30 PM EDT
Written by Michael Larabel in Phoronix
25 Comments

In preparation for next week's 50+ way Linux graphics comparison, I am working on some visualization improvements to better represent data from this vast assortment of graphics cards... Thus, your feedback is kindly appreciated.

With the ten year anniversary of the Phoronix.com coming up on 5 June and the six year anniversary of the Phoronix Test Suite 1.0 release I am working on putting out the 5.2-Khanino release plus a lot of interesting benchmarks. As a result, for better visualizing the vast amount of data, I'm working on some Phoronix Test Suite graph rendering enhancements.

The most prominent change with the upcoming 5.2 release and will impact the upcoming 50-way results is the graphs when rendering the frame latency/timing... Now there's box plots turned on.

Seeking Feedback On Better Visualizing Benchmark Results
Some preliminary data from the upcoming comparison...


Now when viewing results from a number of test runs when it comes to comparisons, it's rendered to a box plot. Thus expressed is the minimum frame time, maximum frame time, first and third quartile frame time, and the median frame time quite easily... With the text descriptors is also the minimum, average, and maximum frame times for each run. Up to now when rendering results from many test runs it would just condense down into a bar chart with the average result.

Seeking Feedback On Better Visualizing Benchmark Results


With both the old and new code, when having a minimal number of runs, it will render the frame timings out to a line graph for best representation, e.g:

Seeking Feedback On Better Visualizing Benchmark Results


If anyone has any feedback for better representing the data, making it more useful, etc, it's much appreciated. Or for anyone that has any other visual feedback or other features for the traditional result graphs, that too is appreciated:

Seeking Feedback On Better Visualizing Benchmark Results


Simple feedback, new mock-ups, or code patches are welcome for everyone's benefit. The code is on GitHub for anyone wishing to optimize the pts_Graph display code.

Aside from these result display improvements, Phoronix Test Suite 5.2 when released next week also has built-in Phoromatic Server capabilities, improved line graphs, various other enhancements, and a few bug-fixes.

Update: Some improvements.

Seeking Feedback On Better Visualizing Benchmark Results


About The Author
Michael Larabel is the principal author of Phoronix.com and founded the web-site in 2004 with a focus on enriching the Linux hardware experience and being the largest web-site devoted to Linux hardware reviews, particularly for products relevant to Linux gamers and enthusiasts but also commonly reviewing servers/workstations and embedded Linux devices. Michael has written more than 10,000 articles covering the state of Linux hardware support, Linux performance, graphics hardware drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org automated testing software. He can be followed via and or contacted via .
Latest Articles & Reviews
  1. Radeon Linux Benchmarks: Catalyst 15.3 Beta vs. Linux 4.0 + Mesa 10.6-devel
  2. Trying Out The Modern Linux Desktops With 4 Monitors + AMD/NVIDIA Graphics
  3. Turning A Basement Into A Big Linux Server Room
  4. NVIDIA's $1000+ GeForce GTX TITAN X Delivers Maximum Linux Performance
  5. OS X 10.10 vs. Ubuntu 15.04 vs. Fedora 21 Tests: Linux Sweeps The Board
  6. The New Place Where Linux Code Is Constantly Being Benchmarked
Latest Linux News
  1. Debian 8.0 Jessie Gets A Release Date
  2. Firefox 37 Coming Today With Heartbeat, HTTPS Bing
  3. OpenIndiana 2015.03 Updates Its Solaris/Illumos Environment
  4. GNOME 3.16 SDK Runtime Now Available
  5. Initial Intel Braxton Support Might Come To Linux 4.1
  6. Why KDE's KWin Doesn't Integrate Weston/QtCompositor For Wayland Support
  7. Clang Now Supports Targeting The NaCl OS
  8. PC-BSD Updates Its Lumina Desktop (v0.8.3)
  9. Fedora 22 Alpha Now Available For AArch64 & PowerPC64
  10. Systemd Developers Did NOT Fork The Linux Kernel
Most Viewed News This Week
  1. Introducing The Library Operating System For Linux
  2. The Big Features Of The Linux 4.0 Kernel
  3. Improved OpenCL Support For Blender's Cycles Renderer
  4. Open-Source Driver Fans Will Love NVIDIA's New OpenGL Demo
  5. Allwinner Continues Jerking Around The Open-Source Community
  6. GNOME 3.16 Released: It's Their Best Release Yet
  7. Ubuntu 15.04 Final Beta Released
  8. Systemd Change Allows For Stateless Systems With Tmpfs