Seeking Feedback On Better Visualizing Benchmark Results
Phoronix: Seeking Feedback On Better Visualizing Benchmark Results
In preparation for next week's 50+ way Linux graphics comparison, I am working on some visualization improvements to better represent data from this vast assortment of graphics cards... Thus, your feedback is kindly appreciated...
Looks nice. The new chart is visually pleasing.
I've been wanting to see box plots for like forever. Ping on the pull request.
Holy shit are there some outliers in those boxplots (I'm looking at you Intel Graphics 4600). I think what will be more helpful than the whiskers being the min and max value, is for them whiskers to be the 10th and 90th percentiles and plotting the other points as outliers, which is probably what those far out points are based on the size of the IQR. See: http://en.wikipedia.org/wiki/File:Bo...ilsabstand.png
That way, I can say, 80% of the time I'm going to get these frame rates.
I've never played with PHP and friends, so what I'm going to suggest might be impossible since I'm not aware of their limitations. Ability to change transparency/opacity of every line graph independently can be really helpful, so you can easily compare the line graphs overlapping with each other and extract more information.
Whenever the user clicks on colored boxes or labels, a new balloon pops up and allows to change opacity value through the slider. Here is a quick and dirty mock-up:
If you really want to improve the visualizations, why not make it interactive? Like these charts http://www.highcharts.com/ (sorry for the free ad, it's the closest example I've found on a quick search). You could display additional information on hover (like min/max FPS). In addition, it would be easier to find out what-is-what in benchmarks like power consumption, where results are so close you can't even distinguish lines, you could hover through the ctested cases and the correspondan line graph would have focus over the rest.
The downside is you could no longer use images for this, of course. You would have no problem on Phoronix, for anonimous benchmarks you could use a frame or give the code in the PTS results.
Originally Posted by siavashserver
A few things that could be improved:
- In the total frame time chart, you could align the min/max/avg figures across all the cards and drop the 'Min:', 'Max:' and 'Avg:' labels. It will be easier to read and cleaner too. It would be event better if the min/max/avg figures were colour coded, i.e. red for the min figure and green for the max.
- Entries for cards from different vendors could be coloured according to their branding colours.
- The text at the top, such as 'Milliseconds, Less is Better' is heavily blurred and barely readable. Consider increasing the font size or using a different font that works well at small sizes. Fonts without AA (such as Dina) generally work well at small sizes.
- Consider sorting the list based on performance.
- It would be great if the graphs were interactive and supported stable sorting based on multiple criteria.
For most browsers already when serving OpenBenchmarking.org graphs it is served as SVG and with that is tooltips and other information that makes it a bit more interactive... But for really like rich interactivity, that's all bottlenecked by my time or the lack of code contributions by others. It's rather easy to add by anyone that has the time. Within this particular image, they were just JPEG image screenshots as I haven't uploaded the latest code to OpenBenchmarking.org for dynamic embedded purposes.
Originally Posted by alazar
1. rather trivial change... patches welcome.
Originally Posted by xslr
2. again, not too much of a big change, and is an easy change for new comers.
3. for the purposes of this article it was just JPEG screenshots rather than SVG graphs as served by most articles, until the new code is live on OpenBenchmarking.org.
4. for this article they were intentionally unsorted as the actual interesting data will be shared next week when it's all complete.
5. see my other notes in this thread and other contributions are welcome....
Or make it so when you hover over a box, it dims the rest of the plots.
Originally Posted by siavashserver