Page 1 of 3 123 LastLast
Results 1 to 10 of 26

Thread: Seeking Feedback On Better Visualizing Benchmark Results

  1. #1
    Join Date
    Jan 2007
    Posts
    15,391

    Default Seeking Feedback On Better Visualizing Benchmark Results

    Phoronix: Seeking Feedback On Better Visualizing Benchmark Results

    In preparation for next week's 50+ way Linux graphics comparison, I am working on some visualization improvements to better represent data from this vast assortment of graphics cards... Thus, your feedback is kindly appreciated...

    http://www.phoronix.com/vr.php?view=MTcwMjY

  2. #2
    Join Date
    Jan 2010
    Location
    Somewhere in Kansas.
    Posts
    291

    Default

    Looks nice. The new chart is visually pleasing.

  3. #3
    Join Date
    May 2014
    Posts
    42

    Default

    I've been wanting to see box plots for like forever. Ping on the pull request.

    Holy shit are there some outliers in those boxplots (I'm looking at you Intel Graphics 4600). I think what will be more helpful than the whiskers being the min and max value, is for them whiskers to be the 10th and 90th percentiles and plotting the other points as outliers, which is probably what those far out points are based on the size of the IQR. See: http://en.wikipedia.org/wiki/File:Bo...ilsabstand.png

    That way, I can say, 80% of the time I'm going to get these frame rates.

  4. #4
    Join Date
    Oct 2013
    Posts
    198

    Default

    I've never played with PHP and friends, so what I'm going to suggest might be impossible since I'm not aware of their limitations. Ability to change transparency/opacity of every line graph independently can be really helpful, so you can easily compare the line graphs overlapping with each other and extract more information.

    Whenever the user clicks on colored boxes or labels, a new balloon pops up and allows to change opacity value through the slider. Here is a quick and dirty mock-up:

  5. #5
    Join Date
    Apr 2011
    Posts
    82

    Default

    If you really want to improve the visualizations, why not make it interactive? Like these charts http://www.highcharts.com/ (sorry for the free ad, it's the closest example I've found on a quick search). You could display additional information on hover (like min/max FPS). In addition, it would be easier to find out what-is-what in benchmarks like power consumption, where results are so close you can't even distinguish lines, you could hover through the ctested cases and the correspondan line graph would have focus over the rest.

    The downside is you could no longer use images for this, of course. You would have no problem on Phoronix, for anonimous benchmarks you could use a frame or give the code in the PTS results.

  6. #6

    Default

    Quote Originally Posted by siavashserver View Post
    I've never played with PHP and friends, so what I'm going to suggest might be impossible since I'm not aware of their limitations. Ability to change transparency/opacity of every line graph independently can be really helpful, so you can easily compare the line graphs overlapping with each other and extract more information.

    Whenever the user clicks on colored boxes or labels, a new balloon pops up and allows to change opacity value through the slider. Here is a quick and dirty mock-up:
    For nearly all browsers, the pts_Graph code renders out to SVG... It'd be possible, via JavaScript, to add customizations like what you mentioned but frankly it'd be low on my TODO List unless it was for a Phoronix Premium only feature.

  7. #7
    Join Date
    Jun 2012
    Posts
    1

    Default

    A few things that could be improved:
    1. In the total frame time chart, you could align the min/max/avg figures across all the cards and drop the 'Min:', 'Max:' and 'Avg:' labels. It will be easier to read and cleaner too. It would be event better if the min/max/avg figures were colour coded, i.e. red for the min figure and green for the max.
    2. Entries for cards from different vendors could be coloured according to their branding colours.
    3. The text at the top, such as 'Milliseconds, Less is Better' is heavily blurred and barely readable. Consider increasing the font size or using a different font that works well at small sizes. Fonts without AA (such as Dina) generally work well at small sizes.
    4. Consider sorting the list based on performance.
    5. It would be great if the graphs were interactive and supported stable sorting based on multiple criteria.

  8. #8

    Default

    Quote Originally Posted by alazar View Post
    If you really want to improve the visualizations, why not make it interactive? Like these charts http://www.highcharts.com/ (sorry for the free ad, it's the closest example I've found on a quick search). You could display additional information on hover (like min/max FPS). In addition, it would be easier to find out what-is-what in benchmarks like power consumption, where results are so close you can't even distinguish lines, you could hover through the ctested cases and the correspondan line graph would have focus over the rest.

    The downside is you could no longer use images for this, of course. You would have no problem on Phoronix, for anonimous benchmarks you could use a frame or give the code in the PTS results.
    For most browsers already when serving OpenBenchmarking.org graphs it is served as SVG and with that is tooltips and other information that makes it a bit more interactive... But for really like rich interactivity, that's all bottlenecked by my time or the lack of code contributions by others. It's rather easy to add by anyone that has the time. Within this particular image, they were just JPEG image screenshots as I haven't uploaded the latest code to OpenBenchmarking.org for dynamic embedded purposes.

  9. #9

    Default

    Quote Originally Posted by xslr View Post
    A few things that could be improved:
    1. In the total frame time chart, you could align the min/max/avg figures across all the cards and drop the 'Min:', 'Max:' and 'Avg:' labels. It will be easier to read and cleaner too. It would be event better if the min/max/avg figures were colour coded, i.e. red for the min figure and green for the max.
    2. Entries for cards from different vendors could be coloured according to their branding colours.
    3. The text at the top, such as 'Milliseconds, Less is Better' is heavily blurred and barely readable. Consider increasing the font size or using a different font that works well at small sizes. Fonts without AA (such as Dina) generally work well at small sizes.
    4. Consider sorting the list based on performance.
    5. It would be great if the graphs were interactive and supported stable sorting based on multiple criteria.
    1. rather trivial change... patches welcome.
    2. again, not too much of a big change, and is an easy change for new comers.
    3. for the purposes of this article it was just JPEG screenshots rather than SVG graphs as served by most articles, until the new code is live on OpenBenchmarking.org.
    4. for this article they were intentionally unsorted as the actual interesting data will be shared next week when it's all complete.
    5. see my other notes in this thread and other contributions are welcome....

  10. #10
    Join Date
    Mar 2014
    Posts
    29

    Default

    Quote Originally Posted by siavashserver View Post
    I've never played with PHP and friends, so what I'm going to suggest might be impossible since I'm not aware of their limitations. Ability to change transparency/opacity of every line graph independently can be really helpful, so you can easily compare the line graphs overlapping with each other and extract more information.

    Whenever the user clicks on colored boxes or labels, a new balloon pops up and allows to change opacity value through the slider. Here is a quick and dirty mock-up:
    Or make it so when you hover over a box, it dims the rest of the plots.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •