Announcement

Collapse
No announcement yet.

Seeking Feedback On Better Visualizing Benchmark Results

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Seeking Feedback On Better Visualizing Benchmark Results

    Phoronix: Seeking Feedback On Better Visualizing Benchmark Results

    In preparation for next week's 50+ way Linux graphics comparison, I am working on some visualization improvements to better represent data from this vast assortment of graphics cards... Thus, your feedback is kindly appreciated...

    Phoronix, Linux Hardware Reviews, Linux hardware benchmarks, Linux server benchmarks, Linux benchmarking, Desktop Linux, Linux performance, Open Source graphics, Linux How To, Ubuntu benchmarks, Ubuntu hardware, Phoronix Test Suite

  • #2
    Looks nice. The new chart is visually pleasing.

    Comment


    • #3
      I've been wanting to see box plots for like forever. Ping on the pull request.

      Holy shit are there some outliers in those boxplots (I'm looking at you Intel Graphics 4600). I think what will be more helpful than the whiskers being the min and max value, is for them whiskers to be the 10th and 90th percentiles and plotting the other points as outliers, which is probably what those far out points are based on the size of the IQR. See: http://en.wikipedia.org/wiki/File:Bo...ilsabstand.png

      That way, I can say, 80% of the time I'm going to get these frame rates.

      Comment


      • #4
        If you really want to improve the visualizations, why not make it interactive? Like these charts http://www.highcharts.com/ (sorry for the free ad, it's the closest example I've found on a quick search). You could display additional information on hover (like min/max FPS). In addition, it would be easier to find out what-is-what in benchmarks like power consumption, where results are so close you can't even distinguish lines, you could hover through the ctested cases and the correspondan line graph would have focus over the rest.

        The downside is you could no longer use images for this, of course. You would have no problem on Phoronix, for anonimous benchmarks you could use a frame or give the code in the PTS results.

        Comment


        • #5
          Originally posted by siavashserver
          I've never played with PHP and friends, so what I'm going to suggest might be impossible since I'm not aware of their limitations. Ability to change transparency/opacity of every line graph independently can be really helpful, so you can easily compare the line graphs overlapping with each other and extract more information.

          Whenever the user clicks on colored boxes or labels, a new balloon pops up and allows to change opacity value through the slider. Here is a quick and dirty mock-up:
          For nearly all browsers, the pts_Graph code renders out to SVG... It'd be possible, via JavaScript, to add customizations like what you mentioned but frankly it'd be low on my TODO List unless it was for a Phoronix Premium only feature.
          Michael Larabel
          https://www.michaellarabel.com/

          Comment


          • #6
            A few things that could be improved:
            1. In the total frame time chart, you could align the min/max/avg figures across all the cards and drop the 'Min:', 'Max:' and 'Avg:' labels. It will be easier to read and cleaner too. It would be event better if the min/max/avg figures were colour coded, i.e. red for the min figure and green for the max.
            2. Entries for cards from different vendors could be coloured according to their branding colours.
            3. The text at the top, such as 'Milliseconds, Less is Better' is heavily blurred and barely readable. Consider increasing the font size or using a different font that works well at small sizes. Fonts without AA (such as Dina) generally work well at small sizes.
            4. Consider sorting the list based on performance.
            5. It would be great if the graphs were interactive and supported stable sorting based on multiple criteria.

            Comment


            • #7
              Originally posted by alazar View Post
              If you really want to improve the visualizations, why not make it interactive? Like these charts http://www.highcharts.com/ (sorry for the free ad, it's the closest example I've found on a quick search). You could display additional information on hover (like min/max FPS). In addition, it would be easier to find out what-is-what in benchmarks like power consumption, where results are so close you can't even distinguish lines, you could hover through the ctested cases and the correspondan line graph would have focus over the rest.

              The downside is you could no longer use images for this, of course. You would have no problem on Phoronix, for anonimous benchmarks you could use a frame or give the code in the PTS results.
              For most browsers already when serving OpenBenchmarking.org graphs it is served as SVG and with that is tooltips and other information that makes it a bit more interactive... But for really like rich interactivity, that's all bottlenecked by my time or the lack of code contributions by others. It's rather easy to add by anyone that has the time. Within this particular image, they were just JPEG image screenshots as I haven't uploaded the latest code to OpenBenchmarking.org for dynamic embedded purposes.
              Michael Larabel
              https://www.michaellarabel.com/

              Comment


              • #8
                Originally posted by xslr View Post
                A few things that could be improved:
                1. In the total frame time chart, you could align the min/max/avg figures across all the cards and drop the 'Min:', 'Max:' and 'Avg:' labels. It will be easier to read and cleaner too. It would be event better if the min/max/avg figures were colour coded, i.e. red for the min figure and green for the max.
                2. Entries for cards from different vendors could be coloured according to their branding colours.
                3. The text at the top, such as 'Milliseconds, Less is Better' is heavily blurred and barely readable. Consider increasing the font size or using a different font that works well at small sizes. Fonts without AA (such as Dina) generally work well at small sizes.
                4. Consider sorting the list based on performance.
                5. It would be great if the graphs were interactive and supported stable sorting based on multiple criteria.
                1. rather trivial change... patches welcome.
                2. again, not too much of a big change, and is an easy change for new comers.
                3. for the purposes of this article it was just JPEG screenshots rather than SVG graphs as served by most articles, until the new code is live on OpenBenchmarking.org.
                4. for this article they were intentionally unsorted as the actual interesting data will be shared next week when it's all complete.
                5. see my other notes in this thread and other contributions are welcome....
                Michael Larabel
                https://www.michaellarabel.com/

                Comment


                • #9
                  Originally posted by siavashserver
                  I've never played with PHP and friends, so what I'm going to suggest might be impossible since I'm not aware of their limitations. Ability to change transparency/opacity of every line graph independently can be really helpful, so you can easily compare the line graphs overlapping with each other and extract more information.

                  Whenever the user clicks on colored boxes or labels, a new balloon pops up and allows to change opacity value through the slider. Here is a quick and dirty mock-up:
                  Or make it so when you hover over a box, it dims the rest of the plots.

                  Comment


                  • #10
                    Sometimes the CPU load would be essential too, especially on poorer graphics drivers. Like a video on YT is playable or game has some FPS but a lot of work is being dumped on the CPU instead of GPU. The blue FPS bar graph could have a second bar in the background with average CPU load (with high opacity) and/or CPU load timeline below FPS timeline.

                    Comment

                    Working...
                    X