Originally posted by W.Irrkopf
View Post
Announcement
Collapse
No announcement yet.
RFC: Polishing Up The Result Graphs
Collapse
X
-
-
First, I would love to see some histograms or even better: probability density plots, especially for FPS related things whose distributions tend not to be normal at all (the reason why FPS average is usually not representative). I can ellaborate on that if needed.
Then, you could also apply a smoothing function to line graphs like power graphs. A simple gaussian or rectangular smoothening would be enough. The reason is that people reading your article care about the trend, not individual and noisy spikes.
While I'm talking about power graphs, there is a big problem with your power measurements: what you really want is an energy consumption. Basically, if I transpose what you do in the realm of school, it's like giving much harder exams to the best students and far easier ones to the others; ultimately concluding that the best students did very bad at the exam compared to the others. To solve this, I would suggest either to work at constant framerate and look at the power consumption (or better, its integral over time: the energy) OR to calculate watt/FPS (not as an average but for each single point) OR to work at constant number of frames per test and calculate the energy (which again, better represents the concept behind "average power consumption").
Finally I would be glad if you could do something to display full graphs on phones. On mine these are usually cropped and I need to ask for the desktop version of the website to get the graphs displayed in totality.
Comment
-
Originally posted by Lltp View PostFirst, I would love to see some histograms or even better: probability density plots, especially for FPS related things whose distributions tend not to be normal at all (the reason why FPS average is usually not representative). I can ellaborate on that if needed.Michael Larabel
https://www.michaellarabel.com/
Comment
-
Originally posted by Michael View Post
What would be the value in that?
Also, one can't discern if the card was tested and failed or if it was tested at all
Comment
-
One general thing about the graphs that had me very confused until recently is how to get to the OpenBenchmarking result from the graphs. For one, the box icon is really not obvious; putting a text label next to it saying where it takes you would improve it a lot. For another, shift-clicking or middle-clicking the box opens... the box icon, not the OpenBenchmarking site, in a new tab.
Comment
-
I still think a summary graph would be good where you would get scores from each test and put them together to get a final score.
When you test drivers, sometimes we get some better performance in some games and worse in others, the summary graph would help see if we're on the positive or negative side as a whole.
Comment
-
Originally posted by GreatEmerald View PostOne general thing about the graphs that had me very confused until recently is how to get to the OpenBenchmarking result from the graphs. For one, the box icon is really not obvious; putting a text label next to it saying where it takes you would improve it a lot. For another, shift-clicking or middle-clicking the box opens... the box icon, not the OpenBenchmarking site, in a new tab.
Comment
-
Originally posted by geearf View PostI still think a summary graph would be good where you would get scores from each test and put them together to get a final score.
When you test drivers, sometimes we get some better performance in some games and worse in others, the summary graph would help see if we're on the positive or negative side as a whole.Michael Larabel
https://www.michaellarabel.com/
Comment
Comment