Benchmarks Of NVIDIA's New Linux GPU Driver

[enfocomp]

I agree, it would be really nice for PTS to allow benchmarking of STEAM titles so hopefully the exiting bug will be fixed in the future. This would allow a side to side comparison to Windows.

[smitty3268]

So without nasty hacks, it can't be automated nicely until Steam quits when requested and doesn't hang.

So you're saying it's possible, with nasty hacks.... Besides which, that's ignoring the argument that Phoronix should just show benchmarks that aren't in PTS, for exactly that reason - PTS hasn't gotten support for Steam in months, and there is no sign of it ever coming. It's pretty obvious Valve doesn't consider the matter an urgent priority, and you obviously don't either. So will PTS ever support Steam? Will Phoronix ever have a Valve game benchmarked?

[Kano]

When you check first that the game runs you can use a direct approach to run the game. Like:

http://kanotix.com/files/fix/tmp/tf2/bench-own-demos-tf2.bash

[Michael]

Sure they do

No they don't, at last check there's still an issue with Steam not exiting (the game can exit, but Steam will still be running and thus block the process) after the benchmark is complete. So without nasty hacks, it can't be automated nicely until Steam quits when requested and doesn't hang.

There's also an issue of not being able to control revisions/updates to the game, but for my purposes that isn't as pressing as Steam getting in the way on exit.

[smitty3268]

RTFL.

Wont expand first 3, but 4th stand for LICENSE.
Did you checked if licenses of those games and license of steam allow for benchmarks?

Michael has already told us that Valve gave him explicit permission to benchmark apps. At least some of Valve's games.

[przemoli]

Sure they do, PTS just doesn't do it yet. Honestly if this site was half way decent it wouldn't matter and Michael would just be running manual benchmark runs if his benchmarking tool wasn't up to speed yet, but Phoronix is all about PTS these days, not the actual benchmark results.

RTFL.

Wont expand first 3, but 4th stand for LICENSE.
Did you checked if licenses of those games and license of steam allow for benchmarks?

[smitty3268]

Personally, if I were releasing benchmarks and people complained about every minute detail - I would stop providing them to the public.

Michael makes his living from ad revenue based on those benchmarks, so it's doubtful he'll just stop. And we have every right to point out what we think should be improved on the site. Michael can always ban us if he doesn't like what we're saying.

[enfocomp]

Thanks for the benchmarks. Odd to see a performance regression with the latest driver release.

What is with people bitching whenever benchmarks are performed here? If you don't like the tests used, then do your own damn benchmarks. Some people are very rude and disrespectful on this forum. Much easier to criticize other people then doing some actual tests yourself, isn't it? Personally, if I were releasing benchmarks and people complained about every minute detail - I would stop providing them to the public.

[GreatEmerald]

Killing Floor is UE2 (it originated as a mod for UT2004). So of course there should be no issues there, except that it's not free AFAIK.

[smitty3268]

they don't return framerate in any way that the PTS could automatically collect and store just yet.

Sure they do, PTS just doesn't do it yet. Honestly if this site was half way decent it wouldn't matter and Michael would just be running manual benchmark runs if his benchmarking tool wasn't up to speed yet, but Phoronix is all about PTS these days, not the actual benchmark results.