1. Computers
  2. Display Drivers
  3. Graphics Cards
  4. Memory
  5. Motherboards
  6. Processors
  7. Software
  8. Storage
  9. Operating Systems


Facebook RSS Twitter Twitter Google Plus


Phoronix Test Suite

OpenBenchmarking.org

More Steam Linux Tests/Benchmarks Might Be Coming

Valve

Published on 24 April 2014 05:39 AM EDT
Written by Michael Larabel in Valve
3 Comments

Thanks to changes being made to the Steam Linux client, it looks like we might be closer to being able to deliver more often benchmarks of Steam Linux games.

For those not familiar with the reasons why Steam on Linux games aren't more frequently benchmarked on Phoronix as part of our graphics testing but tend to benchmark older titles and non-Steam games, read Finally, Team Fortress 2 Benchmarks For Phoronix! and Running Benchmarks On Other New Linux Games. Long story short, tests run at Phoronix must meet strict requirements for reproducibility and turn-key deployment capabilities... This is just not to save me time with constantly benchmarking new Linux software and hardware, but also to make it reproducible to third-parties wishing to verify the test results or to carry out similar tests within different environments.

All testing is automated via the open-source Phoronix Test Suite software with OpenBenchmarking.org to deliver the best Linux benchmarking experience. This just isn't about self-promotion but nearly all major IHVs and ISVs using the Phoronix Test Suite internally in some fashion.

More Steam Linux Tests/Benchmarks Might Be Coming

With using Steam the problems have traditionally come down to the Steam runtime being too controlling for wishing to run the external game processes outside of it, Steam controlling game updates when wishing to obtain a specific revision of a game for ensuring accuracy of the comparison, and many of the games not being easily automate-able for benchmarking purposes that can cleanly start -> benchmark -> quit. For QA and automated testing purposes, it works much better being able to fetch a specific binary with a guaranteed state.

The good news now is that I've heard from a Valve Linux developer that additions to the Steam API will finally allow us to at least record universally a build revision/number for each game... Up to now it's been rather hard to tell if two separate copies of a Steam game being benchmarked were actually the same version (and thus comparable) or not since there wasn't an expressed build number across the board of all Steam games. With the latest Steam API work, it looks like we finally have that ability to record a build number for Steam games to make sure the same version of a game is being benchmarked.

Unfortunately, there's nothing much that can be done from Valve's end for being able to fetch older versions of a game -- if you wish to see how your modern hardware is doing against a Phoronix article with results from a few months ago, how new drivers are comparing to an older release of a game where older drivers were benchmarked at length, etc. There isn't much in the way of revision control capabilities on Steam for rolling back to an older version of a game and it doesn't appear there will be that capability added due to size/interface restraints.

Beyond the work to be able to expose build/version information, there might be some news shortly on another front when it comes to playing back OpenGL traces of popular proprietary game titles via APITrace and VOGL... Stay tuned for hopeful more information in the days ahead. At least for Valve games I already have assurance of being able to use their OpenGL traces without concern for copyright/license matters.

About The Author
Michael Larabel is the principal author of Phoronix.com and founded the web-site in 2004 with a focus on enriching the Linux hardware experience and being the largest web-site devoted to Linux hardware reviews, particularly for products relevant to Linux gamers and enthusiasts but also commonly reviewing servers/workstations and embedded Linux devices. Michael has written more than 10,000 articles covering the state of Linux hardware support, Linux performance, graphics hardware drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org automated testing software. He can be followed via and or contacted via .
Latest Linux Hardware Reviews
  1. Intel Launches The Core i7 5960X, Mighty Powerful Haswell-E CPUs
  2. AMD Radeon R9 290: Gallium3D vs. Catalyst Drivers
  3. AMD Radeon R9 290 Open-Source Driver Works, But Has A Ways To Go
  4. Trying The Configurable 45 Watt TDP With AMD's A10-7800 / A6-7400K
Latest Linux Articles
  1. How Intel Graphics On Linux Compare To Open-Source AMD/NVIDIA Drivers
  2. The Fastest NVIDIA GPUs For Open-Source Nouveau With Steam Linux Gaming
  3. Testing For The Latest Linux Kernel Power Regression
  4. The Most Energy Efficient Radeon GPU For AMD Linux Gaming
Latest Linux News
  1. AMD Steppe Eagle Flys To Coreboot
  2. Intel Beignet Is Working Out Surprisingly Well For OpenCL On Linux
  3. Coreboot Adds Lenovo X220 With Native Sandy Bridge Support
  4. Canonical Has Yet To Land X.Org Server 1.16 For Ubuntu 14.10
  5. Imagination Launches A MIPS Development Board
  6. Getting Involved With The New Raspberry Pi Graphics Driver
  7. A New AMD Catalyst Linux Driver Unofficially Surfaces
  8. LibreOffice Ported To 64-bit ARM (AArch64)
  9. Enlightenment E19 RC3 Shows Off The New Wayland Compositor
  10. Metro Redux Is Going To Require OpenGL 4.x On Linux
Latest Forum Discussions
  1. Btrfs Gets Talked Up, Googler Encourages You To Try Btrfs
  2. Updated graphics drivers for Ubuntu 12.04 Precise LTS
  3. Catalyst 14.201.1008
  4. It's Now Possible To Play Netflix Natively On Linux Without Wine Plug-Ins
  5. Users defect to Linux as OpenBSD removes Lynx from base system
  6. Updated and Optimized Ubuntu Free Graphics Drivers
  7. Canonical Joined The Khronos Group To Help Mir/Wayland Drivers
  8. Radeon HD5670 and Ubuntu 14.04