Great news really!
I hope that soon enough we get to see relevant tests!
Agreed. As long as there's a way to record a demo, play back the demo, and automate the process, that's a start. Hopefully there's also either a way to lock the game version, or at least pick games that don't update often.
Note that this tool isn't limited to running Steam apps, it can be used to print the frame times and insert a frame rate overlay into any OpenGL application, kind of like FRAPS.
Here is my hope: graphics tests that take a minute or two to run. Every time i run a real PTS 3D test, it takes about 10-15 minutes. And this is for one test (say, Unigine). As a result, I rarely test.
What interests me is the Steam integration but after looking at their code it isn't too useful.... but will try talking to them or adding some improvements myself. From the Steam side I would really love the ability for being able to lock to a specific game revision first of all, but I don't know of any command line argument or anything to capture/use a specific revision of the Steam game... Plagman, do you know any? I'll have more details sent to Mike next week.