Page 1 of 3 123 LastLast
Results 1 to 10 of 32

Thread: Defining The Phoronix Test Suite

Hybrid View

  1. #1
    Join Date
    Jan 2007
    Posts
    15,645

    Default Defining The Phoronix Test Suite

    Phoronix: Defining The Phoronix Test Suite

    It's going on four years that we have been providing benchmarks under Linux at Phoronix, and through this time the process has evolved as more applications have come about that gauge Linux system performance and meet our criteria for use in hardware reviews. While our internal process is continually refined, we have received requests for creating a Linux benchmarking manifest so that interested parties are able to easily reproduce our tests for comparative purposes and know everything that's involved. With that said, we are now working to establish the Phoronix Test Suite that will consist both of detailed documentation defining our hardware benchmarking protocols and free software that automates much of this work.

    http://www.phoronix.com/vr.php?view=11813

  2. #2
    Join Date
    Jun 2007
    Posts
    145

    Default

    really, really great idea. i'm going to think about several components for such a benchmark, as soon as i've such results, i'm going to write them here

  3. #3
    Join Date
    Jan 2007
    Location
    Au
    Posts
    174

    Default

    what licence will this be - gpl?

  4. #4

    Default

    Quote Originally Posted by hmmm View Post
    what licence will this be - gpl?

    GPLv3 likely (chance it could be MIT/X11 but most likely GPL)

  5. #5
    Join Date
    Dec 2007
    Location
    Romania, Eastern Europe
    Posts
    31

    Smile licensing beats all!

    Quote Originally Posted by Michael View Post
    GPLv3 likely (chance it could be MIT/X11 but most likely GPL)
    Totally awesome! First i had thought the Test Suite will be released under a proprietary license, and I came to the forum to ask if this is right. And now I see GPLv3.

    I'm totally knocked off!

    Can't wait to see distros shipping up packages with Phoronix Testing Suite.

  6. #6
    Join Date
    May 2007
    Location
    Third Rock from the Sun
    Posts
    6,587

    Default

    Why not add in benches of

    Blender3D rendering, an alternative for the 3dsMax benches suites use (heck even use the project files from Elephants Dream)

    GIMP running though a series of filters and scripts much like other bench suites use Photoshop

    POVRay benches

    MySQL(or postgresql) benchmarks

    x264 encoding benches (perhaps utilizing various filters in an app like avidemux2)

    These apps would be a far more accurate representation of performance then any lame RAMspeed or hdparm test.

    As well they should be compiled in 32-bit and 64-bit with all applicable flags.

    (Oh gee look at that, all free software and all crossplatform)

    I would stay away from propriatary apps like Quakewars. Keep the suite free of non OSS. Use one of the many free fps's instead so everybody can use it and it can be included with linux distributions.
    Last edited by deanjo; 02-13-2008 at 02:12 AM.

  7. #7
    Join Date
    Nov 2006
    Location
    Seattle
    Posts
    305

    Default

    Way to go, this is a great idea. I'm sure this will go far to create a standard benchmarking tool for Linux.

  8. #8
    Join Date
    Feb 2008
    Posts
    88

    Default

    Are there any free games in there? OpenArena, Cube2, Nexuiz (shameless plug)? What about e.g. oggenc?

  9. #9

    Default

    oggenc is in there.

    SavageX: Last I checked out the Nexuiz benchmarking capabilities, I wasn't too impressed to be honest. Have they improved as of late? Last time I looked into it was about a year ago. If you're able to shed anymore light on it I'd be more than willing to investigate it further.

  10. #10
    Join Date
    Feb 2008
    Posts
    88

    Default

    Quote Originally Posted by Michael View Post
    SavageX: Last I checked out the Nexuiz benchmarking capabilities, I wasn't too impressed to be honest. Have they improved as of late? Last time I looked into it was about a year ago. If you're able to shed anymore light on it I'd be more than willing to investigate it further.
    As basically all Quake-engine based games it has the nice timedemo command. Try e.g. "timedemo demos/demo1". I think it should even work directly at game startup: "./nexuiz-linux-whatever-binary +timedemo demos/demo1"

    Or you can create a benchmark config file (e.g. "benchmark.cfg" in the Nexuiz "data" directory):

    timedemo/demo1
    timedemo/demo1
    timedemo/demo1
    timedemo/demo2
    timedemo/demo2
    timedemo/demo2

    and do a "./nexuiz-linux-bla-bla +exec benchmark.cfg" to automate testing.

    Each run will print to console (ingame and to stdout) statistics like min/avg/max framerates.

    We'll release a new version of Nexuiz hopefully later this month (see http://emptyset.endoftheinternet.org...nexuiz/builds/ for SVN builds) which will introduce (optional) rendering features like reflective water with refraction - this will make sure even fast cards are kept busy ;-)

    (Plus we finally have a much nicer menu ;-) )

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •