Announcement

Collapse
No announcement yet.

Phoronix Test Suite Released

Collapse
X
  • Filter
  • Time
  • Show
Clear All
new posts

  • Phoronix Test Suite Released

    Phoronix: Phoronix Test Suite Released

    Back in early February we announced that we were in the process of formalizing and releasing our internal test tools as a platform for facilitating easy to use, accurate, and reproducible Linux benchmarks based upon the testing work that we have been doing at Phoronix for the past four years. The goals with this are really to make it easier for Linux end-users to run reliable (both qualitative and quantitative) benchmarks for their own personal use, push more open-source projects to making their software more testable, and pushing hardware and software vendors for greater Linux testing based upon a standardized set of tests. Today we are very pleased to announce the first public release of the Phoronix Test Suite software, which is licensed under the GNU GPLv3, and the creation of a public database for freely sharing your test results and other information in a collaborative manner.

    http://www.phoronix.com/vr.php?view=12136

  • #2
    1st Bug found.


    ./phoronix-test-suite benchmark universe

    Installing Benchmarks For Universe Test Suite...

    Encode-mp3 is already installed, skipping installation routine...
    Encode-ogg is already installed, skipping installation routine...
    Encode-flac is already installed, skipping installation routine...
    Build-mplayer is already installed, skipping installation routine...
    Build-php is already installed, skipping installation routine...
    Build-imagemagick is already installed, skipping installation routine...
    Nexuiz is already installed, skipping installation routine...
    Compress-gzip is already installed, skipping installation routine...
    Would you like to save these benchmark results (Y/n)? Y
    Enter a name to save (or merge) these results: dean
    Enter a unique identifier for distinguishing this series of tests: 2

    Phoronix Test Suite will record results!

    =================================
    Universe Test Suite
    =================================

    Running Benchmarks For Universe Test Suite...


    =================================
    Executing Pre-Benchmark Tasks
    =================================

    =================================
    LAME MP3 Encoding Benchmark (Run 1 of 3)
    =================================
    sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

    =================================
    LAME MP3 Encoding Benchmark (Run 2 of 3)
    =================================
    sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

    =================================
    LAME MP3 Encoding Benchmark (Run 3 of 3)
    =================================
    sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

    =================================
    Executing Post-Benchmark Tasks
    =================================
    PHP Fatal error: Call to undefined function bcdiv() in /home/dean/Desktop/phoronix-test-suite/pts-core/functions/pts-functions-run.php on line 175
    dean@linux:~/Desktop/phoronix-test-suite>

    Comment


    • #3
      Will give it a try later today or tomorrow! I have waited for the release for some time now, because I also wanted to do some comparions between drivers/distributions. Thanks for your great work, Michael

      Comment


      • #4
        deanjo:

        Do you have time installed at all? If so, what path is it in (which time)?

        Also, what version of PHP are you using / what distro (where bc math wouldn't be enabled)?
        Michael Larabel
        http://www.michaellarabel.com/

        Comment


        • #5
          Also, deanjo, if you run phoronix-test-suite benchmark nexuiz or another profile not depending upon the time command, it should work fine.
          Michael Larabel
          http://www.michaellarabel.com/

          Comment


          • #6
            openSUSE 11A3 / openSUSE 10.3 x64

            yes time is installed in usr/bin/

            PHP version 5.2.5-47 (fixed the PHP math error had to install the PHP5-bcmath module)


            BTW the time not being found only occurs in the audio encoding part of the tests.
            Last edited by deanjo; 04-02-2008, 12:55 PM.

            Comment


            • #7
              Originally posted by deanjo View Post
              openSUSE 11A3 / openSUSE 10.3 x64

              yes time is installed in usr/bin/

              PHP version 5.2.5-47 (fixed the PHP math error had to install the PHP5-bcmath module)


              BTW the time not being found only occurs in the audio encoding part of the tests.

              Sorry jumped the gun, the only tests that complete successfully are the Mplayer, PHP and Imagemagik, everything else fails.

              Code:
              dean@linux:~/Desktop/phoronix-test-suite> ./phoronix-test-suite benchmark universe
              
              Installing Benchmarks For Universe Test Suite...
              
              Encode-mp3 is already installed, skipping installation routine...
              Encode-ogg is already installed, skipping installation routine...
              Encode-flac is already installed, skipping installation routine...
              Build-mplayer is already installed, skipping installation routine...
              Build-php is already installed, skipping installation routine...
              Build-imagemagick is already installed, skipping installation routine...
              Nexuiz is already installed, skipping installation routine...
              Compress-gzip is already installed, skipping installation routine...
              Would you like to save these benchmark results (Y/n)? Y
              Enter a name to save (or merge) these results: dean
              Enter a unique identifier for distinguishing this series of tests: 2
              
              Phoronix Test Suite will record results!
              
              =================================
              Universe Test Suite
              =================================
              
              Running Benchmarks For Universe Test Suite...
              
              
              =================================
              Executing Pre-Benchmark Tasks
              =================================
              
              =================================
              LAME MP3 Encoding Benchmark (Run 1 of 3)
              =================================
              sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory
              
              =================================
              LAME MP3 Encoding Benchmark (Run 2 of 3)
              =================================
              sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory
              
              =================================
              LAME MP3 Encoding Benchmark (Run 3 of 3)
              =================================
              sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory
              
              =================================
              Executing Post-Benchmark Tasks
              =================================
              PHP Fatal error:  Call to undefined function bcdiv() in /home/dean/Desktop/phoronix-test-suite/pts-core/functions/pts-functions-run.php on line 175
              dean@linux:~/Desktop/phoronix-test-suite> ./phoronix-test-suite benchmark universe
              
              Installing Benchmarks For Universe Test Suite...
              
              Encode-mp3 is already installed, skipping installation routine...
              Encode-ogg is already installed, skipping installation routine...
              Encode-flac is already installed, skipping installation routine...
              Build-mplayer is already installed, skipping installation routine...
              Build-php is already installed, skipping installation routine...
              Build-imagemagick is already installed, skipping installation routine...
              Nexuiz is already installed, skipping installation routine...
              Compress-gzip is already installed, skipping installation routine...
              Would you like to save these benchmark results (Y/n)? Y
              Enter a name to save (or merge) these results: dean 2
              Enter a unique identifier for distinguishing this series of tests:
              Enter a unique identifier for distinguishing this series of tests: 2
              
              Phoronix Test Suite will record results!
              
              =================================
              Universe Test Suite
              =================================
              
              Running Benchmarks For Universe Test Suite...
              
              
              =================================
              Executing Pre-Benchmark Tasks
              =================================
              
              =================================
              LAME MP3 Encoding Benchmark (Run 1 of 3)
              =================================
              sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory
              
              =================================
              LAME MP3 Encoding Benchmark (Run 2 of 3)
              =================================
              sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory
              
              =================================
              LAME MP3 Encoding Benchmark (Run 3 of 3)
              =================================
              sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory
              
              =================================
              Executing Post-Benchmark Tasks
              =================================
              
              =================================
              LAME MP3 Encoding Results:
              
               Seconds
               Seconds
               Seconds
              
              Average: 0.00 Seconds
              =================================
              
              =================================
              Executing Pre-Benchmark Tasks
              =================================
              
              =================================
              Ogg Encoding Benchmark (Run 1 of 3)
              =================================
              sh: ./oggenc: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory
              
              =================================
              Ogg Encoding Benchmark (Run 2 of 3)
              =================================
              sh: ./oggenc: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory
              
              =================================
              Ogg Encoding Benchmark (Run 3 of 3)
              =================================
              sh: ./oggenc: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory
              
              =================================
              Executing Post-Benchmark Tasks
              =================================
              
              =================================
              Ogg Encoding Results:
              
               Seconds
               Seconds
               Seconds
              
              Average: 0.00 Seconds
              =================================
              
              =================================
              Executing Pre-Benchmark Tasks
              =================================
              
              =================================
              FLAC Audio Encoding Benchmark (Run 1 of 3)
              =================================
              sh: ./flac: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory
              
              =================================
              FLAC Audio Encoding Benchmark (Run 2 of 3)
              =================================
              sh: ./flac: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory
              
              =================================
              FLAC Audio Encoding Benchmark (Run 3 of 3)
              =================================
              sh: ./flac: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory
              
              =================================
              Executing Post-Benchmark Tasks
              =================================
              
              =================================
              FLAC Audio Encoding Results:
              
               Seconds
               Seconds
               Seconds
              
              Average: 0.00 Seconds
              =================================
              
              =================================
              Executing Pre-Benchmark Tasks
              =================================
              
              =================================
              Timed MPlayer Compilation Benchmark (Run 1 of 1)
              =================================
              MPlayer Build Time: 10.59 Seconds
              
              =================================
              Executing Post-Benchmark Tasks
              =================================
              
              =================================
              Timed MPlayer Compilation Results:
              
              10.59 Seconds
              
              Average: 10.59 Seconds
              =================================
              
              =================================
              Timed PHP Compilation Benchmark (Run 1 of 1)
              =================================
              configure: warning: You will need re2c 0.12.0 or later if you want to regenerate PHP parsers.
              configure: warning: flex versions supported for regeneration of the Zend/PHP parsers: 2.5.4  (found: 2.5.35)
              configure: warning: lemon versions supported for regeneration of libsqlite parsers: 1.0 (found: none).
              PHP Build Time: 89.84 Seconds
              
              =================================
              Executing Post-Benchmark Tasks
              =================================
              
              =================================
              Timed PHP Compilation Results:
              
              89.84 Seconds
              
              Average: 89.84 Seconds
              =================================
              
              =================================
              ImageMagick Compilation Benchmark (Run 1 of 1)
              =================================
              ImageMagick Build Time: 173.93 Seconds
              
              =================================
              Executing Post-Benchmark Tasks
              =================================
              
              =================================
              ImageMagick Compilation Results:
              
              173.93 Seconds
              
              Average: 173.93 Seconds
              =================================
              
              =================================
              Nexuiz Benchmark (Run 1 of 3)
              =================================
              sh: ./nexuiz: /bin/sh\ncd: bad interpreter: No such file or directory
              
              =================================
              Nexuiz Benchmark (Run 2 of 3)
              =================================
              sh: ./nexuiz: /bin/sh\ncd: bad interpreter: No such file or directory
              
              =================================
              Nexuiz Benchmark (Run 3 of 3)
              =================================
              sh: ./nexuiz: /bin/sh\ncd: bad interpreter: No such file or directory
              
              =================================
              Nexuiz Results:
              
               Average FPS
               Average FPS
               Average FPS
              
              Average: 0.00 Average FPS
              =================================
              
              =================================
              Executing Pre-Benchmark Tasks
              =================================
              
              =================================
              Time Gzip Compression Benchmark (Run 1 of 5)
              =================================
              sh: ./compress-gzip: /bin/sh\ncp: bad interpreter: No such file or directory
              
              =================================
              Time Gzip Compression Benchmark (Run 2 of 5)
              =================================
              sh: ./compress-gzip: /bin/sh\ncp: bad interpreter: No such file or directory
              
              =================================
              Time Gzip Compression Benchmark (Run 3 of 5)
              =================================
              sh: ./compress-gzip: /bin/sh\ncp: bad interpreter: No such file or directory
              
              =================================
              Time Gzip Compression Benchmark (Run 4 of 5)
              =================================
              sh: ./compress-gzip: /bin/sh\ncp: bad interpreter: No such file or directory
              
              =================================
              Time Gzip Compression Benchmark (Run 5 of 5)
              =================================
              sh: ./compress-gzip: /bin/sh\ncp: bad interpreter: No such file or directory
              
              =================================
              Executing Post-Benchmark Tasks
              =================================
              
              =================================
              Time Gzip Compression Results:
              
               Seconds
               Seconds
               Seconds
               Seconds
               Seconds
              
              Average: 0.00 Seconds
              =================================
              sh: lspci: command not found
              sh: lspci: command not found
              Results Saved To: test-results/dean2.xml
              Do you want to view the results in your web browser (Y/n)? Y

              Comment


              • #8
                I'll get that fixed shortly... just physically adding in the line breaks.
                Michael Larabel
                http://www.michaellarabel.com/

                Comment


                • #9
                  I just re-uploaded the 0.1 release with the corrected scripts for you. So just go re-download the package (or checkout the git) and then re-run it and it should be working for you with all tests I believe. You don't need to delete pts-benchmark-env as the Phoronix Test Suite will auto-detect these script changes.
                  Michael Larabel
                  http://www.michaellarabel.com/

                  Comment


                  • #10
                    Good job Michael.Gonna bench it after the work.

                    Comment

                    Working...
                    X