Announcement

Collapse
No announcement yet.

Mplayer builds do not complete in suite tests

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Mplayer builds do not complete in suite tests

    OK, something really odd here.

    Whenever the mplayer compile test is ran from a suite such as

    ./phoronix-test-suite run universe
    or
    ./phoronix-test-suite run universe-cli
    or
    ./phoronix-test-suite run multicore

    I get the mplayer build not completing and giving false results like

    Code:
    
    ======================================
    Timed MPlayer Compilation (Run 1 of 1)
    ======================================
    
    MPlayer Build Time: 10.51 Seconds
    
    ====================================
    Timed MPlayer Compilation:
    Time To Compile
    
    10.51 Seconds
    
    Average: 10.51 Seconds
    ====================================
    If I run just the mplayer compilation test on it's own or in some other suites I get more realistic results.

    ./phoronix-test-suite run build-mplayer
    or
    ./phoronix-test-suite run compilation


    Code:
    ======================================
    Timed MPlayer Compilation (Run 1 of 1)
    ======================================
    
    MPlayer Build Time: 85.05 Seconds
    
    ====================================
    Timed MPlayer Compilation:
    
    85.05 Seconds
    
    Average: 85.05 Seconds
    ====================================
    
    dean@linux:~/phoronix-test-suite>
    This is with using a clean install of the suite .7 version. All other tests complete fine and give realistic results. It's just mplayer in certain suites.
    Last edited by deanjo; 18 May 2008, 07:43 AM.

  • #2
    Hmmm very strange! Anyone else experiencing similar issues?
    Michael Larabel
    https://www.michaellarabel.com/

    Comment


    • #3
      mplayer doesn't work well with make -j (probably a dependency issue). Sometimes it works, sometimes it fails early on with an exit code of 2.
      Last edited by apaige; 18 May 2008, 08:31 AM.

      Comment


      • #4
        Actually, mplayer seems to fail with make -j on my machine only when I haven't cleared CFLAGS environment variables.

        Comment


        • #5
          Originally posted by apaige View Post
          Actually, mplayer seems to fail with make -j on my machine only when I haven't cleared CFLAGS environment variables.
          So then are you thinking add CFLAGS = "" into the script?
          Michael Larabel
          https://www.michaellarabel.com/

          Comment


          • #6
            Originally posted by apaige View Post
            mplayer doesn't work well with make -j (probably a dependency issue). Sometimes it works, sometimes it fails early on with an exit code of 2.

            Same here, oddly enough it only happens in the above suites listed.

            ./phoronix-test-suite run build-mplayer or ./phoronix-test-suite run compilation or just doing make -j4 never fails.

            Comment


            • #7
              Originally posted by deanjo View Post
              Same here, oddly enough it only happens in the above suites listed.

              ./phoronix-test-suite run build-mplayer or ./phoronix-test-suite run compilation or just doing make -j4 never fails.
              Can you add CFLAGS="" to your pts/test-resources/build-mplayer/install.sh in the line above the timed make line and see how it runs?
              Michael Larabel
              https://www.michaellarabel.com/

              Comment


              • #8
                Originally posted by Michael View Post
                So then are you thinking add CFLAGS = "" into the script?
                I think the question is larger than that. It's about using optimizations (or not) throughout the test suite. Right now, most benchmarks will pick up users' environmental compiler variables. That's not only compilation benchmarks, but also every benchmark that have apps compile before runnning them (i.e. audio encoding etc...). For that reason, two users with the exact same system can have very different results depending on their environment settings. Ideally, every benchmark would be compiled with specific optimizations for the CPU they run on.

                Comment


                • #9
                  Originally posted by Michael View Post
                  Can you add CFLAGS="" to your pts/test-resources/build-mplayer/install.sh in the line above the timed make line and see how it runs?
                  Made the changes requested

                  Code:
                  sleep 3
                  CFLAGS=""
                  /usr/bin/time -f \"MPlayer Build Time: %e Seconds\" make -s -j \$NUM_CPU_JOBS 2>&1 | grep Seconds" > time-compile-mplayer
                  and then running

                  ./phoronix-test-suite run universe-cli

                  still results in this

                  Code:
                  ======================================
                  Timed MPlayer Compilation (Run 1 of 1)
                  ======================================
                  
                  MPlayer Build Time: 11.03 Seconds
                  
                  ====================================
                  Timed MPlayer Compilation:
                  Time To Compile
                  
                  11.03 Seconds
                  
                  Average: 11.03 Seconds
                  ====================================
                  Still no joy.

                  Comment


                  • #10
                    What does seem to cure the issue is having the mplayer compilation being the first test ran.

                    Code:
                    dean@linux:~/phoronix-test-suite> ./phoronix-test-suite run universe-cli
                    
                    Would you like to save these benchmark results (Y/n)? y
                    Enter a name to save these results: y
                    Enter a unique identifier for distinguishing this series of tests: attop
                    
                    ====================================
                    Universe-cli Test Suite
                    ====================================
                    
                    
                    Running Universe-cli Test Suite...
                    
                    
                    ======================================
                    Timed MPlayer Compilation (Run 1 of 1)
                    ======================================
                    
                    MPlayer Build Time: 84.22 Seconds
                    
                    ====================================
                    Timed MPlayer Compilation:
                    Time To Compile
                    
                    84.22 Seconds
                    
                    Average: 84.22 Seconds
                    ====================================
                    
                    ^C
                    dean@linux:~/phoronix-test-suite> ./phoronix-test-suite run universe-cli
                    
                    Would you like to save these benchmark results (Y/n)? y
                    Enter a name to save these results: run2
                    Enter a unique identifier for distinguishing this series of tests: run2
                    
                    ====================================
                    Universe-cli Test Suite
                    ====================================
                    
                    
                    Running Universe-cli Test Suite...
                    
                    
                    ======================================
                    Timed MPlayer Compilation (Run 1 of 1)
                    ======================================
                    
                    MPlayer Build Time: 86.06 Seconds
                    
                    ====================================
                    Timed MPlayer Compilation:
                    Time To Compile
                    
                    86.06 Seconds
                    
                    Average: 86.06 Seconds
                    ====================================
                    
                    ^C
                    dean@linux:~/phoronix-test-suite>

                    Comment

                    Working...
                    X