Announcement

Collapse
No announcement yet.

Mplayer builds do not complete in suite tests

Collapse
X
  • Filter
  • Time
  • Show
Clear All
new posts

  • Mplayer builds do not complete in suite tests

    OK, something really odd here.

    Whenever the mplayer compile test is ran from a suite such as

    ./phoronix-test-suite run universe
    or
    ./phoronix-test-suite run universe-cli
    or
    ./phoronix-test-suite run multicore

    I get the mplayer build not completing and giving false results like

    Code:
    
    ======================================
    Timed MPlayer Compilation (Run 1 of 1)
    ======================================
    
    MPlayer Build Time: 10.51 Seconds
    
    ====================================
    Timed MPlayer Compilation:
    Time To Compile
    
    10.51 Seconds
    
    Average: 10.51 Seconds
    ====================================
    If I run just the mplayer compilation test on it's own or in some other suites I get more realistic results.

    ./phoronix-test-suite run build-mplayer
    or
    ./phoronix-test-suite run compilation


    Code:
    ======================================
    Timed MPlayer Compilation (Run 1 of 1)
    ======================================
    
    MPlayer Build Time: 85.05 Seconds
    
    ====================================
    Timed MPlayer Compilation:
    
    85.05 Seconds
    
    Average: 85.05 Seconds
    ====================================
    
    dean@linux:~/phoronix-test-suite>
    This is with using a clean install of the suite .7 version. All other tests complete fine and give realistic results. It's just mplayer in certain suites.
    Last edited by deanjo; 05-18-2008, 07:43 AM.

  • #2
    Hmmm very strange! Anyone else experiencing similar issues?
    Michael Larabel
    http://www.michaellarabel.com/

    Comment


    • #3
      mplayer doesn't work well with make -j (probably a dependency issue). Sometimes it works, sometimes it fails early on with an exit code of 2.
      Last edited by apaige; 05-18-2008, 08:31 AM.

      Comment


      • #4
        Actually, mplayer seems to fail with make -j on my machine only when I haven't cleared CFLAGS environment variables.

        Comment


        • #5
          Originally posted by apaige View Post
          Actually, mplayer seems to fail with make -j on my machine only when I haven't cleared CFLAGS environment variables.
          So then are you thinking add CFLAGS = "" into the script?
          Michael Larabel
          http://www.michaellarabel.com/

          Comment


          • #6
            Originally posted by apaige View Post
            mplayer doesn't work well with make -j (probably a dependency issue). Sometimes it works, sometimes it fails early on with an exit code of 2.

            Same here, oddly enough it only happens in the above suites listed.

            ./phoronix-test-suite run build-mplayer or ./phoronix-test-suite run compilation or just doing make -j4 never fails.

            Comment


            • #7
              Originally posted by deanjo View Post
              Same here, oddly enough it only happens in the above suites listed.

              ./phoronix-test-suite run build-mplayer or ./phoronix-test-suite run compilation or just doing make -j4 never fails.
              Can you add CFLAGS="" to your pts/test-resources/build-mplayer/install.sh in the line above the timed make line and see how it runs?
              Michael Larabel
              http://www.michaellarabel.com/

              Comment


              • #8
                Originally posted by Michael View Post
                So then are you thinking add CFLAGS = "" into the script?
                I think the question is larger than that. It's about using optimizations (or not) throughout the test suite. Right now, most benchmarks will pick up users' environmental compiler variables. That's not only compilation benchmarks, but also every benchmark that have apps compile before runnning them (i.e. audio encoding etc...). For that reason, two users with the exact same system can have very different results depending on their environment settings. Ideally, every benchmark would be compiled with specific optimizations for the CPU they run on.

                Comment


                • #9
                  Originally posted by Michael View Post
                  Can you add CFLAGS="" to your pts/test-resources/build-mplayer/install.sh in the line above the timed make line and see how it runs?
                  Made the changes requested

                  Code:
                  sleep 3
                  CFLAGS=""
                  /usr/bin/time -f \"MPlayer Build Time: %e Seconds\" make -s -j \$NUM_CPU_JOBS 2>&1 | grep Seconds" > time-compile-mplayer
                  and then running

                  ./phoronix-test-suite run universe-cli

                  still results in this

                  Code:
                  ======================================
                  Timed MPlayer Compilation (Run 1 of 1)
                  ======================================
                  
                  MPlayer Build Time: 11.03 Seconds
                  
                  ====================================
                  Timed MPlayer Compilation:
                  Time To Compile
                  
                  11.03 Seconds
                  
                  Average: 11.03 Seconds
                  ====================================
                  Still no joy.

                  Comment


                  • #10
                    What does seem to cure the issue is having the mplayer compilation being the first test ran.

                    Code:
                    dean@linux:~/phoronix-test-suite> ./phoronix-test-suite run universe-cli
                    
                    Would you like to save these benchmark results (Y/n)? y
                    Enter a name to save these results: y
                    Enter a unique identifier for distinguishing this series of tests: attop
                    
                    ====================================
                    Universe-cli Test Suite
                    ====================================
                    
                    
                    Running Universe-cli Test Suite...
                    
                    
                    ======================================
                    Timed MPlayer Compilation (Run 1 of 1)
                    ======================================
                    
                    MPlayer Build Time: 84.22 Seconds
                    
                    ====================================
                    Timed MPlayer Compilation:
                    Time To Compile
                    
                    84.22 Seconds
                    
                    Average: 84.22 Seconds
                    ====================================
                    
                    ^C
                    dean@linux:~/phoronix-test-suite> ./phoronix-test-suite run universe-cli
                    
                    Would you like to save these benchmark results (Y/n)? y
                    Enter a name to save these results: run2
                    Enter a unique identifier for distinguishing this series of tests: run2
                    
                    ====================================
                    Universe-cli Test Suite
                    ====================================
                    
                    
                    Running Universe-cli Test Suite...
                    
                    
                    ======================================
                    Timed MPlayer Compilation (Run 1 of 1)
                    ======================================
                    
                    MPlayer Build Time: 86.06 Seconds
                    
                    ====================================
                    Timed MPlayer Compilation:
                    Time To Compile
                    
                    86.06 Seconds
                    
                    Average: 86.06 Seconds
                    ====================================
                    
                    ^C
                    dean@linux:~/phoronix-test-suite>

                    Comment


                    • #11
                      Originally posted by deanjo View Post
                      Made the changes requested

                      Code:
                      sleep 3
                      CFLAGS=""
                      /usr/bin/time -f \"MPlayer Build Time: %e Seconds\" make -s -j \$NUM_CPU_JOBS 2>&1 | grep Seconds" > time-compile-mplayer
                      and then running

                      ./phoronix-test-suite run universe-cli

                      still results in this

                      Code:
                      ======================================
                      Timed MPlayer Compilation (Run 1 of 1)
                      ======================================
                      
                      MPlayer Build Time: 11.03 Seconds
                      
                      ====================================
                      Timed MPlayer Compilation:
                      Time To Compile
                      
                      11.03 Seconds
                      
                      Average: 11.03 Seconds
                      ====================================
                      Still no joy.
                      What about trying:

                      Code:
                      #!/bin/sh
                      
                      cd $1
                      
                      echo "#!/bin/sh
                      
                      if [ ! -f MPlayer-1.0rc2.tar.bz2 ]
                        then
                          echo \"MPlayer Not Installed... Build Failed.\"
                          exit
                      fi
                      
                      rm -rf MPlayer-1.0rc2/
                      tar -xjf MPlayer-1.0rc2.tar.bz2
                      cd MPlayer-1.0rc2/
                      ./configure > /dev/null
                      sleep 3
                      /usr/bin/time -f \"MPlayer Build Time: %e Seconds\" make -s -j \$NUM_CPU_JOBS 2>&1 | grep Seconds
                      
                      if [ \$? = 2 ]
                          then
                      /usr/bin/time -f \"MPlayer Build Time: %e Seconds\" make -s 2>&1 | grep Seconds
                          exit
                      fi" > time-compile-mplayer
                      
                      chmod +x time-compile-mplayer
                      Michael Larabel
                      http://www.michaellarabel.com/

                      Comment


                      • #12
                        Originally posted by Michael View Post
                        What about trying:

                        Code:
                        #!/bin/sh
                        
                        cd $1
                        
                        echo "#!/bin/sh
                        
                        if [ ! -f MPlayer-1.0rc2.tar.bz2 ]
                          then
                            echo \"MPlayer Not Installed... Build Failed.\"
                            exit
                        fi
                        
                        rm -rf MPlayer-1.0rc2/
                        tar -xjf MPlayer-1.0rc2.tar.bz2
                        cd MPlayer-1.0rc2/
                        ./configure > /dev/null
                        sleep 3
                        /usr/bin/time -f \"MPlayer Build Time: %e Seconds\" make -s -j \$NUM_CPU_JOBS 2>&1 | grep Seconds
                        
                        if [ \$? = 2 ]
                            then
                        /usr/bin/time -f \"MPlayer Build Time: %e Seconds\" make -s 2>&1 | grep Seconds
                            exit
                        fi" > time-compile-mplayer
                        
                        chmod +x time-compile-mplayer
                        Nope, issue remains
                        Code:
                        ======================================
                        Timed MPlayer Compilation (Run 1 of 1)
                        ======================================
                        
                        MPlayer Build Time: 12.19 Seconds
                        
                        ====================================
                        Timed MPlayer Compilation:
                        Time To Compile
                        
                        12.19 Seconds
                        
                        Average: 12.19 Seconds
                        ====================================
                        
                        ^C
                        dean@linux:~/phoronix-test-suite>

                        Comment


                        • #13
                          I would guess that some build-deps are missing.

                          Comment


                          • #14
                            Originally posted by Kano View Post
                            I would guess that some build-deps are missing.
                            Like I mentioned earlier, if the mplayer test is the first test in a suite then it builds fine everytime.

                            BTW, Michael the latest git doesn't resolve it.
                            Last edited by deanjo; 05-18-2008, 11:29 AM.

                            Comment


                            • #15
                              For testing I would remove the |grep Seconds, then you see more. Also I don't get what errorlevel 2 should be for the fallback.

                              Comment

                              Working...
                              X