Announcement

Collapse
No announcement yet.

Phoronix Test Suite Brings Benchmarking To Mac OS X

Collapse
X
  • Filter
  • Time
  • Show
Clear All
new posts

  • Phoronix Test Suite Brings Benchmarking To Mac OS X

    Phoronix: Phoronix Test Suite Brings Benchmarking To Mac OS X

    In the Phoronix Test Suite 1.2 "Malvik" release our flagship Linux benchmarking software was brought to OpenSolaris and FreeBSD. With Phoronix Test Suite 1.4 "Orkdal", to be officially released later this year, we are now extending our test support to include Apple's Mac OS X operating system. In Phoronix Test Suite 1.4 Alpha 2 that was released this morning there is full support for Mac OS X within this open-source benchmarking framework and there are about three dozen tests that will run "out of the box" in this environment. We believe this is now the most comprehensive benchmarking platform for Mac OS X and it allows real-world test results to be compared from Linux, OpenSolaris, and FreeBSD.

    http://www.phoronix.com/vr.php?view=12915

  • #2
    Interesting . And more interesting as I installed OSX86 recently on my notebook (dell vostro 1400 with nvidia 8400m gs) and a desktop (wolfdale e8400 @ 3.6ghz on ep43-ds3l and nvidia 8500gt) on some spare hard disk space.

    Although I don't quite like the huge size of the test suites. Pretty happy with small tests like Xbench which are just a few MB. (Btw, Xbench rates the above mentioned desktop close to 200, afaik meaning twice fast as best g5 workstation.)

    I am guessing that the graphics subsystem tests in OSX will be pretty mediocre compared to Linux, especially those with ATI graphics. Just my guess though.

    Aside, speaking of OSX, I guess the Linux distros can learn a number of nice things. First of them is the lighting fast boot time. I apparently see that it boots in barely 15 seconds or so. And its no magic as we can clearly see whats going on behind the scenes by booting in verbose mode (-v). The actual kernel is too small and most things are modular. Further, the modules (aka extensions) are sort of precached (Extensions.mkext) - not much of hardware detection goes on during boot. And it caches them automagically every time any changes are made to the extensions folder (and guess for hardware changes also). The other thing to notice is the small number of services and the way they are started parallely. The system feels very very responsive in general (also look at the output of 'ps -A' for the relatively small number of services running). Minimal and clean system I should say. Remember its also a server OS. I am sure Linux users don't want a 5-second boot (would be wonderful though), but 15-second boot is really possible and already achieved.

    There is also another nice thing I saw about their kernel. Looks like there are not too many API changes. A hardware driver module (extension) made 2 or 3 years ago (for 10.4 I guess) still plugs in nicely and magically in 10.5.5. Thats something really really nice. Its kind of annoying in Linux that we can't expect third-party drivers to work with a minor change like kernel 2.6.26 to 2.6.27, that too for something as trivial as the number of arguments changing for a basic function! While its reasonable to ask for example that why fglrx developers cannot fix their drivers for xorg-server 1.5 which shipped with fedora9 several months ago, its also reasonable to question the number of changes made in kernel and xorg. Instead of chasing a moving target, devels can spend their valuable time implementing features and fixing *real* bugs - remember everything takes time. True that we see radical improvements in kernel and xorg, but things can hopefully be done in a little more non-destructive manner. Worst more, we don't want things like gallium vs dri2, gem vs ttm and ext4 vs reiser4 etc to be happening. Although these issues have been discussed time and again, hopefully somebody is listening.

    Long one!

    Comment


    • #3
      Originally posted by hdas View Post
      Although I don't quite like the huge size of the test suites
      Just the time it takes to run? Run an individual test then or make your own mini test suite.
      Michael Larabel
      http://www.michaellarabel.com/

      Comment


      • #4
        Happy to read about this! Can you run the darwin testsuite on linux, too? We have a mixed environment and it would be great to have a big suite where we can run the same tests on both systems. Apples to apples comparison

        I will try the OS X tests soonish.

        Comment


        • #5
          Originally posted by chem View Post
          Happy to read about this! Can you run the darwin testsuite on linux, too? We have a mixed environment and it would be great to have a big suite where we can run the same tests on both systems. Apples to apples comparison
          Yep, you can run phoronix-test-suite benchmark darwin on any platform.
          Michael Larabel
          http://www.michaellarabel.com/

          Comment


          • #6
            How to install this in OS X?

            I downloaded the phoronix-test-suite-1.4.0a1.tar.gz file. Extracted, double clicked "Install -sh" which opened Terminal, but with an error message:

            ERROR: /usr is not writable. Run this installer as root or specify a different directory prefix as the first argument sent to this script.


            Have I got the right package?

            Comment


            • #7
              You need 1.4.0a2, not Alpha 1.

              You're receiving that error since you need to run it as root or using the sudo command in order to install it to /usr/ So launch the terminal and then sudo ./install-sh.
              Michael Larabel
              http://www.michaellarabel.com/

              Comment


              • #8
                Hi Michael,

                Where is the downlownload link for 1.4.0a2?
                I can only see the source link on the download page.

                Thanx, I'll run it in Terminal

                Comment


                • #9
                  http://www.phoronix-test-suite.com/d...-suite-1.4.0a2

                  Right from the download page. I don't see 1.4.0a1 from the download page anymore, it shouldn't be there.
                  Michael Larabel
                  http://www.michaellarabel.com/

                  Comment


                  • #10
                    Thanx for that. Sorry, another noob question. Is this benchmark supposed to be run from Terminal as well?

                    The installation went o.k, when I doubled clicked on "Phoronix-test-suite", Terminal returned this message:
                    To run the Phoronix Test Suite locally you must first change directories to phoronix-test-suite/ or install the program using the install-sh script. For support visit: http://www.phoronix-test-suite.com/


                    What's my next step?

                    Comment


                    • #11
                      You must change to the directory you extracted the test suite to and then run it from that folder i.e. from terminal it would look something like this:

                      Code:
                      phoronix-test-suite Chilly$ ./phoronix-test-suite benchmark darwin
                      to begin the benchmark.

                      Just a few questions. Nexuiz runs poorly and I'm getting only 20fps average and I think I know why, because OpenGL 2.0 is disabled when the benchmark runs. Is setting OpenGL 2.0 against the Phoronix suite rules? if not how do I turn it on when my benchmark runs.

                      TIA.

                      Comment


                      • #12
                        Looking at your results on line, your macpro is using OGL 2.0. I'm not quite sure as how you figure OGL is "disabling".

                        Comment


                        • #13
                          Originally posted by deanjo View Post
                          Looking at your results on line, your macpro is using OGL 2.0. I'm not quite sure as how you figure OGL is "disabling".
                          Probably should have been more specific, the OpenGL 2.0 Shaders (GLSL) provide a dramatic improvement during the benchmark. During the benchmark I hit the esc button, navigate to video, turn this option on and see a night/day improvement (from 20fps to around 100fps+). BTW UrbanTerror is running fine and so is X-Plane.

                          Comment


                          • #14
                            I think I answered my own question lol.

                            http://www.alientrap.org/forum/viewtopic.php?t=3090

                            AlienTrap has a heads up for Nexuiz on OS X about the OpenGL 2.0 Shaders not being saved when enabled by the user.

                            Comment


                            • #15
                              Originally posted by Exman View Post
                              Thanx for that. Sorry, another noob question. Is this benchmark supposed to be run from Terminal as well?

                              The installation went o.k, when I doubled clicked on "Phoronix-test-suite", Terminal returned this message:
                              To run the Phoronix Test Suite locally you must first change directories to phoronix-test-suite/ or install the program using the install-sh script. For support visit: http://www.phoronix-test-suite.com/


                              What's my next step?
                              Yes you run from terminal.

                              Just launch terminal, cd to the directory of phoronix-test-suite, and then run say ./phoronix-test-suite benchmark darwin.
                              Michael Larabel
                              http://www.michaellarabel.com/

                              Comment

                              Working...
                              X