Announcement

Collapse
No announcement yet.

Quickly & Easily Running Benchmarks On Docker With "phoronix/pts"

Collapse
X
  • Filter
  • Time
  • Show
Clear All
new posts

  • Quickly & Easily Running Benchmarks On Docker With "phoronix/pts"

    Phoronix: Quickly & Easily Running Benchmarks On Docker With "phoronix/pts"

    Making the Phoronix Test Suite even easier to use for container benchmarking, on Docker Hub now is the phoronix/pts image for easily carrying out Docker tests with a fully-standardized, performance-optimized user-space stack with many of the popular test profiles pre-seeded on the disk and is ready to begin benchmarking out-of-the-box.

    http://www.phoronix.com/vr.php?view=26779

  • blueweb
    replied
    Originally posted by Michael View Post

    What system dependency issues have you ran into in particular or with what tests? The Docker image installs Clear's package/bundle of os-testsuite-phoronix-cli, which should provide all available dependencies for the CLI/non-display PTS tests that work under Clear.
    For example, hpcc does not install due to dependencies:

    Code:
    Some additional dependencies are required, but they could not be installed automatically for your operating system.
    
    Below are the software packages that must be installed.
    
    Linear Algebra Pack
    
    Possible Package Names: liblapack-dev, lapack, lapack-devel, liblapack-devel
      
     The above dependencies should be installed before proceeding. Press any key when you're ready to continue.

    Leave a comment:


  • Michael
    replied
    Originally posted by blueweb View Post
    It's more a lack of familiarity with individual tests, and knowledge of what makes sense for a given test. I think a user downloading and trying different tests isn't too uncommon, and if tests just give errors or don't run, that makes the test suite seem less user-friendly. I suppose whether this is, or should be, addressed depends on what is the core mission of PTS.

    Will the release address the system dependencies issues?
    What system dependency issues have you ran into in particular or with what tests? The Docker image installs Clear's package/bundle of os-testsuite-phoronix-cli, which should provide all available dependencies for the CLI/non-display PTS tests that work under Clear.

    Leave a comment:


  • blueweb
    replied
    Originally posted by Michael View Post
    Were there any other tests in particular you found mysterious on Docker?
    It's more a lack of familiarity with individual tests, and knowledge of what makes sense for a given test. I think a user downloading and trying different tests isn't too uncommon, and if tests just give errors or don't run, that makes the test suite seem less user-friendly. I suppose whether this is, or should be, addressed depends on what is the core mission of PTS.

    The Docker image will be respun next week btw for the official 8.2 release.
    Will the release address the system dependencies issues?

    Leave a comment:


  • Michael
    replied
    And pts/indigobench-1.0.2 now has the RequiresDisplay = TRUE - http://openbenchmarking.org/test/pts/indigobench

    The Docker image will be respun next week btw for the official 8.2 release.

    Leave a comment:


  • Michael
    replied
    Originally posted by Michael View Post

    Were there any other tests in particular you found mysterious on Docker? I could add like a 'RequiresDisplay' property to test profiles to enforce the behavior that is assumed when TestType = Graphics, but I think it is just indigo and maybe one or two other tests that would benefit from as such... so just a matter of weighing the benefits. But yeah always looking for ways to improve the experience more broadly.
    Ended up adding a RequiresDisplay anyhow, https://github.com/phoronix-test-sui...e42c8f884aad37 so will go ahead and update indigobench shortly.

    Leave a comment:


  • Michael
    replied
    Originally posted by blueweb View Post
    Thanks for the explanation. I figured the problem might be due to the window launching aspect. Still, it would be nice to have a message instead of mysterious errors.

    And is it possible to install dependencies in the docker image? Otherwise it would be good to know which tests require dependencies and thus cannot be run.
    Were there any other tests in particular you found mysterious on Docker? I could add like a 'RequiresDisplay' property to test profiles to enforce the behavior that is assumed when TestType = Graphics, but I think it is just indigo and maybe one or two other tests that would benefit from as such... so just a matter of weighing the benefits. But yeah always looking for ways to improve the experience more broadly.

    Leave a comment:


  • blueweb
    replied
    Thanks for the explanation. I figured the problem might be due to the window launching aspect. Still, it would be nice to have a message instead of mysterious errors.

    And is it possible to install dependencies in the docker image? Otherwise it would be good to know which tests require dependencies and thus cannot be run.

    Leave a comment:


  • Michael
    replied
    Originally posted by blueweb View Post
    Aside from the above problem of installing dependencies, some tests don't run. I tried indigobench which downloaded and installed without error, but when run it gives a message "The test run did not produce a result." The benchmark does run on my system outside of docker.
    There may be some corner-cases... Like with indigobench, it launches a window even when running CPU benchmark... But without X11 support, it will fail. PTS will know for tests marked 'Graphics' that if no Wayland/X11 on Linux is present, the test shouldn't run as it will fail. But in this case it's not marked as Graphics. There are a few corner cases like that.

    So either needing to add more meta-data to the test profiles or the current approach of just assuming users are going to use sensible tests or explore if there are problems.

    Leave a comment:


  • blueweb
    replied
    Aside from the above problem of installing dependencies, some tests don't run. I tried indigobench which downloaded and installed without error, but when run it gives a message "The test run did not produce a result." The benchmark does run on my system outside of docker.

    Leave a comment:

Working...
X