Quickly & Easily Running Benchmarks On Docker With "phoronix/pts"

[phoronix]

Phoronix: Quickly & Easily Running Benchmarks On Docker With "phoronix/pts"

Making the Phoronix Test Suite even easier to use for container benchmarking, on Docker Hub now is the phoronix/pts image for easily carrying out Docker tests with a fully-standardized, performance-optimized user-space stack with many of the popular test profiles pre-seeded on the disk and is ready to begin benchmarking out-of-the-box.

http://www.phoronix.com/vr.php?view=26779

[DrYak]

Great stuff!


Possibility to benchmark an external filesystem that was bind-mounted to the docker (forgot the correct docker terminology...)

Quick check : yes, bind mount is the correct terminology.

[lachs0r]

Just be aware that Docker has insane syscall overhead due to its heavy filtering (even with privileged containers), which can be observed with perf top while running syscall-heavy workloads (for instance, installing packages can take orders of magnitude longer in a Docker container than it does with plain lxc or under KVM/virtio). This should be taken into account when interpreting benchmark results.

[edwaleni]

This is fantastic! Exactly what I was looking for. I will give it a run.

[Kekos]

great !! any link to the Dockerfile ?

[DrYak]

Also, has someone tried running this container it on cluster-firendly systems ?
(e.g.: on Singularity containers, etc.)

I would try eventually...

[Michael]

Also, has someone tried running this container it on cluster-firendly systems ?
(e.g.: on Singularity containers, etc.)

I would try eventually...

I haven't tried myself, but if Clear Linux works there then it should.... Anyhow, feedback and testing appreciated.

[browseria]

pts/encode-ogg-1.5.1:
Test Installation 3 of 6
3 Files Needed [3.4 MB / 1 Minute]
Test Profile Status: Deprecated
libogg-1.3.3.tar.gz must be manually placed in the Phoronix Test Suite download-cache.
libvorbis-1.3.5.tar.gz must be manually placed in the Phoronix Test Suite download-cache.
vorbis-tools-1.4.0.tar.gz must be manually placed in the Phoronix Test Suite download-cache.
Downloading of needed test files failed.

...

PostgreSQL pgbench 10.3:
pts/pgbench-1.8.4
Test 2 of 2
Estimated Trial Run Count: 3
Estimated Time To Completion: 43 Minutes [06:23 UTC]
Started Run 1 @ 05:40:45
The test run did not produce a result.
Started Run 2 @ 05:40:57
The test run did not produce a result.
Started Run 3 @ 05:41:09
The test run did not produce a result.
E: ERROR: relation "pgbench_branches" does not exist

[Michael]

pts/encode-ogg-1.5.1:
Test Installation 3 of 6
3 Files Needed [3.4 MB / 1 Minute]
Test Profile Status: Deprecated
libogg-1.3.3.tar.gz must be manually placed in the Phoronix Test Suite download-cache.
libvorbis-1.3.5.tar.gz must be manually placed in the Phoronix Test Suite download-cache.
vorbis-tools-1.4.0.tar.gz must be manually placed in the Phoronix Test Suite download-cache.
Downloading of needed test files failed.

...

PostgreSQL pgbench 10.3:
pts/pgbench-1.8.4
Test 2 of 2
Estimated Trial Run Count: 3
Estimated Time To Completion: 43 Minutes [06:23 UTC]
Started Run 1 @ 05:40:45
The test run did not produce a result.
Started Run 2 @ 05:40:57
The test run did not produce a result.
Started Run 3 @ 05:41:09
The test run did not produce a result.
E: ERROR: relation "pgbench_branches" does not exist

For the first error are you running without Internet? Ogg isn't one of the cached tests. You can see list-cached-tests to know what are cached locally. PostgreSQL should be there, would need to investigate via debug-run pgbench to see why it might be failing.

[blueweb]

Trying to benchmark with the 'hpcc' test produces this message:

Some additional dependencies are required, but they could not be installed automatically for your operating system.
Below are the software packages that must be installed.


Linear Algebra Pack
Possible Package Names: liblapack-dev, lapack, lapack-devel, liblapack-devel

The above dependencies should be installed before proceeding. Press any key when you're ready to continue.

How should the dependencies be installed?