I am attempting to use PTS 3.0.0 to benchmark a new server I got at work. This is a Dell R910 with 32 cores (64 with SMT which I have disabled for these tests), and 256GB of DDR3. I am running the universe-cli suite, as I do not intend to install a GUI on the system. I have run into several tests failing to run, and thought it might be good to report the errors here so that they may be fixed in a future version of PTS.
First off, two tests which fail with >8CPUs, mencoder & ffmpeg. Neither of these tests like it when you tell them to use more than 8 threads. As I mentioned above, the system I'm testing happens to have 32 cores, so using $NUM_CPU_CORES causes the tests to fail.
Next, compress-pbzip2 which as far as I can tell seems to work when I run the command line by hand, but tells me "The test did not produce a result" each time it runs. I think this is a timing issue (as in, the test isn't timed correctly, or assumes that the result will be greater than specific value and is throwing away the results because they're too fast?).
I also had an issue with a couple of Compile Bench tests, Compile and Read Compiled Tree, though the Initial Create test worked fine. I think this is a parsing error, as the results I get from running the test in debug mode seem to indicate that both the compile & the read tree worked correctly:
Next is mrbayes, which is another case of too many CPUs:
Finally, java-scimark2 FFT test failed as well. This appears to be another parsing error, as the test definitely produces results:
I hope that these reports are useful, and if any further information is required I will be happy to provide it.
First off, two tests which fail with >8CPUs, mencoder & ffmpeg. Neither of these tests like it when you tell them to use more than 8 threads. As I mentioned above, the system I'm testing happens to have 32 cores, so using $NUM_CPU_CORES causes the tests to fail.
Next, compress-pbzip2 which as far as I can tell seems to work when I run the command line by hand, but tells me "The test did not produce a result" each time it runs. I think this is a timing issue (as in, the test isn't timed correctly, or assumes that the result will be greater than specific value and is throwing away the results because they're too fast?).
I also had an issue with a couple of Compile Bench tests, Compile and Read Compiled Tree, though the Initial Create test worked fine. I think this is a parsing error, as the results I get from running the test in debug mode seem to indicate that both the compile & the read tree worked correctly:
Code:
run complete: ========================================================================== intial create total runs 10 avg 146.98 MB/s (user 0.59s sys 0.91s) no runs for create no runs for patch compile total runs 10 avg 792.47 MB/s (user 0.12s sys 0.74s) no runs for clean no runs for read tree read compiled tree total runs 3 avg 826.78 MB/s (user 0.38s sys 0.71s) no runs for delete tree delete compiled tree total runs 10 avg 0.95 seconds (user 0.25s sys 0.69s) no runs for stat tree no runs for stat compiled tree
Code:
The number of chains must be at least as great as the number of processors (32)
Code:
======================================== Java SciMark (Run 4 of 4) ======================================== Test Run Command: cd /home/thalin/.phoronix-test-suite/installed-tests/pts/java-scimark2-1.1.1/ && ./java-scimark2 TEST_FFT 2>&1 SciMark 2.0a Composite Score: 865.7334474774465 FFT (1024): 538.1797821272396 SOR (100x100): 963.7184161416388 Monte Carlo : 459.6497601801464 Sparse matmult (N=1000, nz=5000): 867.1650672662963 LU (100x100): 1499.954211671911 java.vendor: Sun Microsystems Inc. java.version: 1.6.0_20 os.arch: amd64 os.name: Linux os.version: 2.6.35-25-server Result Parsing Search Key: FFT (1024): Result Line: Composite Score: 865.7334474774465 Test Result Value: The test did not produce a result.
Comment