result-file-to-json: show all test arguments

[jbrand]

Apologies if this is a known issue but I wanted to verify if this is expected output when using result-file-to-json.

As seen below, when running pts/stream with batch-run on phoronix-test-suite 8.6.1, I see each test's type & iteration results:

# TEST_RESULTS_NAME=pts-stream-test TEST_RESULTS_IDENTIFIER=pts-stream-test TEST_RESULTS_DESCRIPTION=pts-stream-test phoronix-test-suite batch-run pts/stream

Phoronix Test Suite v8.6.1
System Information

  PROCESSOR:          Virtual 82d9ed4018dd
    Core Count:       2
    Extensions:       SSE 4.2 + AVX512CD + AVX2 + AVX + RDRAND + FSGSBASE
    Cache Size:       16384 KB
    Microcode:        0x1

  GRAPHICS:           Cirrus Logic GD 5446
    Screen:           1024x768

  MOTHERBOARD:        QEMU Standard PC
    BIOS Version:     rel-1.11.2-0-gf9626ccb91-prebuilt.qemu-project.org
    Chipset:          Intel 440FX 82441FX PMC
    Network:          Red Hat Virtio device

  MEMORY:             1 x 4096 MB RAM QEMU

  DISK:               79GB
    File-System:      ext4
    Mount Options:    data=ordered errors=remount-ro relatime rw
    Disk Scheduler:   none

  OPERATING SYSTEM:   Debian 9.8
    Kernel:           4.9.0-8-amd64 (x86_64)
    Compiler:         GCC 6.3.0 20170516
    System Layer:     qemu
    Security:         KPTI
                      + __user pointer sanitization
                      + Full generic retpoline
                      + PTE Inversion

Test Identifier: pts-stream-test
Test Description: pts-stream-test

Stream 2013-01-17:
    pts/stream-1.3.1 [Type: Copy]
    Test 1 of 4
    Estimated Trial Run Count:    5
    Estimated Test Run-Time:      7 Minutes
    Estimated Time To Completion: 25 Minutes [17:08 UTC]
        Started Run 1 @ 16:44:00
        Started Run 2 @ 16:44:49
        Started Run 3 @ 16:45:34
        Started Run 4 @ 16:46:19
        Started Run 5 @ 16:47:04

    Type: Copy:
        18985.9
        18898.7
        18909.7
        18974.7
        19125.5

    Average: 18978.90 MB/s
    Deviation: 0.48%


Stream 2013-01-17:
    pts/stream-1.3.1 [Type: Scale]
    Test 2 of 4
    Estimated Trial Run Count:    5
    Estimated Test Run-Time:      7 Minutes
    Estimated Time To Completion: 19 Minutes [17:06 UTC]
        Utilizing Data From Shared Cache @ 16:47:49

    Type: Scale:
        17373.9
        17533.1
        17616.7
        17471.6
        17102.4

    Average: 17419.54 MB/s
    Deviation: 1.14%

Stream 2013-01-17:
    pts/stream-1.3.1 [Type: Triad]
    Test 3 of 4
    Estimated Trial Run Count:    5
    Estimated Test Run-Time:      7 Minutes
    Estimated Time To Completion: 13 Minutes [17:00 UTC]
        Utilizing Data From Shared Cache @ 16:47:50

    Type: Triad:
        20976.8
        20956.9
        20893.5
        21127
        20997.5

    Average: 20990.34 MB/s
    Deviation: 0.41%

Stream 2013-01-17:
    pts/stream-1.3.1 [Type: Add]
    Test 4 of 4
    Estimated Trial Run Count:    5
    Estimated Time To Completion: 7 Minutes [16:54 UTC]
        Utilizing Data From Shared Cache @ 16:47:51

    Type: Add:
        20801.6
        20843.6
        20948.3
        20906.7
        20830.8

    Average: 20866.20 MB/s
    Deviation: 0.29%

Moreover, when I export the results from pts-stream-test to a CSV using result-file-to-csv, I see each test's (Copy, Scale, Triad, Add) average results:

# phoronix-test-suite result-file-to-csv pts-stream-test

pts-stream-test

 ,,"pts-stream-test"
Processor,,Virtual 82d9ed4018dd (2 Cores)
Motherboard,,QEMU Standard PC (i440FX + PIIX 1996) (rel-1.11.2-0-gf9626ccb91-prebuilt.qemu-project.org BIOS)
Chipset,,Intel 440FX 82441FX PMC
Memory,,1 x 4096 MB RAM QEMU
Disk,,79GB
Graphics,,Cirrus Logic GD 5446
Network,,Red Hat Virtio device
OS,,Debian 9.8
Kernel,,4.9.0-8-amd64 (x86_64)
Compiler,,GCC 6.3.0 20170516
File-System,,ext4
Screen Resolution,,1024x768
System Layer,,qemu

 ,,"pts-stream-test"
"pts/stream-1.3.1 - Copy",HIB,18978.90
"pts/stream-1.3.1 - Scale",HIB,17419.54
"pts/stream-1.3.1 - Triad",HIB,20990.34
"pts/stream-1.3.1 - Add",HIB,20866.20

However, when I export the results from pts-stream-test to JSON using result-file-to-json, I only see the last test's results; in this case, "Type: Add":

# phoronix-test-suite result-file-to-json pts-stream-test

{
    "title": "pts-stream-test",
    "results": {
        "pts\/stream-1.3.1": {
            "arguments": "Type: Add",
            "units": "MB\/s",
            "results": {
                "pts-stream-test": {
                    "value": "20866.20",
                    "all_results": "20801.6:20843.6:20948.3:20906.7:20830.8"
                }
            }
        }
    }
}

Similar to result-file-to-csv, is there a way to show all the test arguments (Copy, Scale, Triad, Add) when using result-file-to-json?

[Michael]

Hi jbrand can you try latest PTS 8.8 Git? I think this issue I fixed up a few weeks ago, so if using any of the newer 8.8 development snapshots should be fine. Should be as easy as trying via:

git clone https://github.com/phoronix-test-sui...test-suite.git
cd phoronix-test-suite
./phoronix-test-suite result-file-to-json pts-stream-test

[jbrand]

Michael thank you, using PTS 8.8 resolved the issue:

~/phoronix-test-suite# ./phoronix-test-suite version

Phoronix Test Suite v8.8.0m2 (Hvaler)

~/phoronix-test-suite# ./phoronix-test-suite result-file-to-json pts-stream-test

{
    "title": "pts-stream-test",
    "results": [
        {
            "test": "pts\/stream-1.3.1",
            "arguments": "Type: Copy",
            "units": "MB\/s",
            "results": {
                "pts-stream-test": {
                    "value": "18978.90",
                    "all_results": "18985.9:18898.7:18909.7:18974.7:19125.5"
                }
            }
        },
        {
            "test": "pts\/stream-1.3.1",
            "arguments": "Type: Scale",
            "units": "MB\/s",
            "results": {
                "pts-stream-test": {
                    "value": "17419.54",
                    "all_results": "17373.9:17533.1:17616.7:17471.6:17102.4"
                }
            }
        },
        {
            "test": "pts\/stream-1.3.1",
            "arguments": "Type: Triad",
            "units": "MB\/s",
            "results": {
                "pts-stream-test": {
                    "value": "20990.34",
                    "all_results": "20976.8:20956.9:20893.5:21127:20997.5"
                }
            }
        },
        {
            "test": "pts\/stream-1.3.1",
            "arguments": "Type: Add",
            "units": "MB\/s",
            "results": {
                "pts-stream-test": {
                    "value": "20866.20",
                    "all_results": "20801.6:20843.6:20948.3:20906.7:20830.8"
                }
            }
        }
    ]
}