Announcement

Collapse
No announcement yet.

result-file-to-json: show all test arguments

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • result-file-to-json: show all test arguments

    Apologies if this is a known issue but I wanted to verify if this is expected output when using result-file-to-json.

    As seen below, when running pts/stream with batch-run on phoronix-test-suite 8.6.1, I see each test's type & iteration results:
    Code:
    # TEST_RESULTS_NAME=pts-stream-test TEST_RESULTS_IDENTIFIER=pts-stream-test TEST_RESULTS_DESCRIPTION=pts-stream-test phoronix-test-suite batch-run pts/stream
    
    Phoronix Test Suite v8.6.1
    System Information
    
      PROCESSOR:          Virtual 82d9ed4018dd
        Core Count:       2
        Extensions:       SSE 4.2 + AVX512CD + AVX2 + AVX + RDRAND + FSGSBASE
        Cache Size:       16384 KB
        Microcode:        0x1
    
      GRAPHICS:           Cirrus Logic GD 5446
        Screen:           1024x768
    
      MOTHERBOARD:        QEMU Standard PC
        BIOS Version:     rel-1.11.2-0-gf9626ccb91-prebuilt.qemu-project.org
        Chipset:          Intel 440FX 82441FX PMC
        Network:          Red Hat Virtio device
    
      MEMORY:             1 x 4096 MB RAM QEMU
    
      DISK:               79GB
        File-System:      ext4
        Mount Options:    data=ordered errors=remount-ro relatime rw
        Disk Scheduler:   none
    
      OPERATING SYSTEM:   Debian 9.8
        Kernel:           4.9.0-8-amd64 (x86_64)
        Compiler:         GCC 6.3.0 20170516
        System Layer:     qemu
        Security:         KPTI
                          + __user pointer sanitization
                          + Full generic retpoline
                          + PTE Inversion
    
    Test Identifier: pts-stream-test
    Test Description: pts-stream-test
    
    Stream 2013-01-17:
        pts/stream-1.3.1 [Type: Copy]
        Test 1 of 4
        Estimated Trial Run Count:    5
        Estimated Test Run-Time:      7 Minutes
        Estimated Time To Completion: 25 Minutes [17:08 UTC]
            Started Run 1 @ 16:44:00
            Started Run 2 @ 16:44:49
            Started Run 3 @ 16:45:34
            Started Run 4 @ 16:46:19
            Started Run 5 @ 16:47:04
    
        Type: Copy:
            18985.9
            18898.7
            18909.7
            18974.7
            19125.5
    
        Average: 18978.90 MB/s
        Deviation: 0.48%
    
    
    Stream 2013-01-17:
        pts/stream-1.3.1 [Type: Scale]
        Test 2 of 4
        Estimated Trial Run Count:    5
        Estimated Test Run-Time:      7 Minutes
        Estimated Time To Completion: 19 Minutes [17:06 UTC]
            Utilizing Data From Shared Cache @ 16:47:49
    
        Type: Scale:
            17373.9
            17533.1
            17616.7
            17471.6
            17102.4
    
        Average: 17419.54 MB/s
        Deviation: 1.14%
    
    Stream 2013-01-17:
        pts/stream-1.3.1 [Type: Triad]
        Test 3 of 4
        Estimated Trial Run Count:    5
        Estimated Test Run-Time:      7 Minutes
        Estimated Time To Completion: 13 Minutes [17:00 UTC]
            Utilizing Data From Shared Cache @ 16:47:50
    
        Type: Triad:
            20976.8
            20956.9
            20893.5
            21127
            20997.5
    
        Average: 20990.34 MB/s
        Deviation: 0.41%
    
    Stream 2013-01-17:
        pts/stream-1.3.1 [Type: Add]
        Test 4 of 4
        Estimated Trial Run Count:    5
        Estimated Time To Completion: 7 Minutes [16:54 UTC]
            Utilizing Data From Shared Cache @ 16:47:51
    
        Type: Add:
            20801.6
            20843.6
            20948.3
            20906.7
            20830.8
    
        Average: 20866.20 MB/s
        Deviation: 0.29%

    Moreover, when I export the results from pts-stream-test to a CSV using result-file-to-csv, I see each test's (Copy, Scale, Triad, Add) average results:
    Code:
    # phoronix-test-suite result-file-to-csv pts-stream-test
    
    pts-stream-test
    
     ,,"pts-stream-test"
    Processor,,Virtual 82d9ed4018dd (2 Cores)
    Motherboard,,QEMU Standard PC (i440FX + PIIX 1996) (rel-1.11.2-0-gf9626ccb91-prebuilt.qemu-project.org BIOS)
    Chipset,,Intel 440FX 82441FX PMC
    Memory,,1 x 4096 MB RAM QEMU
    Disk,,79GB
    Graphics,,Cirrus Logic GD 5446
    Network,,Red Hat Virtio device
    OS,,Debian 9.8
    Kernel,,4.9.0-8-amd64 (x86_64)
    Compiler,,GCC 6.3.0 20170516
    File-System,,ext4
    Screen Resolution,,1024x768
    System Layer,,qemu
    
     ,,"pts-stream-test"
    "pts/stream-1.3.1 - Copy",HIB,18978.90
    "pts/stream-1.3.1 - Scale",HIB,17419.54
    "pts/stream-1.3.1 - Triad",HIB,20990.34
    "pts/stream-1.3.1 - Add",HIB,20866.20

    However, when I export the results from pts-stream-test to JSON using result-file-to-json, I only see the last test's results; in this case, "Type: Add":
    Code:
    # phoronix-test-suite result-file-to-json pts-stream-test
    
    {
        "title": "pts-stream-test",
        "results": {
            "pts\/stream-1.3.1": {
                "arguments": "Type: Add",
                "units": "MB\/s",
                "results": {
                    "pts-stream-test": {
                        "value": "20866.20",
                        "all_results": "20801.6:20843.6:20948.3:20906.7:20830.8"
                    }
                }
            }
        }
    }

    Similar to result-file-to-csv, is there a way to show all the test arguments (Copy, Scale, Triad, Add) when using result-file-to-json?

  • #2
    Hi jbrand can you try latest PTS 8.8 Git? I think this issue I fixed up a few weeks ago, so if using any of the newer 8.8 development snapshots should be fine. Should be as easy as trying via:

    git clone https://github.com/phoronix-test-sui...test-suite.git
    cd phoronix-test-suite
    ./phoronix-test-suite result-file-to-json pts-stream-test
    Michael Larabel
    https://www.michaellarabel.com/

    Comment


    • #3
      Michael thank you, using PTS 8.8 resolved the issue:
      Code:
      ~/phoronix-test-suite# ./phoronix-test-suite version
      
      Phoronix Test Suite v8.8.0m2 (Hvaler)
      
      ~/phoronix-test-suite# ./phoronix-test-suite result-file-to-json pts-stream-test
      
      {
          "title": "pts-stream-test",
          "results": [
              {
                  "test": "pts\/stream-1.3.1",
                  "arguments": "Type: Copy",
                  "units": "MB\/s",
                  "results": {
                      "pts-stream-test": {
                          "value": "18978.90",
                          "all_results": "18985.9:18898.7:18909.7:18974.7:19125.5"
                      }
                  }
              },
              {
                  "test": "pts\/stream-1.3.1",
                  "arguments": "Type: Scale",
                  "units": "MB\/s",
                  "results": {
                      "pts-stream-test": {
                          "value": "17419.54",
                          "all_results": "17373.9:17533.1:17616.7:17471.6:17102.4"
                      }
                  }
              },
              {
                  "test": "pts\/stream-1.3.1",
                  "arguments": "Type: Triad",
                  "units": "MB\/s",
                  "results": {
                      "pts-stream-test": {
                          "value": "20990.34",
                          "all_results": "20976.8:20956.9:20893.5:21127:20997.5"
                      }
                  }
              },
              {
                  "test": "pts\/stream-1.3.1",
                  "arguments": "Type: Add",
                  "units": "MB\/s",
                  "results": {
                      "pts-stream-test": {
                          "value": "20866.20",
                          "all_results": "20801.6:20843.6:20948.3:20906.7:20830.8"
                      }
                  }
              }
          ]
      }

      Comment

      Working...
      X