Announcement

Collapse
No announcement yet.

Create own tests

Collapse
X
  • Filter
  • Time
  • Show
Clear All
new posts

  • Create own tests

    I want to create a own test to measure the performance of our internal Yocto build.
    Is there a guide how to create a own test? I cannot find anything on the internet.
    Thanks!

  • #2
    Unfortunately no guide right now, but would recommend by starting off modifying an existing test profile and working from there. Generally once you get the hang of things it's very easy to create new tests with a new test profile effectively being a bash script and XML files. If you have any questions feel free to post, I've covered some of the basics in other threads here too.
    Michael Larabel
    http://www.michaellarabel.com/

    Comment


    • #3
      Originally posted by ludwighuber
      Hi Michael,

      have you already got some time to look into this?

      Best Regards
      Ludwig
      Hi Ludwig,

      Looks good from a quick look, didn't try running it. Did it run fine for you?

      For making it a dependency, you could use the <ExternalDependencies> tag if adding mercurial entries to the different distributions at pts-core/external-dependencies/xml/* that should be easy to figure out when looking at it.

      Or there is the newer <SystemDependencies> route but that will only work on distributions supporting reverse package searches based upon file names.
      Michael Larabel
      http://www.michaellarabel.com/

      Comment


      • #4
        Originally posted by ludwighuber

        Hi Michael,

        for me the tests runs fine, when the dependencies are already installed.
        The <ExternalDependencies> tag should work, but the <SystemDependencies> tag seams to be ignored on my Kubuntu 16.04 machine.

        Another question: is it possible to generate a total performance score, to compare multiple systems? My manager don't wants to look at every single graph, he wants a comparable number of overall system performance and not multiple numbers.

        Best Regards
        Ludwig
        Do you have apt-file installed on your Kubuntu system? On Ubuntu/Debian systems, apt-file is needed for being able to do reverse-dependency searches. So if apt-file isn't present, PTS isn't able to efficiently determine what would provide the hg binary.

        At the moment there isn't some like 'global score', but you could take like the average geometric mean of all the different tests you are interested in or some other composite, but PTS makes no standard definition of that at the moment due to the diverse range of benchmarks available and everyone's use-case/workloads they are interested in being slightly different.

        Michael
        Michael Larabel
        http://www.michaellarabel.com/

        Comment

        Working...
        X