Hi! I've been searching for a while and haven't found anything around this topic.
For my current use case of the PTS, I would like to run the same test/suite in multiple instances of an AWS flavor. Having all those results, I would like to compare them against the averaging of another flavor.
An example to make it more clear:
I have a test suite (Suite A) with 2 tests.
I've read the documentation and test different options with no luck on finding something to achieve this. So, my question is:
Is there any way within the current solution to achieve this?
If not, could using the raw data of the tests results and averaging those myself give an ""accurate"" value?
Thanks in advance!
For my current use case of the PTS, I would like to run the same test/suite in multiple instances of an AWS flavor. Having all those results, I would like to compare them against the averaging of another flavor.
An example to make it more clear:
I have a test suite (Suite A) with 2 tests.
- I launch 10 "c4.xlarge" instances and run Suite A in all of them. This gives me 10 different results folders/composites/etc. I call this Run A
- I launch 10 "c5.large" instances and run Suite A in all of them. This gives me 10 different results folders/composites/etc. I call this Run B
I've read the documentation and test different options with no luck on finding something to achieve this. So, my question is:
Is there any way within the current solution to achieve this?
If not, could using the raw data of the tests results and averaging those myself give an ""accurate"" value?
Thanks in advance!
Comment