How to make test profile available for others?

[def-]

I have added a new test profile: https://openbenchmarking.org/test/def/ddnet It appeared under my username "def" instead of "pts". I assume "pts" is only for official test profiles?

Someone else wanted to use my profile and ran the command

[B]phoronix-test-suite benchmark def/ddnet[/B]

, but unfortunately this fails:

[PROBLEM] Invalid Argument: def/ddnet

.

What is the proper way to upload my test profile so that others can also use it and compare results?

[Michael]

If you run the command a second time it should work. The user experience / message could be improved, but basically for the first time accessing a new repository you need to basically run the command twice. That first command basically should initialize access to the repository but doesn't report it to the user. The second time then should make it work as seamless as all other tests....

Does that work for you then? If the test profile is stable and you are interested I can evaluate it for pulling into the official pts/ archive.

[def-]

Which command should be run twice? Running "phoronix-test-suite benchmark def/ddnet" twice still prints the same error for me.

> If the test profile is stable and you are interested I can evaluate it for pulling into the official pts/ archive.

It should be stable. I only tested it on Linux, but other platforms should be supported as long as libraries are available. It would be great if you could evaluate/help with putting it in pts/.

[Michael]

Hmm, will take a look regarding the error but after the second attempt should be working.

In any case, I have pulled it into pts/. I did make a few improvements, namely added the "SystemDependencies" tag with a few dependencies to check for to help allowing DDnet to build out of the box more easily... At least on the systems I tried so far, with those additions DDnet now builds nicely out of the box on Ubuntu with PTS and not having to worry about any dependencies manually. I also dropped the OpenGL 1.4 option since I don't really see that being of much use by benchmarkers.

In any case the updated copy is now available via pts/ and some data will begin accumulating on the page over the days ahead -

https://openbenchmarking.org/test/pts/ddnet-1.0.1

Thanks!

[def-]

Thanks, seems to work well!

[def-]

Actually there is a problem on higher performance machines. For the libframetime-output format that DDNet uses only large frametimes are used. Looking at the source code of pts all fast frametimes are ignored, is this intentional? https://github.com/phoronix-test-sui...rser.php#L1071

Should I switch DDNet to another format like csv-dump-frame-latencies?