CentOS Stream & Clear Linux Achieve Greater Performance On 4th Gen Xeon Scalable Sapphire Rapids, EPYC Genoa
For Microsoft's ONNX Runtime for AI, CentOS Stream 9 was performing very well and generally coming ahead of the others on both the AMD Genoa and Intel Sapphire Rapids servers.
The CPU power consumption wasn't all that different during the ONNX testing.
Intel's clear Linux distribution picked up its first win on Sapphire Rapids when it comes to the AI-driven Leela Chess Zero engine.
When it comes to the Ubuntu results, the benefits of the CPU frequency scaling "performance" governor continue to be quite clear and is unfortunate that Ubuntu Server (and a number of other prominent Linux desktop/server distributions) aren't defaulting to it on such hardware platforms.
In some workloads the AMD schedutil vs. performance governors difference isn't measurable but the default Intel P-State powersave versus performance governors is much more pronounced.