AMD 4th Gen EPYC 9654 "Genoa" AVX-512 Performance Analysis

Moving back to more Intel software written to take advantage of AVX-512 that performs very well on AMD processors too... OpenVINO is up next for that wonderful open-source deep learning toolkit.

OpenVINO was commonly running at 2x the performance when AVX-512 was enabled, as is by default, for 4th Gen EPYC processors.

For some of the OpenVINO test cases there was higher power use with AVX-512 enabled runs, but still on a power efficiency basis was still being a positive net gain with Zen 4.

Microsoft's ONNX was also showing the benefit as well from Zen 4 AVX-512 use.