AMD ZenDNN 5.0 Software For AI Delivers "400% Performance Uplift"

Written by Michael Larabel in AMD on 27 January 2025 at 01:18 PM EST. 6 Comments
AMD
Released last November following the AMD 5th Gen EPYC "Turin" server processor launch was ZenDNN 5.0 as their deep neural network library optimized for EPYC/Ryzen processors. ZenDNN 5.0 is their updated version of their neural network library that is compatible with the APIs from Intel oneDNN/DNNL and in turn can be used with the likes of PyTorch. It turns out ZenDNN 5.0 is capable of delivering a 400% performance uplift over their prior ZenDNN software release on the same hardware.

While writing about ZenDNN 5.0 back in November the day it was released and then forgetting about it alongside all of the other exciting Linux benchmarking and testing like their AOCC 5.0 compiler, earlier this month AMD put out a blog post formally announcing the ZenDNN 5.0 software library. Not only do they talk up its Zen 5 / Turin CPU support but that ZenDNN 5.0 can provide a 400% performance uplift on average.

ZenDNN 5.0 400% performance


Earlier this month AMD engineer Shailen Sobhee outlined the ZenDNN 5.0 release and its ability to provide a 400% performance uplift. Testing across a range of models like Llama 2/3.1 compared to ZenDNN 4.2 yielded a 400% performance uplift on average. This was measured with the ZenDNN plug-in for PyTorch. There were also very nice gains over IPEX 2.4 as Intel's Extension for PyTorch.

ZenDNN 5.0 benchmarks versus ZenDNN 4.2


In addition to enabling 5th Gen AMD EPYC "Turin" / Zen 5 CPU support, ZenDNN 5.0 delivers on advanced auto-tuning for LLMs, INT4 weight-only quantization, new APIs for generative LLMs, and other optimizations.

More details on the ZenDNN 5.0 software release and its 400% performance uplift via the technical article on AMD Developer Central. I'll be working on some of my own ZenDNN 5.0 independent benchmarks as soon as time allows.
Related News
About The Author
Michael Larabel

Michael Larabel is the principal author of Phoronix.com and founded the site in 2004 with a focus on enriching the Linux hardware experience. Michael has written more than 20,000 articles covering the state of Linux hardware support, Linux performance, graphics drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org automated benchmarking software. He can be followed via Twitter, LinkedIn, or contacted via MichaelLarabel.com.

Popular News This Week