The Incredible Performance & Power Efficiency Of AMD Zen 1 vs. Zen 4C

Written by Michael Larabel in Processors on 25 January 2024 at 03:00 PM EST. Page 6 of 7. 33 Comments.
Llama.cpp benchmark with settings of Model: llama-2-70b-chat.Q5_0.gguf. EPYC 8324P - Zen 4C was the fastest.
Llama.cpp benchmark with settings of Model: llama-2-70b-chat.Q5_0.gguf. EPYC 8324P - Zen 4C was the fastest.
Llama.cpp benchmark with settings of Model: llama-2-70b-chat.Q5_0.gguf. EPYC 8324P - Zen 4C was the fastest.
OpenVINO benchmark with settings of Model: Face Detection FP16-INT8, Device: CPU. EPYC 8534PN - Zen 4C was the fastest.
OpenVINO benchmark with settings of Model: Face Detection FP16-INT8, Device: CPU. EPYC 8324P - Zen 4C was the fastest.
OpenVINO benchmark with settings of Model: Person Detection FP16, Device: CPU. EPYC 8534PN - Zen 4C was the fastest.
OpenVINO benchmark with settings of Model: Person Detection FP16, Device: CPU. EPYC 8324P - Zen 4C was the fastest.
OpenVINO benchmark with settings of Model: Weld Porosity Detection FP16-INT8, Device: CPU. EPYC 8534PN - Zen 4C was the fastest.
OpenVINO benchmark with settings of Model: Person Vehicle Bike Detection FP16, Device: CPU. EPYC 8534PN - Zen 4C was the fastest.
OpenVINO benchmark with settings of Model: Handwritten English Recognition FP16-INT8, Device: CPU. EPYC 8534PN - Zen 4C was the fastest.
Neural Magic DeepSparse benchmark with settings of Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8, Scenario: Asynchronous Multi-Stream. EPYC 8534PN - Zen 4C was the fastest.
Neural Magic DeepSparse benchmark with settings of Model: NLP Token Classification, BERT base uncased conll2003, Scenario: Asynchronous Multi-Stream. EPYC 8534PN - Zen 4C was the fastest.
Neural Magic DeepSparse benchmark with settings of Model: BERT-Large, NLP Question Answering, Sparse INT8, Scenario: Asynchronous Multi-Stream. EPYC 8534PN - Zen 4C was the fastest.
Neural Magic DeepSparse benchmark with settings of Model: BERT-Large, NLP Question Answering, Sparse INT8, Scenario: Asynchronous Multi-Stream. EPYC 8324P - Zen 4C was the fastest.
TensorFlow benchmark with settings of Device: CPU, Batch Size: 16, Model: ResNet-50. EPYC 8324P - Zen 4C was the fastest.
TensorFlow benchmark with settings of Device: CPU, Batch Size: 16, Model: ResNet-50. EPYC 8324P - Zen 4C was the fastest.
TensorFlow benchmark with settings of Device: CPU, Batch Size: 16, Model: ResNet-50. EPYC 8324P - Zen 4C was the fastest.
PyTorch benchmark with settings of Device: CPU, Batch Size: 256, Model: ResNet-50. EPYC 8324P - Zen 4C was the fastest.
PyTorch benchmark with settings of Device: CPU, Batch Size: 256, Model: ResNet-50. EPYC 8324P - Zen 4C was the fastest.
PyTorch benchmark with settings of Device: CPU, Batch Size: 256, Model: ResNet-50. EPYC 8324P - Zen 4C was the fastest.

Back when AMD introduced EPYC Naples, AI wasn't nearly as prolific as it is today... Running AI workloads on Zen 1 is simply embarrassing while now with Zen 4(C) the performance is terrific and often outpacing Intel's wares. The huge difference in these workloads is thanks to Zen 4(C) adding AVX-512 support.


Related Articles