The AVX-512 Performance Advantage With AMD EPYC Bergamo

Written by Michael Larabel in Processors on 26 July 2023 at 03:30 PM EDT. Page 4 of 5. 85 Comments.
Neural Magic DeepSparse benchmark with settings of Model: NLP Document Classification, oBERT base uncased on IMDB, Scenario: Asynchronous Multi-Stream. AVX512 On was the fastest.
Neural Magic DeepSparse benchmark with settings of Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased, Scenario: Asynchronous Multi-Stream. AVX512 On was the fastest.
Neural Magic DeepSparse benchmark with settings of Model: CV Classification, ResNet-50 ImageNet, Scenario: Asynchronous Multi-Stream. AVX512 On was the fastest.
Neural Magic DeepSparse benchmark with settings of Model: NLP Text Classification, DistilBERT mnli, Scenario: Asynchronous Multi-Stream. AVX512 On was the fastest.
Neural Magic DeepSparse benchmark with settings of Model: NLP Token Classification, BERT base uncased conll2003, Scenario: Asynchronous Multi-Stream. AVX512 On was the fastest.

AVX-512 on Bergamo also helped the DeepSparse AI software.

OpenVINO benchmark with settings of Model: Face Detection FP16, Device: CPU. AVX512 On was the fastest.
OpenVINO benchmark with settings of Model: Person Detection FP16, Device: CPU. AVX512 On was the fastest.
OpenVINO benchmark with settings of Model: Person Detection FP32, Device: CPU. AVX512 On was the fastest.
OpenVINO benchmark with settings of Model: Vehicle Detection FP16, Device: CPU. AVX512 On was the fastest.
OpenVINO benchmark with settings of Model: Face Detection FP16-INT8, Device: CPU. AVX512 On was the fastest.
OpenVINO benchmark with settings of Model: Vehicle Detection FP16-INT8, Device: CPU. AVX512 On was the fastest.
OpenVINO benchmark with settings of Model: Machine Translation EN To DE FP16, Device: CPU. AVX512 On was the fastest.
OpenVINO benchmark with settings of Model: Weld Porosity Detection FP16-INT8, Device: CPU. AVX512 On was the fastest.
OpenVINO benchmark with settings of Model: Age Gender Recognition Retail 0013 FP16-INT8, Device: CPU. AVX512 On was the fastest.

AVX-512 also makes a dramatic difference for Intel's OpenVINO AI toolkit.


Related Articles
Intel Announces Gaudi 3 AI Accelerator, Intel Xeon 6 Brand
AMD Zen 4 vs. Zen 4C Performance, Zen 4C Core Scaling With Ryzen 5 8500G
Intel Core i3 14100 / i5 14500 vs. AMD Ryzen 5 8500G / 8600G In 500+ Benchmarks
AMD Ryzen 8500G / 8600G / 8700G Performance @ 35 Watt & 45 Watt cTDP
NVIDIA GH200 CPU Performance Benchmarks Against EPYC Zen 4 & Xeon Emerald Rapids
AMD Ryzen 5 8500G: A Surprisingly Fascinating Sub-$200 CPU