Intel Xeon 6980P "Granite Rapids" Linux Benchmarks

Written by Michael Larabel in Processors on 24 September 2024 at 11:00 AM EDT. Page 10 of 11. 83 Comments.
OpenVINO benchmark with settings of Model: Face Detection FP16-INT8, Device: CPU. Xeon 6980P 2P was the fastest.
OpenVINO benchmark with settings of Model: Person Detection FP16, Device: CPU. EPYC 9684X 2P was the fastest.
OpenVINO benchmark with settings of Model: Weld Porosity Detection FP16-INT8, Device: CPU. Xeon 6980P 2P was the fastest.
OpenVINO benchmark with settings of Model: Vehicle Detection FP16-INT8, Device: CPU. Xeon 6980P 2P was the fastest.
OpenVINO benchmark with settings of Model: Person Vehicle Bike Detection FP16, Device: CPU. Xeon 6980P 2P was the fastest.
OpenVINO benchmark with settings of Model: Machine Translation EN To DE FP16, Device: CPU. Xeon 6980P 2P was the fastest.
OpenVINO benchmark with settings of Model: Face Detection Retail FP16-INT8, Device: CPU. Xeon 6980P 2P was the fastest.
OpenVINO benchmark with settings of Model: Handwritten English Recognition FP16-INT8, Device: CPU. Xeon 6980P 2P was the fastest.
OpenVINO benchmark with settings of Model: Road Segmentation ADAS FP16-INT8, Device: CPU. Xeon 6980P 2P was the fastest.
OpenVINO benchmark with settings of Model: Person Re-Identification Retail FP16, Device: CPU. Xeon 6980P 2P was the fastest.

Thanks to Intel's OpenVINO AI toolkit being optimized for Advanced Matrix Extensions (AMX), this is an area where recent Intel Xeon processors outright dominate. With Granite Rapids the lead is expanded much more over AMD EPYC thanks to 128 cores per socket and ore core improvements with Granite Rapids as well as enjoying the MRDIMM memory bandwidth.

ONNX Runtime benchmark with settings of Model: GPT-2, Device: CPU, Executor: Standard. Xeon 6980P 2P was the fastest.
ONNX Runtime benchmark with settings of Model: Faster R-CNN R-50-FPN-int8, Device: CPU, Executor: Standard. Xeon 6980P 2P was the fastest.

Granite Rapids also exhibited strong performance with the ONNX Runtime.

Related Articles
Intel Xeon 6980P SNC3 vs. HEX Clustering Mode Performance
Intel Xeon 6980P vs. AMD EPYC Power Efficiency / Performance-Per-Watt Benchmarks
Intel Launches Xeon 6900P Series "Granite Rapids" Processors
AMD AGESA PI 1.2.0.2 Performance With The Ryzen 9 9950X On Linux
AMD Ryzen 5 9600X & Ryzen 7 9700X Linux Performance With 105 Watt cTDP
AWS Graviton4 vs. AmpereOne 192-Core Benchmarks For Leading AArch64 Server Performance