AMD EPYC 9755 DDR5-4800 vs. DDR5-6000 Memory Performance

Written by Michael Larabel in Memory on 14 October 2024 at 10:45 AM EDT. Page 8 of 9. 3 Comments.
TensorFlow benchmark with settings of Device: CPU, Batch Size: 64, Model: ResNet-50. DDR5-6000 was the fastest.
TensorFlow benchmark with settings of Device: CPU, Batch Size: 64, Model: GoogLeNet. DDR5-6000 was the fastest.
TensorFlow benchmark with settings of Device: CPU, Batch Size: 256, Model: ResNet-50. DDR5-6000 was the fastest.
TensorFlow benchmark with settings of Device: CPU, Batch Size: 512, Model: ResNet-50. DDR5-6000 was the fastest.

TensorFlow was enjoying the faster DDR5-6000 memory performance with the higher batch sizes.

PyTorch benchmark with settings of Device: CPU, Batch Size: 64, Model: ResNet-50. DDR5-6000 was the fastest.
PyTorch benchmark with settings of Device: CPU, Batch Size: 64, Model: ResNet-152. DDR5-4800 was the fastest.
PyTorch benchmark with settings of Device: CPU, Batch Size: 512, Model: ResNet-50. DDR5-6000 was the fastest.

PyTorch similarly saw some benefit from the faster DDR5 memory performance.

OpenVINO benchmark with settings of Model: Face Detection FP16-INT8, Device: CPU. DDR5-4800 was the fastest.
OpenVINO benchmark with settings of Model: Person Detection FP16, Device: CPU. DDR5-6000 was the fastest.
OpenVINO benchmark with settings of Model: Weld Porosity Detection FP16-INT8, Device: CPU. DDR5-4800 was the fastest.
OpenVINO benchmark with settings of Model: Vehicle Detection FP16-INT8, Device: CPU. DDR5-6000 was the fastest.
OpenVINO benchmark with settings of Model: Machine Translation EN To DE FP16, Device: CPU. DDR5-6000 was the fastest.
OpenVINO benchmark with settings of Model: Handwritten English Recognition FP16-INT8, Device: CPU. DDR5-4800 was the fastest.
OpenVINO benchmark with settings of Model: Noise Suppression Poconet-Like FP16, Device: CPU. DDR5-6000 was the fastest.

The DDR5-6000 memory was also helping out some of the OpenVINO AI benchmarks.

Llamafile benchmark with settings of Test: wizardcoder-python-34b-v1.0.Q6_K, Acceleration: CPU. DDR5-6000 was the fastest.
Related Articles