AMD Announces Milan-X 3D V-Cache CPUs, Azure Prepares For Great Upgrade

[jaxa]

With Milan-X there is now 3D V-Cache introduced for the current generation and still-very-impressive EPYC 7003 "Milan" processors. I can personally attest to Milan-X being very exciting for HPC workloads and beyond with impressive gains to performance.

AMD showed off a 5900X with 3D V-Cache (192 MiB) getting about +15% performance in games when they first announced it.

The performance gains with Epyc's larger implementation of 3D V-Cache (768 MiB) are much larger. +50% average according to AMD, no improvement in some workloads, but +66-80% in some cases.

[smitty3268]

AMD showed off a 5900X with 3D V-Cache (192 MiB) getting about +15% performance in games when they first announced it.

The performance gains with Epyc's larger implementation of 3D V-Cache (768 MiB) are much larger. +50% average according to AMD, no improvement in some workloads, but +66-80% in some cases.

Always take vendor supplied benchmarks with a big grain of salt. Many workloads are probably not going to see any gains from the larger cache. AMD generally doesn't outright cheat on tests the way Intel does, but they aren't above cherry picking which tests they run.

[jaxa]

Always take vendor supplied benchmarks with a big grain of salt. Many workloads are probably not going to see any gains from the larger cache. AMD generally doesn't outright cheat on tests the way Intel does, but they aren't above cherry picking which tests they run.

https://techcommunity.microsoft.com/t5/azure-compute/performance-amp-scalability-of-hbv3-vms-with-milan-x-cpus/ba-p/2939814

[yump]

AMD showed off a 5900X with 3D V-Cache (192 MiB) getting about +15% performance in games when they first announced it.

The performance gains with Epyc's larger implementation of 3D V-Cache (768 MiB) are much larger. +50% average according to AMD, no improvement in some workloads, but +66-80% in some cases.

It's not a larger implementation. 96 MiB on each chiplet, 32 on the lower deck and 64 on the upper. Times 2 is 192, times 8 is 768. Chiplets are probably binned for Ryzen or Epyc, but almost certainly manufactured identically.