Intel Xeon Platinum 8490H "Sapphire Rapids" Performance Benchmarks

[crudeboil]

This is not a mainframe and Intel is not intending to replace them with these. For your use-case you wouldn't even need that many cores. These QAT accelerators are just for people who don't have a few hundred dollars for a superior DPU.

+once again regarding your last link: he did bench AI inference with AMX.

[sophisticles]

For your use-case you wouldn't even need that many cores. These QAT accelerators are just for people who don't have a few hundred dollars for a superior DPU..

So your theory is that a potential buyer of a 40 thousand dollar server does not have a few hundred bucks to buy a faster solution?

Hard to argue with the logic.

[crudeboil]

My theory is that nobody will buy these 8490H for QAT.

[willmore]

Michael (?) Typo on page 5: "2P match0-up."

[sophisticles]

My theory is that nobody will buy these 8490H for QAT.

Then you do not understand what QAT is nor the history of what made Intel a powerhouse.

Back in the day, there used to be what was known as Big Iron, powerful servers running UNIX, that consumed a lot of power, cost a ton of money and had used UNIX OSes that had extremely expensive per user licensing costs.

Wintel was born when Intel adopted the "fast enough" marketing campaign, the sold processors that were half as fast as the cpu's in these Big Iron servers, used a tenth of the power and cost a fraction of what the huge servers cost. MS for its part, released Windows version with relatively cost effective licensing terms, this Wintel partnership is what is credited with bringing Big Iron down.

Intel is clearly going down the same road again, these Xeons despite costing 17 grand each, are way cheaper than the minimum 500K to 3000K for the IBM Z15.

So the sales pitch is obvious, they are marketing a processor with 16 on-board accelerators, with the implication that a rack of dual xeon servers is still cheaper than the Z15 main frame.

The Z16's are another matter, supposedly they are so fast that they are actual quantum safe.

[nicalandia]

I wouldn't pay too much attention to that page, yet, due to its limited scope. It's only showing data where there is sufficient collection for each benchmark/configuration and other factors that refines it to only showing sound generalized results. As more benchmarks of the 8490H and other SPR results appear in the days/weeks/months ahead it will be much more relevant.

I am using the released data that you just published

2S 9374F(64C/128T) is beating a single 8490H even with the OpenVIMO AMX numbers.

image.png

AMD Genoa 2S 9374F vs 1P Intel Xeon SPR 8490H

[nicalandia]

...

Michael, why do you think there is a Huge performance difference in OpenVINO between the 1P and 2S 8490H?

image.png

image.png

image.png

[Mahboi]

Good article. But I think Michael you were being very charitable with the comments.

In Michael's defense, at this point Intel deserves our charity. Being rough with these Xeons may be akin to child beating.

[AdrianBc]

Some of Michael's reviews are great, some are so-so and some prove that he doesn't understand what he is reviewing.

This is one of those reviews.

He is given a high end, purpose built server, with two $17,000 Xeon Platinum 8490H, each with 16 dedicated accelerators, and he runs benchmarks like code compilation.

This is the equivalent of a car reviewer being given a Ford 350 Lariat Super Cab Long Box with a goose neck and doing 0-100-0, skid pad and slalom tests.

No one one is buying a Xeon Platinum 8490H to run any of the software bench marked in this review.

They are buying them to run specialized software that can benefit from the on-board accelerators.

Thus this whole review, any any others like it by other reviews, is basically a waste of time.

I think that it is you who does not understand the purpose of this review.

No individual or small business will waste money by buying 8490H CPUs, but many might buy some of the cheaper Sapphire Rapids models, e.g. 24-core SKUs.

Most Sapphire Rapids SKUs have most of the accelerators disabled, unless the owner chooses to pay for Intel on Demand, which makes sense only for big companies, like cloud vendors. So the Sapphire Rapids accelerators will be of no benefit for individuals or small businesses.

The employees of big companies do not care much about the benchmarks published here, because their companies can afford to buy or rent some samples of Sapphire Rapids systems on which to test exactly the applications in which they are interested.

On the other hand, individuals or small businesses cannot afford to spend thousands of $ for a Sapphire Rapids server, only to discover that it was not worth buying, so they are very interested in published benchmarks like these, especially in code compilation and computational benchmarks like those included in this review.

I am much more interested to see the same benchmarks from this review, but between Xeon 5412U ($1113) and Ryzen 7950X, but the results for 8490H and Genoa are still useful as a proxy enabling a very rough estimation of how those would compare, even if the estimation is hard, due to the great differences between the memory interfaces of Xeon and Ryzen.

[Keats]

As I said, it's obvious that Michael does not understand the purpose of these processors, but he is clearly not alone as evidenced by the comments from "crudeboil:".

The accelerators found on these chips have specific uses, in compression and decompressing, encryption and decryption, databases (analytics):

https://www.intel.com/content/www/us...analytics.html

https://www.intel.com/content/www/us.../overview.html

https://www.intel.com/content/www/us...-overview.html

https://www.intel.com/content/www/us...l#gs.mc7xob

The Xeon Platinum 8490H are Intel's answer to the processors found in IBM's Z15/16 servers, those processors are basically a collection of accelerators bound together with a general purpose cpu; the sole purpose of the cpu is to boot up the OS and initialize the peripherals, once that's done everything is handled by accelerators, encryption, decryption, math, I/O, compression, decompression, all of it, performed by accelerators, programmed using COBOL.

These Xeons are made for running custom software, much of it coded in Python, running libraries that can leverage the on-board accelerators.

The fact that Michael tested this server in the way he did, and then defending his test, tells me he doesn't understand the purpose of this system and frankly should never have been supplied with a test unit.

So what you're saying is that anyone who wants a general purpose CPU should just buy AMD?