NVIDIA Announces Hopper H100, Grace CPU Superchips, Jetson Orin Developer Kit

[phoronix]

Phoronix: NVIDIA Announces Hopper H100, Grace CPU Superchips, Jetson Orin Developer Kit

Jensen Huang has just wrapped up his GTC Spring 2022 keynote and thus the embargo has lifted on several exciting announcements from NVIDIA. NVIDIA has a lot of interesting hardware and software to talk about at this "#1 AI developer conference" from the Hopper H100 to next year's Grace CPU Superchips to the Jetson Orin.

https://www.phoronix.com/vr.php?view=30993

[ezst036]

Are we still waiting for that big huge open source announcement from Nvidia from a few years back?

https://www.phoronix.com/scan.php?page=news_item&px=NVIDIA-Open-Source-GTC-20

https://www.phoronix.com/scan.php?page=news_item&px=NVIDIA-GTC-2020-5-October

[hoohoo]

1 exaflop TF32. I like! Too bad it will not come in a PCIe4/5 AIB form factor.

Also, 2 thots: funny it is nVidia not AMD promising to finally deliver an HPC "APU" type device; when a company anounces a super-anything shipping sometime in a wide window next year, keep your big grain of salt handy. I think that CPU might be great at logic and imteger but quite weak on the FP metric.

[numacross]

Too bad it will not come in a PCIe4/5 AIB form factor..

It will (page 15), but not at 700W TDP obviously

[tildearrow]

Are we still waiting for that big huge open source announcement from Nvidia from a few years back?

https://www.phoronix.com/scan.php?pa...-Source-GTC-20
https://www.phoronix.com/scan.php?pa...2020-5-October

That could have been nothing more than a PR stunt...

[Krteq]

It will (page 15), but not at 700W TDP obviously

...and it won't be 1000 TFLOP TF32 either

...a single H100 PCIe GPU efficiently provides 65% delivered performance of the H100 SXM5 GPU while consuming 50% of the power.

[theriddick]

Sounds like it will all be good for crypto mining....

[polarathene]

Orin looks really nice... if only nvidia would bother to update their platform with newer LTS kernels at the very least, and preferably the Ubuntu LTS base (they're still on 18.04 even with 22.04 just around the corner)... If Orin releases and they continue to stay on Ubuntu 18.04 base with 4.19 kernel...ugh it's like they don't want to increase sales.

[Linuxxx]

Are we still waiting for that big huge open source announcement from Nvidia from a few years back?

https://www.phoronix.com/scan.php?page=news_item&px=NVIDIA-Open-Source-GTC-20

https://www.phoronix.com/scan.php?pa...2020-5-October

Most likely nVidia did really plan to switch their driver over to a similar model of AMDGPU-Pro (integrated kernel driver + blobby user-space part).

However Daniel Vetter's tweet which publicly ridiculed them probably caused an egoistic change-of-heart, so they simply managed to bolt on GBM support to their current driver model & will carry on to do business as usual, which, from a financial perspective at least, seems to work out for nVidia just fine, quite frankly...

[vegabook]

Wait $1999 for the dev kit and $399 for the modules??

Is that a typo?

What am I getting for the 1600 difference? Just the case, power supply, and host board?

EDIT

Phoronix article on Jetson Orin is wrong. Here's a much better effort.

Bottom line: 64GB Jetson Orin module = 1599
Dev kit with 32GB module = 1999
Orin NX module (1/8th of RAM, quarter the performance): 399.