AMD Talks Up Open-Source Software For AI, Introduces Instinct MI300X

[phoronix]

Phoronix: AMD Talks Up Open-Source Software For AI, Introduces Instinct MI300X

Beyond launching Bergamo and Genoa-X, AMD's AI Day also showcased the new AMD-Pensando DPU offerings and also previewed more of their next-gen Instinct MI300 accelerator APU...

https://www.phoronix.com/news/AMD-Instinct-MI300X-AI

[deusexmachina]

Maybe consider open sourcing the thing that could give foreign entities a backdoor into every computer running AI first? Oh right, in too deep with the money printers and therefore their friends in intelligence agencies - so gotta keep those obfuscated! Like every influential security expert says, "security through obscurity isn't valid, unless it is the blackbox CPU running in your CPU!"

[dragorth]

Maybe consider open sourcing the thing that could give foreign entities a backdoor into every computer running AI first? Oh right, in too deep with the money printers and therefore their friends in intelligence agencies - so gotta keep those obfuscated! Like every influential security expert says, "security through obscurity isn't valid, unless it is the blackbox CPU running in your CPU!"

Is it AMD or Intel that is running a customized version of Minix for their CPU in a CPU?

[Krteq]

Intel's "Management Engine"... Nice shot

[Spacefish]

The real question here: Will they support RDNA in the ROCm Stack on launch day next time?

[zexelon]

The more real question is can you get this hardware?? Or is this another paper launch of hardware that is only going to some DoE super computer or some other singular mega customer?

[hartree]

The more real question is can you get this hardware?? Or is this another paper launch of hardware that is only going to some DoE super computer or some other singular mega customer?

You might be able to find them, but they're not really affordable. The MI210 is available for around €10k in Germany.

[qarium]

The more real question is can you get this hardware?? Or is this another paper launch of hardware that is only going to some DoE super computer or some other singular mega customer?

AMD claimed to have changed but i think any CDNA product is only for the super computer people.

the radeon RDNA3 cards for consumers all have the memory wall problem means 24GB vram is not enough for bigger AI modells.

the PRO cards of RDNA3 have 48GB vram... but as you can see in these new CDNA products with 128gb and 192gb vram the memory wall will hit you on 48gb vram very fast.

no normal consumer will buy such a 10 000€ CDNA card...

and it looks like the only AI AMDs try to support and promote is the AI cores of the new APUs and CPUs they want to sell to customers. similar to the AI unit intel now adds to their newest cpus. and apple M2 products also have AI units.

but all this is not CDNA...

[clementhk]

The more real question is can you get this hardware?? Or is this another paper launch of hardware that is only going to some DoE super computer or some other singular mega customer?

Well the company I work for need a model using our 200 internal books plus monthly internal magazine from dozens of years, and we don't want to leak our own data, so we need something like this. And I would imagine a lot of big companies need to train their own models with internal data. Also, with this much ram we could probably just load all the data in as prompt instead of fine tuning.

[Mathias]

Wake me up when I can `dnf install rocm-hip`, `apt-get rocm-hip` and download rocm-hip-setup.exe and 4 out of 5 ML tools support rocm in the standard installation.