AMD Releases ROCm 5.7 GPU Compute Stack

[JEBjames]

Michael

Duplicated text...

This block of text is repeated in the article.

"AMD's release notes do note that ROCm 6.0 will be a breaking release that isn't backwards compatible with ROCm 5.x. ROCm 6.0 will split up the LLVM packages into more manageable sizes, there will be changes to the HIP Runtime API, rocRAND and hipRAND will be split into separate packages, and other fundamental changes."

[andre30correia]

my apu stop working with this realease, amd should invest more in this cuda alternative

[vegabook]

Funny thing is, the best alternative to Cuda is turning out to be Metal. Yeah yeah it's closed it's apple yada. But at this stage AMDs stack is _worse_ than closed. "Open, but unusable for less than 10 grand". So basically open-source gaslighting. Frankly I prefer "closed but affordable", not to mention pretty much works out the box.

You can fairly painlessly get ML models working quite well on it with all the major libraries supporting it (Tensorflow, Pytorch, even Jax). The Metal documentation is not bad at all. And the unified memory means that if you spend 3 grand or so on a 64GB ram Studio, you got the whole 64GB of RAM available to GPU making things like full fat Llama70b available without all the dual 3090/4090 shenanigans and quantization. Now it will run slower, sure, about 4x slower by my calc, but it's perfectly usable and great for fairly advanced proof-of-concept onsite, without having to spend a fortune on cloud instances.

Not writing off Intel yet btw. Lots of potential but it's not here yet.

[geerge]

Dropping MI50 are they off their rocker? Guess that means all Vega are on the way out. I take it RDNA is still in a piss poor shape. So the remaining cards that are well supported would be somewhere between bugger all and a trick of the light? I officially no longer care, they can't do a damn thing right.

[yump]

Don't judge. AMD's GPU compute customer is probably quite happy with this release.

[vegabook]

Don't judge. AMD's GPU compute customer is probably quite happy with this release.

lol I see what you did there.