AMD Has Open-Source Ryzen AI Demo Code - But Only For Windows

[phoronix]

Phoronix: AMD Has Open-Source Ryzen AI Demo Code - But Only For Windows

One of the most interesting aspects of the new AMD Ryzen 7040 series laptop processors is the new "Ryzen AI" capabilities with the new XDNA AI engine capabilities built into the SoC, leveraging IP from their Xilinx acquisition. Linux support details remain scarce but at least one of their (Windows) demos for showcasing Ryzen AI is open-source...

https://www.phoronix.com/news/AMD-Ryzen-AI-Open-Source-Demo

[Laughing1]

https://github.com/amd/RyzenAI-cloud-to-client-demo/issues/2

[tildearrow]

But why Windows when the majority of such loads happen on Linux........................

[jrch2k8]

But why Windows when the majority of such loads happen on Linux........................

I suspect AMD actual Linux capable personnel is very small and mostly focused on AMDGPU kernel coding which would help explain RoCm horror show and AMDVLK which i assume are done by teams on Windows and then kinda learning Linux enough to migrate it some time later.

[onlyLinuxLuvUBack]

Somebody please use chatgpt and rewrite the python to be linux only with rust

[brucethemoose]

Michael, if you are looking for an "AI benchmark," try running mlc-llm and/or llama.cpp. MLC will run an LLM on highly optimized Vulkan, and Llama.cpp will run it on CPU with SIMD intrinsics (with optional OpenCL offload that is, TBH, not good on IGPs). MLC in particular is comparable to the CUDA kernals I've seen on Nvidia GPUs, which is unusual for Vulkan inference.


There are other potential candidates, but few are so easy to set up and so "apples to apples" across vendors.

[brucethemoose]

But why Windows when the majority of such loads happen on Linux........................

This is not necessarily true. If you look at the communities running generative AI locally, most users (and some devs) are running Windows, though WSL is very common.


AMD is demoing more "Windowsy" things with Ryzen AI anyway, like face detection (face unlock) and object classification (sorting photos).

[brucethemoose]

https://github.com/amd/RyzenAI-cloud...-demo/issues/2

The linux driver is missing, but the backend looks like its "just" Vitis AI running an onnx model.

If anyone has a Xilinx FPGA, maybe they could change the config and try it out?

[NeoMorpheus]

But why Windows when the majority of such loads happen on Linux........................

Simple, they observed the blind devotion that Linux users have for nvidia even when they are hostile towards FOSS, so they are assuming that we respond better when ignored/abused.

[avis]

Meanwhile Google has presented a new JS engine for Chrome called Maglev which will make it a whole lot faster:

https://blog.chromium.org/2023/06/how-chrome-achieved-high-scores-on.htm

Michael

Maybe mention this on the front page, no?