Microsoft ONNX Runtime 1.14 Released With A Big Intel AMX Performance Optimization

[phoronix]

Phoronix: Microsoft ONNX Runtime 1.14 Released With A Big Intel AMX Performance Optimization

Microsoft on Friday released version 1.14 of their ONNX Runtime, a cross-platform, high performance machine learning inferencing and training accelerator...

https://www.phoronix.com/news/ONNX-Runtime-1.14

[svenh]

A link is missing after the final word "via"?

[nicalandia]

ONNX 1.4 is not that optimized for Multi-threaded CPUs, here is the 7950X amost matching the 8490H

[Quackdoc]

for everyone considering onnx but worried about support, there is an onnx runtime called wonnx which is based on wgpu, meaning it supports DX12, Vulkan and metal, im not sure how good it is, but it does exist

[jacob]

I'm sure there will be plenty of the usual MS bashing soon, but this is actually good. And being MIT licensed means that it's compatible with virtually all FLOSS licences.

[rabcor]

So ONNX is made by microsoft, no wonder it's so fucking trash.