DeepSparse 1.5 Released For Faster AI Inference On CPUs

[phoronix]

Phoronix: DeepSparse 1.5 Released For Faster AI Inference On CPUs

Neural Magic's DeepSparse AI inference runtime continues to pursue "GPU-class performance on CPUs" and with the new DeepSparse 1.5 release is delivering even faster performance for CPU inference...

https://www.phoronix.com/news/DeepSparse-1.5-Released

[pegasus]

Would be interesting to see how this compares to low power GPUs at inference ...