Huawei's Bolt 1.5 Adds AVX-VNNI, Intel Desktop GPU Support

Written by Michael Larabel in Free Software on 6 April 2023 at 06:17 AM EDT. 1 Comment
Huawei's Bolt project is a deep learning library focused on high performance and heterogeneous flexibility and supporting a variety of neural networks. Bolt claims to outperform other deep learning acceleration libraries while supporting models from TensorFlow, ONNX, Caffe, and more.

With today's Bolt 1.5 release there is now support for AVX-VNNI instructions as well as formally adding support for the Armv9 architecture. Also on the new hardware support side, Intel desktop GPUs (Arc Graphics) are now supported by the Bolt library when using the Float16 or Float32 data types.

AI apps using Bolt examples

Bolt 1.5 also introduces a Python API, adds support for Windows on Arm builds, supports more neural networks and operators, model file compatibility enhancements, and improves the multi-threaded parallel inference performance on CPUs.

Downloads and more details on the Bolt 1.5 deep learning library via GitHub.
Related News
About The Author
Michael Larabel

Michael Larabel is the principal author of and founded the site in 2004 with a focus on enriching the Linux hardware experience. Michael has written more than 20,000 articles covering the state of Linux hardware support, Linux performance, graphics drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and automated benchmarking software. He can be followed via Twitter, LinkedIn, or contacted via

Popular News This Week