Linux Driver Prepared For The Qualcomm Cloud AI 100 Accelerator

Written by Michael Larabel in Hardware on 15 May 2020 at 02:29 AM EDT. 2 Comments
HARDWARE
Announced over one year ago was the Qualcomm Cloud AI 100 Accelerator as designed for offering superior AI inference performance in the cloud. Since then not much has been heard of this accelerator but their engineers did publish a Linux driver on Thursday.

At least as of April 2019, Qualcomm believed their Cloud AI 100 offering could deliver 10x the perf-per-Watt of other inference solutions and would support PyTorch, TensorFlow, Keras, ONNX, and all the other popular deep learning solutions.

Qualcomm Cloud AI 100 was expected for H2'2019 while at least as far as upstream Linux kernel support is concerned the first patches were only published this week. In fact, while checking for any other recent activities on the Cloud AI 100 front I may have missed, most web references to it are dated back just from April 2019 when first announced.

A set of eight Linux kernel patches were posted on Thursday for enabling this PCI Express adapter card under Linux. Qualcomm's Jeffrey Hugo says their goal is to have "the product fully upstream" in the kernel so they began with an initial "request for comments" on the driver.

The Qualcomm Cloud AI driver is dependent on the recently introduced MHI bus for communication with the deep learning specialized SoC. The communication between kernel and user-space is done using a char device interface.

The initial kernel patches for supporting the Qualcomm Cloud AI accelerator can be found on the kernel mailing list. The patches are still in flux with additional feature work pending. At this point no open-source user-space patches appear to have been posted.
Related News
About The Author
Michael Larabel

Michael Larabel is the principal author of Phoronix.com and founded the site in 2004 with a focus on enriching the Linux hardware experience. Michael has written more than 20,000 articles covering the state of Linux hardware support, Linux performance, graphics drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org automated benchmarking software. He can be followed via Twitter, LinkedIn, or contacted via MichaelLarabel.com.

Popular News This Week