AMX-FP8 Support Upstreamed Into LLVM For Intel Diamond Rapids

Written by Michael Larabel in Intel on 31 October 2024 at 06:43 AM EDT. Add A Comment
INTEL
Intel compiler engineer Feng Zou has upstreamed AMX-FP8 support into the LLVM compiler stack. This FP8 extension to the Advanced Matrix Extensions (AMX) is coming with next-gen Diamond Rapids processors alongside other new ISA extensions.

AMX-FP8 was disclosed this month in Intel's updated public documentation as one of the new capabilities to be introduced with next-gen Xeon "Diamond Rapids" processors. AMX-FP8 allows for FP8 tiles with Advanced Matrix Extensions.

AMX-FP8 with Diamond Rapids complements the earlier Granite Rapids additions of the AMX-FP16 extension as well as AMX-COMPLEX that added support for half-precision floating point complex numbers. With Diamond Rapids FP8 input now rounds out the BF16 / INT8 / FP16 support for AMX. Since its introduction in Sapphire Rapids, AMX has shown it can yield significant performance benefits for a variety of mostly AI-related software that is adapted to make use of the AMX instructions.

AMX-FP8 Intel documentation


This commit today to LLVM 20 Git adds the AMX-FP8 infrastructure and part of Intel's ongoing upstreaming of LLVM support for Diamond Rapids. The GCC upstreaming of new "-march=diamondrapids" ISA features also remains ongoing.
Related News
About The Author
Michael Larabel

Michael Larabel is the principal author of Phoronix.com and founded the site in 2004 with a focus on enriching the Linux hardware experience. Michael has written more than 20,000 articles covering the state of Linux hardware support, Linux performance, graphics drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org automated benchmarking software. He can be followed via Twitter, LinkedIn, or contacted via MichaelLarabel.com.

Popular News This Week