OpenVINO 2024.4 Prepares For Core Ultra Series 2, New Gen AI Models

Written by Michael Larabel in Intel on 19 September 2024 at 08:50 AM EDT. 1 Comment
INTEL
Intel engineers today released OpenVINO 2024.4 as the newest version of their open-source AI toolkit. OpenVINO 2024.4 prepares for upcoming Intel Core Ultra Series 2 "Lunar Lake" processors, supports newer Gen AI models, now supports Python 3.12, and finally adds official support for Red Hat Enterprise Linux 9.

OpenVINO 2024.4 adds support for the GLM-4-9B Chat, MiniCPM-1B, Llama 3 and 3.1, Phi-3-Mini, Phi-3-Medium and YOLOX-s models.

OpenVINO 2024.4 also expands its large language model (LLM) support with run-time optimizations for Xe Matrix Extensions (XMX) systolic arrays, memory sharing for Lunar Lake CPUs, a new PagedAttention feature for discrete GPUs, production-quality support for the OpenAI-compatible API, improved performance and memory consumption, Python 3.12 support, and support for RHEL9.

OpenVINO overview


Downloads and more details on the new OpenVINO 2024.4 AI toolkit release via GitHub.
1 Comment
Related News
Intel P-State Energy Aware Scheduling Patches Updated For Lunar Lake
Intel Lands "Round Robin Strict" Driver Optimization For Helping Battlemage/Xe2
Intel Looking To Raise SPIR-V Backend To Becoming An Official LLVM Target
Intel Panther Lake & Clearwater Forest Power Management Patches For Linux 6.14
Intel Begins Readying Graphics Driver Changes For The Linux 6.14 Kernel
UMD Direct Submission "Proof Of Concept" For The Intel Xe Linux Driver
About The Author
Michael Larabel

Michael Larabel is the principal author of Phoronix.com and founded the site in 2004 with a focus on enriching the Linux hardware experience. Michael has written more than 20,000 articles covering the state of Linux hardware support, Linux performance, graphics drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org automated benchmarking software. He can be followed via Twitter, LinkedIn, or contacted via MichaelLarabel.com.

Popular News This Week
OpenWrt Affected By Security Issue That Could Have Led To Compromised Build Artifacts
How AMD Is Taking Standard C/C++ Code To Run Directly On GPUs
Linux EFI Zboot Abandoning "Compression Library Museum", Focusing On Gzip & Zstd
Ptyxis Becomes Ubuntu's Recommended Replacement To GNOME Terminal
GNU Shepherd 1.0 Service Manager Released As "Solid Tool" Alternative To systemd
KDE Starts December By Landing A Number Of New Features
NTSYNC Linux Patches Revived To Help Boost Steam Play Gaming Performance
Rust-Based, Memory-Safe PNG Decoders "Vastly Outperform" C-Based PNG Libraries