Updated Zstd Implementation For The Linux Kernel Coming Soon

Written by Michael Larabel in Linux Kernel on 29 September 2021 at 05:45 AM EDT. 8 Comments
While the Linux kernel is increasingly supporting the use of Zstd for various compression purposes, the current Zstd code within the kernel is out-of-date and efforts so far to re-base it against the closer to upstream Zstd state have been stalled. Fortunately, a new attempt at getting the Zstd code updated for the Linux kernel will be published soon.

There has been Linux kernel work to support Zstd compressed modules, Zstd compressed firmware, Zstd'ed kernel image, and work like Btrfs Zstd file-system compression. Zstandard is increasingly used throughout the open-source ecosystem for its speedy decompression capabilities and overall great design and performance.

While the kernel continues making use of Zstd, the existing in-kernel code is out-of-date while there was an effort by Zstd's Nick Terrell of Facebook to get that code updated from upstream and also make it more automatically-generated moving forward so the kernel's implementation can stay closer to upstream and in more maintainable shape. Sadly, that has been a mess and the effort ultimately stalled.

Fortunately, Nick Terrell shared he is working on a new patch series. He says to expect some action on this front soon, potentially in time for the next kernel merge window.

This in turn should get the kernel code into a state at least based on Zstd 1.5 and in turn deliver a nice performance upgrade to the kernel for functionality leveraging this compression algorithm. (See our Zstd compression benchmarks on OpenBenchmarking.org.)
Related News
About The Author
Michael Larabel

Michael Larabel is the principal author of Phoronix.com and founded the site in 2004 with a focus on enriching the Linux hardware experience. Michael has written more than 20,000 articles covering the state of Linux hardware support, Linux performance, graphics drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org automated benchmarking software. He can be followed via Twitter, LinkedIn, or contacted via MichaelLarabel.com.

Popular News This Week