Zstd 1.4.9 Released With ~2x Faster Performance For Long Mode

Written by Michael Larabel in Programming on 3 March 2021 at 03:57 PM EST. 12 Comments
PROGRAMMING
Zstd 1.4.9 is out today as the latest version of this implementation for the Facebook-led Zstandard lossless data compression algorithm. With Zstd 1.4.9 comes a very sizable speed-up when running in its long distance mode.

Zstd previously introduced the "--long" mode to analyze large quantities of data in a timely manner and suitable memory budget. The aim in this mode is to improve the compression ratio for files with long matches at a large distance. With Zstd 1.4.9 the long distance mode is much faster thanks to a number of optimizations that preserve the compression ratio while drastically speeding up the compression time. Test cases are showing this long distance mode being 114~154% faster than the prior point release of Zstd. These new algorithms for the long distance mode appear to be a big win based on all of the data published thus far.

The faster long distance mode is the main highlight of Zstd 1.4.9 but there is also a new experimental decompression feature allowing multiple calls to the Zstd refDDict, improved help message, and other changes.

Downloads and more details on Zstd 1.4.9 via GitHub. Our Zstd compression benchmark test profile is in the process of being updated against this latest release.
Related News
About The Author
Michael Larabel

Michael Larabel is the principal author of Phoronix.com and founded the site in 2004 with a focus on enriching the Linux hardware experience. Michael has written more than 20,000 articles covering the state of Linux hardware support, Linux performance, graphics drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org automated benchmarking software. He can be followed via Twitter, LinkedIn, or contacted via MichaelLarabel.com.

Popular News This Week