Ubuntu 21.10 Compressing Debian Packages With Zstd

[caligula]

"Facebook-developed Zstandard compression technology"

I'm pretty sure zstd was invented long before the developer was hired by FB.

[jacob]

Are there any benchmarks for this? Intuitively I would have thought that decompression times would be insignificant compared to download times (and the actual disk writes) and a slower but higher ratio compressor would thus lead to better performance overall?

[skeevy420]

I wonder if there'll ever be a dynamic Zstd dictionary framework for compressing packages based on the package's files + its sources or even a massive dictionary based on every package in the OS and its sources? The former could be something created per package that gets better each time the package updates and gets compressed again (like per package ccache) while the latter could be a project shared among the community as the Zstd Linux Packaging Dictionary.

I wonder how long it would take to index every Debian package and source file...and then repeat that process with Red Hat, Fedora, SUSE, Arch, Ubuntu, etc...and if that would even matter in regards to OS packaging efficiency.

[middy]

arch switched over to zstd back in december of 2019 for packages and for initramfs this year. really sped up decompression.

[shmerl]

Time for Debian to do it as well. Faster decompression times will be great.

[phoronix]

Phoronix: Ubuntu 21.10 Compressing Debian Packages With Zstd

It's coming three years later than originally planned but with Ubuntu 21.10 this autumn the Debian packages will now be compressed via Zstd for offering speedier decompression speeds...

https://www.phoronix.com/scan.php?page=news_item&px=Ubuntu-21.10-Zstd-Debs