Zstd 1.3.5 Released With Greater Dictionary Compression Performance

[phoronix]

Phoronix: Zstd 1.3.5 Released With Greater Dictionary Compression Performance

The Facebook developers working on the Zstandard "Zstd" compression technology released their latest update a few days ago, v1.3.5 that is codenamed the "Dictionary Edition" given its dictionary compression performance improvements...

http://www.phoronix.com/scan.php?page=news_item&px=Zstd-1.3.5-Released

[arjan_intel]

Since you have a pts/ test for zstd... I'm curious how 1.3.4 and 1.3.5 compare in performance across a range of compression levels.... could be a fun article

[Michael]

Since you have a pts/ test for zstd... I'm curious how 1.3.4 and 1.3.5 compare in performance across a range of compression levels.... could be a fun article

Results actually rather mixed with at least the reference file: http://openbenchmarking.org/result/1...PTS-ZSTDCOMP90

[treba]

I'd actually love to see how zstd compares to lzo as btrfs option now. The last test I'm aware of was the attached one from last november. zstd 1.3.4 and 1.3.5 both brought big performance enhancements, so I'd guess the numbers are even more in favour of it now.

[log0]

Results actually rather mixed with at least the reference file: http://openbenchmarking.org/result/1...PTS-ZSTDCOMP90

I think they've been tweaking the compression levels. So that is probably expected.

[treba]

I'd love to see btrfs benchmarks. 1.3.4 and 1.3.5 both brought big performance improvements, so probably the numbers changed quite a bit from the last one

[Weasel]

This would be good for zram (4k pages), if it actually supported zstd, I don't know why they can't just add it to the crypto API.

[waxhead]

I really miss the XPK libraries from the good old Amiga times. One general interface to compression and all compressors and decompressors was plugins that was stored in a directory. This means that your 10 year old program could easily support a modern packer once available as all the program needed to support was XPK. I wish that more people saw the genius of the old days.

[scix]

This would be good for zram (4k pages), if it actually supported zstd, I don't know why they can't just add it to the crypto API.

It's supported since 4.18-rc1. You also need a recent version of util-linux.

[Weasel]

It's supported since 4.18-rc1. You also need a recent version of util-linux.

That's great, but what do you need util-linux for? I setup my zram devices purely with /sys, do I still need util-linux?