OpenZFS Could Soon See Much Better Deduplication Support
The OpenZFS project shared that data company Panzura will be opening up their "highly performant" temporal ZFS deduplication implementation.
At yesterday's #OpenZFS leadership meeting @PanzuraStorage announced that they will be open sourcing their highly perfomant temporal #ZFS dedup implementation
— OpenZFS on Linux (@OpenZFSonLinux) September 19, 2019
This is good news for OpenZFS performance assuming the dedup support is punctually opened up and is an acceptable state for quickly landing in this ZFS file-system code used by Linux with "ZFS On Linux" and in the process of by the likes of FreeBSD.
The ZFS file-system has supported data deduplication for the past decade. However, it's not widely recommended due to being very heavy on RAM usage as well as relatively taxing on the CPU, so it will be interesting to see just how effective is the Panzura implementation.
Panzure is a company specializing in data storage offerings. Panzura makes use of ZFS within the Panzura Distributed Cloud File-System, more details on that via this whitepaper.