OpenZFS Could Soon See Much Better Deduplication Support

[phoronix]

Phoronix: OpenZFS Could Soon See Much Better Deduplication Support

The OpenZFS file-system could soon be seeing better data deduplication support...

http://www.phoronix.com/scan.php?page=news_item&px=OpenZFS-Better-Dedup

[tildearrow]

Panzure is a company specializing in data storage offerings

Panzura or Panzure?

[aht0]

very nice

[gorgone]

My proxmox will love this. I have alot(10+) of debian containers ... this will massively reduce the size.

[k1e0x]

That's great.

Dedup would be really great if it worked and it was cheep. (like compression).

[darkbasic]

I already use zfs in lots of machines, but If this really works well without requiring a TB of ram then I'll probably switch all my installations from btrfs to zfs.

[starshipeleven]

Damn me and my timing, I just bought a Fujitsu rack server that can mount up to 768 GB of ECC RAM.

[discordian]

I already use zfs in lots of machines, but If this really works well without requiring a TB of ram then I'll probably switch all my installations from btrfs to zfs.

I am always getting mixed answers to how much ram openzfs needs (from atleast 8gb to not much unless you use specific features) . Have you it on some 1-2 GB systems?

[starshipeleven]

I am always getting mixed answers to how much ram openzfs needs (from atleast 8gb to not much unless you use specific features) . Have you it on some 1-2 GB systems?

It will work for home-sized arrays (a few TB)
https://serverfault.com/questions/74...ool-block-size
https://github.com/zfsonlinux/zfs/issues/5417
as long as you don't use dedup and L2ARC.

Having more RAM is better because it's used as cache, but you don't need that much RAM to just use ZFS.

Apart from that, there is a lot of legends and hearsay about heavy RAM usage/requirements coming from FreeNAS (FreeBSD) people that does not apply to OpenZFS (and soon will not apply to FreeNAS/BSD anymore too as they are migrating to OpenZFS codebase for their ZFS)
Pool block size in OpenZFS is huge if compared to Solaris and FreeBSD, and they have reduced massively the RAM requirement for L2ARC.

See my post and the answers here https://www.phoronix.com/forums/foru...15#post1112115

[dfyt]

I just want persistent cache.