EXT4 & Btrfs Get Additional Fixes With Linux 5.1

[phoronix]

Phoronix: EXT4 & Btrfs Get Additional Fixes With Linux 5.1

Ted Ts'o sent in the main EXT4 feature pull request today for the Linux 5.1 kernel merge window while David Sterba sent in a secondary batch of Btrfs material...

http://www.phoronix.com/scan.php?page=news_item&px=EXT4-Btrfs-Linux-5.1-Fixes

[tildearrow]

Dedupe...

[geearf]

Is btrfs supporting dedupe natively now?

[treba]

Is btrfs supporting dedupe natively now?

What do you mean by natively? 'online' dedupe like zfs?

[geearf]

What do you mean by natively? 'online' dedupe like zfs?

I meant without using additional userspace tools, like autodefrag vs btrfs fi defrag.

[dreich]

for the time being it provides support for offline deduplication.

[elvis]

for the time being it provides support for offline deduplication.

I prefer offline deduplication. Online requires enormous amounts of memory and misses potential dedup opportunities when databases are cleared (typically after reboot, where the database is stored in RAM).

Tools like dupremove can be set to run on a schedule, use low disk priority, and store their databases on disk which allows even low-memory machines to efficiently dedup large volumes.

I'm an enterprise Oracle ZFS customer, and have requested they add userspace tools to do this. I'd rather my precious and expensive enterprise storage DRAM be used for cache to speed up IO, and not for storing dedup information.

[cynic]

I meant without using additional userspace tools, like autodefrag vs btrfs fi defrag.

There's an experimental branch of Lu Fengqi here https://github.com/littleroad/linux/tree/dedupe_latest , if you are brave enough to test it!

[geearf]

There's an experimental branch of Lu Fengqi here https://github.com/littleroad/linux/tree/dedupe_latest , if you are brave enough to test it!

I definitely am not

[cynic]

I definitely am not

It looks promising right now, but maybe not enough to be tested on a working machine!
I'm looking forward to give it a try on a test box as soon as I have some spare time.