EXT4 & Btrfs Get Additional Fixes With Linux 5.1

[cynic]

The github link mentions some error "Failed to load latest commit information", presumably that's why the last commit is noted as June 2016? Doesn't instill much faith :|

Viewing the commit history tab, the 13 commits ahead mentioned are all there and specifically for the de-dupe. Committed at Nov 2018 but originally made back in 2016 from the looks of it(github or git often confuses me when it has variances in dates like that :\), so the last work on it was Nov 2018, and was applying the old 2016 commits/patches to the linux kernel around then(4.19/4.20 I think)? But no actual development since 2016.

probably it was a link to a branch that's no more
last release has been in october 2018. If you browse through the "branch" combo you'll find all the newest releases (which are, however 10 months old)

[polarathene]

There's an experimental branch of Lu Fengqi here https://github.com/littleroad/linux/tree/dedupe_latest , if you are brave enough to test it!

The github link mentions some error "Failed to load latest commit information", presumably that's why the last commit is noted as June 2016? Doesn't instill much faith :|

Viewing the commit history tab, the 13 commits ahead mentioned are all there and specifically for the de-dupe. Committed at Nov 2018 but originally made back in 2016 from the looks of it(github or git often confuses me when it has variances in dates like that :\), so the last work on it was Nov 2018, and was applying the old 2016 commits/patches to the linux kernel around then(4.19/4.20 I think)? But no actual development since 2016.

[geearf]

I'll wait for it to at least hit Linux, if not a few more releases down the line as it seems fairly new and dangerous.

[cynic]

I definitely am not

It looks promising right now, but maybe not enough to be tested on a working machine!
I'm looking forward to give it a try on a test box as soon as I have some spare time.

[geearf]

There's an experimental branch of Lu Fengqi here https://github.com/littleroad/linux/tree/dedupe_latest , if you are brave enough to test it!

I definitely am not

[cynic]

I meant without using additional userspace tools, like autodefrag vs btrfs fi defrag.

There's an experimental branch of Lu Fengqi here https://github.com/littleroad/linux/tree/dedupe_latest , if you are brave enough to test it!

[elvis]

for the time being it provides support for offline deduplication.

I prefer offline deduplication. Online requires enormous amounts of memory and misses potential dedup opportunities when databases are cleared (typically after reboot, where the database is stored in RAM).

Tools like dupremove can be set to run on a schedule, use low disk priority, and store their databases on disk which allows even low-memory machines to efficiently dedup large volumes.

I'm an enterprise Oracle ZFS customer, and have requested they add userspace tools to do this. I'd rather my precious and expensive enterprise storage DRAM be used for cache to speed up IO, and not for storing dedup information.

[dreich]

for the time being it provides support for offline deduplication.

[geearf]

What do you mean by natively? 'online' dedupe like zfs?

I meant without using additional userspace tools, like autodefrag vs btrfs fi defrag.

[treba]

Is btrfs supporting dedupe natively now?

What do you mean by natively? 'online' dedupe like zfs?