Tuxera Claims NTFS Is The Fastest File-System For Linux

[locovaca]

ECC memory is supported on all AMD CPUs since socket 754 days, and only recently AMD started to screw consumers by dropping it from their Fusion parts. I think the majority of AM2/AM3/+ mobos support it too.

Small correction, Socket A Athlon MPs required ECC in some configurations.

[deanjo]

So is windows and any other human creation...

Lies! You have not tried my chicken noodle soup. NO SOUP FOR YOU!

[Apopas]

current linux is far from perfect .

So is windows and any other human creation...

[kraftman]

there are some linux fans near nervous-breakdown ....[*8
normal they use linux too much ...i joke a little but as shown the kernel power bug that Phoronix found and solved , current linux is far from perfect .
using things from big corporations like intel ,M$ ntfs , and the drivers they build . should be the top priority , at least untill linux is on 80% of all pcs [by now it s 5] , may be that will come . like there are distro , there will be kernels choice with proprietaries patents inside

There's a bug mainly, because of messed up bios. Ntfs is crap, so I guess nobody will use it on Linux. Maybe when he has to deal with dual boot, because Windows cannot handle Linux file systems (unless you install some third party tool). Linux is far from perfect, but Windows is farthest. I can only imagine how many patents winblows violates.

[kraftman]

You show some Oracle engineers talking about data corruption. You dont show any research. Of course, developers behind ReiserFS, NTFS, ext3 etc are also engineers, and they also tried to make ReiserFS, ext3 and NTFS safe. But they failed according to a PhD thesis. You show similar links: some Oracle engineers saying that they tried to do a filesystem safe. But maybe they also failed?

If the problem is resolved in the block layer it should probably make every native Linux file system safe from the silent data corruption. If the problem wasn't known before the PhD thesis it's obvious the file systems have failed in this matter. According to Oracle's blog post kernel was patched after the thesis. If there's no present thesis then it's matter of believing and conclusions.

Again: I dont know any research on ext4 - but lack of research does not prove ext4 is safe. You need to provide research that shows that ext4 can handle silent corruption. You show some talks about Oracle engineers saying they want to make Linux safe. Just as Reiser said. But he failed, ReiserFS is not safe, according to PhD thesis.

Like before: there were some changes aimed at the issue. Check this:

http://blogs.oracle.com/linux/entry/oracle_unbreakable_enterprise_kernel_and_emulex_hba_eliminate_silent_data_corruption

There's a white paper about sdc and Linux.

I want to see the same kind of research on your Linux links. But there are no research as I know of. So we have to wait, but until then I would use the Linux solution in your links (and hope that the Linux solution is safe), or I would use ZFS. But it is good that Oracle helps Linux to be safer.

I like this part.

[jcgeny]

there are some linux fans near nervous-breakdown ....[*8
normal they use linux too much ...i joke a little but as shown the kernel power bug that Phoronix found and solved , current linux is far from perfect .
using things from big corporations like intel ,M$ ntfs , and the drivers they build . should be the top priority , at least untill linux is on 80% of all pcs [by now it s 5] , may be that will come . like there are distro , there will be kernels choice with proprietaries patents inside

[kebabbert]

WHERE????!

I showed you the link, that proves that ext3 is not safe. Nor XFS, JFS, ReiserFS or NTFS is safe. Just read the link I posted for you. In the link there is a PhD thesis that shows that ext3 is not safe. If you look in the link, you can find the PhD thesis.

*1* Platter surface demagnetization errors! SMART detect this.
*2* Firmware errors! Contact or sue hardware vendor!
*3* Firmware errors! Same!
*4* RAID Hardware logic & xfer errors! Same, but for RAID card/controller/cables!
*5* RAM bit magnetization due to high density! Use ECC RAM, position RAM correctly - follow MB manufacturer recommendation, enclose hardware in grounded cages correctly!

Where is LINUX EXTx CORRUPTING YOUR DATA HERE?

You know, there are many more errors that those you listed. The problem is that ext3 does not catch all those errors. For instance, *2*, if there are firmware errors, then the filesystem should catch this. ext3 does not. The question is; is ext4 safer? We dont know, there is no research on ext4. But it seems that ext4 is safer.

Is filesystem DESIGNED to withstand all those errors? Hell, NO.
It is like blaming Joe from Los Angeles in Fukushima crisis! He is american, and americans delivered parts to Nippon, so he is responsible for nuclear meltdown! He is NOT. What is Joe responsible? To support his family and do it well! There is no point in giving every single Joe nuclear physician education to control the reactor either!

Yes. ZFS is designed to withstand all those errors, and many more. There is research team of computer scientists that do research on ZFS. Read the paper in my post above.

Projected to this "analysis", the file system should only do what filesystem should do - and do it well.

As Jeff Bonwick says: "The job of the file system is to make sure that the data you wrote is intact and the data you get from the filesystem, is the same and has not been altered. Funny though, most filesystems can not do this". Jeff Bonwick is the lead architect behind ZFS.

Detect file corruption - ext does data block and journal checksumming. Ntfs? I know only a way via hacks.
Prevent fragmentation - ext does this, designed with this priority. Ntfs does not do it and hence - speedups.
Correctly support operating system security requirements - ext does this.
Support for file requirements (timedate,name,reservations) - ext does this - and efficiently, unlike ntfs with MFT growing past 12-50% of partition size, without sane mechanism to change it.
Maintain consistency over power-down/cuts - ext does this and can do full data journaling, where ntfs does only metadata.
Badblocks - are not applicable to file system job, only in times of floppy disks. Nevertheless, ntfs tries to appy this in 21 century.

But still, research shows that ext3 is not safe. Neither is XFS, nor JFS nor ReiserFS. So, the engineers has not succeeded. Their solution is not safe enough.

The guys threw HUGE testing at HUGE capacity arrays. Of course errors would show up, but from those, none were of linux or ext origin. Or you have something else to tell?

A safe solution should catch all such errors. ZFS does.

Of course it does. It reports when first physical sector was remapped or when drive motor starts showing age. Sufficient for the desktop or workstation to replace the drive with the new one.

There are cases when SMART is not good enough. For instance, one power supply was bad, some 1 became 0 and vice versa. No one detected this. Except ZFS. Very quick, ZFS detected those errors. SMART did not notice.

Of course I know, happens ECC is only available and built for server mainboards,

In RAM memory sticks, some 1 might become 0, and vice versa. There are many reasons: power spikes, cosmic radiation, etc:

http://en.wikipedia.org/wiki/Dynamic_random_access_memory#Errors_and_error_correction

The reason we use ECC, is because ECC protects against some of these errors. The same errors happens to disk drives. For instance Bit Rot, after some years 1 might become 0, vice versa. Bugs in firmware, etc. A safe filesystem should catch all these errors and protect your data. Hardware raid does not protect your data. There is research on that.

SATA has many SAS functions in it and is sufficient for desktop usage. SAS is too complex and has operating environment not normally seen on desktop, like 24/7 massively parallel data exchange with very limited error correction time, multi-disk and hotswap support. For example, you do not do SAS with 1000x 1Gb drives at home, you buy one 1Tb drive instead.

I am trying to say that even high end safe, Enterprise SAS disks which costs much many says:
"every 10^16 bits, there will be errors that is not recoverable".
just read the spec sheet and you will see. Every 10^16 bits, there will be some read/write errors that are not recoverable nor repairable by the disk. And commodity SATA disks has much more errors than high end Enterprise server SAS disks.

[kebabbert]

It seems it's not the case in Linux:

No, I said something like "I dont know any RESEARCH on ext4, but lack of research does not prove that ext4 is safe".

You show some Oracle engineers talking about data corruption. You dont show any research. Of course, developers behind ReiserFS, NTFS, ext3 etc are also engineers, and they also tried to make ReiserFS, ext3 and NTFS safe. But they failed according to a PhD thesis. You show similar links: some Oracle engineers saying that they tried to do a filesystem safe. But maybe they also failed?

Again: I dont know any research on ext4 - but lack of research does not prove ext4 is safe. You need to provide research that shows that ext4 can handle silent corruption. You show some talks about Oracle engineers saying they want to make Linux safe. Just as Reiser said. But he failed, ReiserFS is not safe, according to PhD thesis.

http://blogs.oracle.com/linux/entry/webcast_eliminating_silent_data_corruption_in_linux

and this:
http://www.betanews.com/article/Orac...ion/1228243294

I agree this looks good for Linux. But I would like to see research on this, have the engineers succeeded or did they fail? But until I see research (maybe this solution is really bad? Or is it better than ZFS?) I would definitely use this Oracle solution. Or ZFS. I would avoid everything else if my data is important.

So it seems it was resolved in Linux even before ZFS.

ZFS is much older than this. ZFS was officially announced 2004 but was in development several years before.

One of your Linux link is from last year, 2010. The other link is almost from 2009 (December 2008). Thus, almost half a decade after Sun talked about ZFS and Silent Corruption, everyone else now today is aware of Silent Corruption and tries to develop solutions to protect against Silent Corruption. But is their solution as good as ZFS?

There is recent research on ZFS and Silent Corruption, showing that ZFS protects against all the different silent corruption scenarios the research team tried to provoke:

http://www.cs.wisc.edu/wind/Publications/zfs-corruption-fast10.pdf

Thus, initial research shows ZFS to be much safer than any other solution, because ZFS catched all artifically injected errors.

I want to see the same kind of research on your Linux links. But there are no research as I know of. So we have to wait, but until then I would use the Linux solution in your links (and hope that the Linux solution is safe), or I would use ZFS. But it is good that Oracle helps Linux to be safer.

[kraftman]

So the "block I/O data integrity infrastructure" automagically resolves all data corruption issues? I think not.

It's about sillent data corruption.

[chithanh]

So it seems it was resolved in Linux even before ZFS.

So the "block I/O data integrity infrastructure" automagically resolves all data corruption issues? I think not.

*1* Platter surface demagnetization errors! SMART detect this.
Of course I know, happens ECC is only available and built for server mainboards, although unofficially some asus boards seems to support it.
But its manufacturer job to make sure component does not break within its designed usage scenario.

SMART does not tell you if the sector which you just read is correct or corrupt.
ECC memory is supported on all AMD CPUs since socket 754 days, and only recently AMD started to screw consumers by dropping it from their Fusion parts. I think the majority of AM2/AM3/+ mobos support it too.
If you read the CERN article, you will notice that apart from the memory/firmware problem, all components worked within their specified error rates.