FreeBSD ZFS vs. ZoL Performance, Ubuntu ZFS On Linux Reference

[Markore]

Difference is arbitrary. In my eyes Illumos is as much Solaris as FreeBSD is BSD. It designates "family of OS'es" is all.

Good to know that you know better and confirm what you wrote is not factual.
Plus you wrote illumos with big "I" again , when you are clearly already said it is "illumos".

There are very good reasons brands are different, licenses are different, source models, distribution models ,compatibility, development models are different.

As you probably understand now, there are illumos distributions as are Linux distributions.
If you need to check family of OSes you simply can't just type Solaris for whole family of different distributions that are not Solaris anymore, but illumos.
Closest form before illumos time was "Opensolaris-derived" but that is something of the past now.

It is like you would say Linux is Unix, but it is not, it us Unix-like.
illumos on the other hand , as project evolved from OpenSolaris and Solaris 10 and illumos IS Unix System V family, the only one core OS that is open in that System V UNIX-derived branch.

When you say proprietary "Solaris" , you should expect binary compatibility of both drivers and software.
illumos moved to GCC compiler long time ago , not maintaining binary compatibility with Solaris and it is more in line with other free software projects.

[aht0]

Again illumos is not Solaris. Those are 2 different OSes and platforms. illumos is opensource and free software , Oracle Solaris is proprietary
You are obviously refusing to acknowledge illumos distros existence. Please write it in the sentence, it's not hard. It is typed with small "i": illumos .

Difference is arbitrary. In my eyes Illumos is as much Solaris as FreeBSD is BSD. It designates "family of OS'es" is all.

[Markore]

Test suite is open source. Feel free to test Linux_vs_bsd_vs_solaris out yourself. I am sure that extra 3-party content would be okay in Phoronix.

Again illumos is not Solaris. Those are 2 different OSes and platforms. illumos is opensource and free software , Oracle Solaris is proprietary
You are obviously refusing to acknowledge illumos distros existence. Please write it in the sentence, it's not hard. It is typed with small "i": illumos .

[aht0]

And this is what I call intentionally avoiding the issue. My comment is "illumos distros are out there to test and compare"
and you are talking about some other os..

Test suite is open source. Feel free to test Linux_vs_bsd_vs_solaris out yourself. I am sure that extra 3-party content would be okay in Phoronix.

[aht0]

What is that huge Linux - FreeBSD storage performance difference due to ?
In past I was used to see quite the opposite (Linux far ahead regardless filesystem), now maybe due to the new massive cpu security patches ?

FreeBSD has the same cpu security fixes applied.

[Markore]

Oracle Solaris is a free for testing and education- i.e. home use, but strictly prohibited from public benchmark. My own observation is its fastest zfs platform, no surprise. The big thing is not zfs itself but Solaris SMB and NFS fail sharing protocols.

And this is what I call intentionally avoiding the issue. My comment is "illumos distros are out there to test and compare"
and you are talking about some other os..

[gclarkii]

They use UFS because they don't care for data integrity at the server/VM level. They are using Amazon datacenters to store their media and virtual servers anyway.

First off, they have servers/systems all over the place. Some back end workloads are at Google, others are with Amazon, those run Linux of one flavor or another. They run FreeBSD on their Open Connect Appliance which are at their foundation are a type of file server cache, think Squid on steroids.
Second, if I'm running a network/file cache, I'm not really worried about integrity so much as I am speed. Plus I can't remember the last time I had a disk die with ZERO warning, S.M.A.R.T. starts bitching long before it actually does die. I will admit however that I've only had 80 - 90 disks working for me over the last 5 years, someone from a server farm company might have seen instant death somewhere. That said, the OCA's are under constant monitoring; If a disk shows problems, they cut it out of the cache, and replace it with a spare. It's a cache, it will rebuild itself over the next couple of rebuilds. That is why they are running UFS, pure speed. On the other hand, I'm almost willing to bet they are running some type of mirroring/redundancy for the system drive.

As far as I know, their back end runs Linux of whatever flavor and so talking about AWS in regard to FreeBSD does not make sense. The way that last part sounds to me is that your saying the UFS usage does not matter as it all runs on AWS anyway, but it does not. Yes, the master content servers is at AWS, but it is the OCA's(which are FreeBSD based), which carry the heavy load for content distribution. And yes, every so often some knothead claims the OCA's no longer run FreeBSD, but as of February of 2019, they still do.

Take a look at the 2019 FOSDEM talk slides which shows one of their 40Gb/s Open Connect Appliances(with 249TB of storage). Talk about a file server from hell.
And if you really want to go fast, how about hitting 90Gb/s+ with TLS traffic. That thing blows the above OCA away. And they all run FreeBSD.

[Dedobot]

Where is the freaking illumos on the charts??? WTH?? SmartOS, OmniOS, Dilos, Openindiana.. OpenZFS..
Comparison with Solaris 11 proprietrary ZFS...
Very bad guys to intentionally FORGET form where Zfs came from..

Oracle Solaris is a free for testing and education- i.e. home use, but strictly prohibited from public benchmark. My own observation is its fastest zfs platform, no surprise. The big thing is not zfs itself but Solaris SMB and NFS fail sharing protocols.

[scineram]

They use UFS because they don't care for data integrity at the server/VM level. They are using Amazon datacenters to store their media and virtual servers anyway.

Where they do use ZFS. On Linux.

[Ironmask]

Where is the freaking illumos on the charts??? WTH?? SmartOS, OmniOS, Dilos, Openindiana.. OpenZFS..
Comparison with Solaris 11 proprietrary ZFS...
Very bad guys to intentionally FORGET form where Zfs came from..

Hey, where's the Xenix benchmarks? That was the first big UNIX product that made it an industry standard. Pretty bad they got to benchmark the origin of UNIX in the industry huh?