Benchmarks: FreeBSD 13 vs. NetBSD 9.2 vs. OpenBSD 7 vs. DragonFlyBSD 6 vs. Linux

[Volta]

Or why is it not mentioned that Bhyve is the fastest hypervisor currently?

Because your examples and claims doesn't make any sense. KVM eats bhyve for breakfast:

https://www.reddit.com/r/homelab/comments/9vz26t/hypervisor_performance_comparison/

If I may be honest, this is a collection of fairly meaningless benchmarks. Systems like FreeBSD, CentOS, Ubuntu, NetBSD etc are mostly used as web server or database.

They're more meaningful than the ones that you posted with software RAID on Linux vs ZFS.

[jacob]

If I may be honest, this is a collection of fairly meaningless benchmarks. Systems like FreeBSD, CentOS, Ubuntu, NetBSD etc are mostly used as web server or database.

Where did you get that from? Ubuntu in particular is used in anything from IoT and embedded systems to computation farms where these benchmarks are very meaningful.

Where are the Apache, NginX, PostgreSQL and Redis benchmarks? And where are the measurements of network performance?
We might then be able to see a different and more important reality:

Nginx Perfomace - FreeBSD vs CentOS (Under Heavy Load) https://www.youtube.com/watch?v=RGo4iyNwo_Y
PostgreSQL benchmark on FreeBSD, CentOS, Ubuntu Debian and openSUSE https://redbyte.eu/en/blog/postgresq...bian-opensuse/
FreeBSD/Ubuntu Dual Boot Homelab in The Bedroom by the bed testbed https://adventurist.me/posts/00307

Ah ok so that clears it up: you are a BSD fanboy. Go look at some more serious data and then there will be more to talk about.

Why does the article not mention anywhere that Docker is much more insecure than FreeBSD Jails and has already caused billions of dollars in cybercrime costs?

Because duh, the article is about performance benchmarks. Like all BSD zealots you also make the mistake to believe that Docker is somehow the Linux equivalent of FreeBSD jails. It isn't, Linux's jails are LXD and I'm not aware of any current security issues with it. As far as Docker is concerned I'd like to see a source of your claim about billions of dollars worth of cybercrime. At any rate yes it does tend to have more frequent security advisories than jails largely for a simple reason: unlike jails it is actually used in the real world and not just on hobby servers.

Or why is it not mentioned that Bhyve is the fastest hypervisor currently?

Because it isn't (and obviously you haven't posted any source for your claim).

[Classical]

Because your examples and claims doesn't make any sense. KVM eats bhyve for breakfast.

FreeBSD's Bhyve Overview: Why it's better than other hypervisors. At least for our use-case. https://www.youtube.com/watch?v=uV61mVYsFM8

The VMs start and stop much faster in Bhyve. KVM and Xen are much slower in this area. Bhyve is also seriously superior in the memory footprint.

They're more meaningful than the ones that you posted with software RAID on Linux vs ZFS.

Is that right?

There are currently +- 500 million NginX servers active. And even more Apache server. Have you noticed how much faster FreeBSD is in NginX compared to CentOS?

And do you know how many data centers exist on the planet? I think it is definitely more important that FreeBSD is 2x faster than Linux in PostgreSQL (the best SQL database).

A lot of Michael's benchmarks are eg Python related. This is a programming language that lacks several basic functions (https://medium.com/nerd-for-tech/pyt...ge-2ab73b0bda5) Python is less productive than Lisp, and has much lower performance than Lisp. If we look at how fast AI is growing, we can see that Python can no longer be used in this domain, since it is much slower than Lisp and Julia eg. You're just burning the earth if you continue to use Python for extremely energy-intensive things like AI and data science. A data center will draw significantly more power, and will therefore also need much more energy to stay cool. Python has to stop, or it will stop with humans..

That's why I say that many of Michael's benchmarks have little or no value.

[Classical]

As far as Docker is concerned I'd like to see a source of your claim about billions of dollars worth of cybercrime. At any rate yes it does tend to have more frequent security advisories than jails largely for a simple reason: unlike jails it is actually used in the real world and not just on hobby servers.

Take a look at this documentation: https://pdfhost.io/v/YSd79UGBC_dockerpdf.pdf

A report from McAfee estimated that global losses from cybercrime are expected to skyrocket to more than $6 trillion in 2021, according to a report produced by Cybersecurity Ventures.

Because it isn't (and obviously you haven't posted any source for your claim).

bhyve has by far the lowest memory footprint, and the start and stop times are in a different class than KVM and Xen.

[gugus]

Please remove zstd results from this report: You are comparing zstd 1.5 vs 1.4.x, where v1.5 brings huge performance performance improvement.

[ermo]

Please remove zstd results from this report: You are comparing zstd 1.5 vs 1.4.x, where v1.5 brings huge performance performance improvement.

Inasmuch as the benchmarks are showing performance as of the time of testing, you could argue that the benchmarks give a realistic picture of the real world performance you can expect with the respective zstd packages available ootb?

I do agree that an apples-to-apples zstd 1.5.x comparison would've been interesting though.

[dreich]

Please remove zstd results from this report: You are comparing zstd 1.5 vs 1.4.x, where v1.5 brings huge performance performance improvement.

No, he is comparing FreeBSD 13 vs. NetBSD 9.2 vs. OpenBSD 7 vs. DragonFlyBSD 6 vs. Linux

[Steffo]

Sorry for the seemingly ignorant question..

Is there a reason for not including Fedora?

Is Ubuntu just more recognized as a server OS?

(I would think more people could come up with Fedora as a server than Clear..)

Fedora has no LTS releases and is thus irrelevant for serious production servers. Fedora is a playground for Red Hat Linux in order to test new technologies. I'm writing this as a Fedora desktop user on my private PC.

[RedEyed]

Please remove zstd results from this report: You are comparing zstd 1.5 vs 1.4.x, where v1.5 brings huge performance performance improvement.

It's OS benchmark (with default packages) not package benchmark

[jacob]

Take a look at this documentation: https://pdfhost.io/v/YSd79UGBC_dockerpdf.pdf

A report from McAfee estimated that global losses from cybercrime are expected to skyrocket to more than $6 trillion in 2021, according to a report produced by Cybersecurity Ventures.

The two figures are unrelated. The McAfee report doesn't say that those global losses are due to docker; on the other hand your PDF lists a SMALL number of known issues that have been reported and addressed but nothing in here says that there would have been less incidents if all the Docker users were using jails instead (and for the umpteenth time, Docker is not jails and serves a different purpose. Linux has jails like FreeBSD and unrelated to that, it also has Docker).

Like any widely used tech, Docker has security vulnerabilities and there are much more reports of them than for something barely anyone uses in prod. You will find much less security disclosures about Minix than about Linux. By itself that doesn't imply that Minix is necessarily more secure, just that it's less used and less scrutinised.

bhyve has by far the lowest memory footprint, and the start and stop times are in a different class than KVM and Xen.

Only when running FreeBSD as a paravirtualised guest. In cases that actually matter, like running other OSes, the picture is very different (https://forums.freebsd.org/threads/b...rements.66977/).

The VM startup time is also not very relevant, what matters in a hypervisor is throughput and scalability. bhyve is not even in the same game as KVM.