Here are the results from our largest Linux file-system comparison to date. Using the soon-to-be-released Linux 2.6.38 kernel, on a SATA hard drive and solid-state drive, we benchmarked seven file-systems on each drive with the latest kernel code as of this past weekend. The tested file-systems include EXT3, EXT4, Btrfs, XFS, JFS, ReiserFS, and NILFS2.
Last month there were benchmarks on Phoronix looking at the multi-core scaling performance of multiple operating systems, including CentOS 5.5, Fedora 14, FreeBSD 8.1, and OpenIndiana b148. CentOS 5.5 uses the long-term Linux 2.6.18 kernel while Fedora 14 has the more recent Linux 2.6.35 kernel by default, but a number of users asked how the Linux 2.6.38 kernel would fair for multi-core scaling with the removal of the Big Kernel Lock and various other low-level improvements in this forthcoming kernel. Here are some benchmarks showing just that.
VirtualBox, the Sun/Oracle virtualization platform, has supported OpenGL acceleration and Direct3D acceleration within virtual machines for more than two years. When the host system has hardware GPU acceleration, OpenGL/Direct3D calls can be passed from the guest to the host when the VirtualBox guest driver is installed. There has been the Linux 3D support since VirtualBox 2.2 and was initially limited to OpenGL 1.4 support and in the summer of 2009 it turned to OpenGL 2.0. We had not delivered any early benchmarks as the initial support was too buggy, but even with the recently released VirtualBox 4.0, while the support is usable and stable for the most part, it is still far from being very efficient and will crash under some OpenGL software.
Matthew Tippett and I talked this weekend at the Southern California Linux Expo on the matter of making more informed Linux hardware choices. While Linux hardware support has come along way, it is not perfect and there are still shortcomings. However, with Phoronix Test Suite 3.0 and OpenBenchmarking.org, which were released in Los Angeles, we believe there are now the capabilities to dramatically enhance the Linux hardware and software experience. These freely available tools are not only a game-changer for Linux, but have the capabilities to impact how projects and organizations handle their Windows, Mac OS X, BSD, and Solaris testing as well.
Earlier this month benchmarks were published on Phoronix showing the GCC 4.6 compiler performance with AVX support under Intel's new Sandy Bridge processors that are the first to provide Advanced Vector Extensions support. The Core i5 2500K CPU performance is already great under Linux, but once more Linux software supports taking advantage of this latest cross-vendor instruction set, there will be even more speed-ups. While the Low-Level Virtual Machine does not yet have full support for taking advantage of the Advanced Vector Extensions support, in this article we are looking at how the latest development code for LLVM 2.9 and the Clang compiler are performing on Intel's Sandy Bridge in relation to GCC.
February has finally arrived. Later this month Phoronix Test Suite 3.0 "Iveland" and OpenBenchmarking.org will be officially unveiled from the Southern California Linux Expo during the talk entitled "Making Better Linux Hardware Choices" by myself and Matthew Tippett, the former ATI/AMD Linux Core Engineering Manager. Before the California Linux event, there may also be a public demonstration in Munich of this major Linux testing/benchmarking breakthrough. While the Phoronix Test Suite 3.0-Iveland software can currently be downloaded as beta, OpenBenchmarking.org is not yet publicly available nor have we said much about the project. What has been said though is that it will cause Linux benchmarking to change, it will likely cause a greater impact than Phoronix.com, may result in my editorial departure from Phoronix, and will change the way that you find Linux compatible hardware. Here though is a primer of some of what you can expect out of OpenBenchmarking.org when it becomes available late in the month.
Started by one of our readers more than a week ago was a compiler deathmatch for comparing the performance of GCC, LLVM Clang, PCC (the Portable C Compiler), TCC (Tiny C Compiler), and Intel's C Compiler under Arch Linux. This user did not stop there with compiling these different x86_64 code compilers, but he also went on to look at the compiler performance with different compiler flags, among other options. The results are definitely worth looking at and here are some more.
Last summer we delivered the news that a native ZFS file-system implementation for Linux was coming by an Indian company known as KQ Infotech where they leveraged the Lawrence Livermore National Laboratories ZFS Linux code, finished it off in some areas, and took care of the POSIX support. This ZFS Linux module was eventually released to a group of beta testers -- us included -- and we ran some ZFS Linux benchmarks back in November using the latest beta code. Since that point, however, KQ Infotech has made their ZFS Linux port publicly available and earlier this month they declared this work as stable via its general availability release. We have decided to benchmark this latest ZFS Linux code to see where the performance now stands against the EXT4, Btrfs, and XFS file-systems.
Last month we delivered our first benchmarks of the Amazon EC2 Cloud, but those initial tests were limited to just a few of their cloud computing instances due to failures with the Ubuntu EC2 operating system on their other compute instances. Earlier this month we then showed how the Amazon EC2 Micro was comparable to a Nokia N900 and Intel Atom, but now we have a more exhaustive comparison complete of all major Amazon Elastic Compute Cloud types. Using the Amazon Linux AMI operating system, we have run a plethora of performance benchmarks on the m1.small, m1.large, m1.xlarge, m2.xlarge, m2.2xlarge, m2.4xlarge, c1.medium, and c1.xlarge cloud computing instances.
The most common Linux file-systems we talk about at Phoronix are of course Btrfs and EXT4 while the ZFS file-system, which is available on Linux as a FUSE (user-space) module or via a recent kernel module port, gets mentioned a fair amount too. When it comes to the FreeBSD and PC-BSD operating systems, ZFS is looked upon as the superior, next-generation option that is available to BSD users. However, with the DragonFlyBSD operating system there is another option: HAMMER. In this article we are seeing how the performance of this original creation within the DragonFlyBSD project competes with ZFS, UFS, EXT3, EXT4, and Btrfs.
In December we published our first set of Amazon EC2 benchmarks for their Elastic Compute Cloud using Ubuntu EC2 and the different instances that were compatible. Now though we are in the process of carrying out a new set of benchmarks from Amazon's cloud that not only contains more tests, but using the official Amazon Linux AMI we tested nearly every instance type. Except what is missing are the results for the "micro" (the t1.micro API name) instance. Why? It is simply too slow and irregular.
With 2010 now coming to an end, what were the most popular Phoronix stories this year? For those curious about the most viewed articles and news posts on Phoronix in 2010, here's a list. Exclusive information on Valve's forthcoming Linux Steam client, photographs from my adventure to the Chernobyl Nuclear Disaster Site, and multi-OS benchmarks had dominated 2010.
In early November we delivered benchmarks of EXT4 vs. Btrfs on an early Linux 2.6.37 kernel as our latest round of tests comparing these two leading Linux file-systems. There were some changes in the Linux disk performance with these file-systems using the latest Linux kernel code, but overall it was not too interesting. However, as the Linux 2.6.37 kernel does introduce a new mount option for Btrfs, the space_cache option, we decided to explore its performance in today's article.
Linux gaming has a bright future ahead with the forthcoming Unigine games, successful indie campaigns, and many other Linux-native game titles being just out on the horizon. Right now though if you are a dedicated PC gamer looking to satisfy your entertainment appetite under Linux, more than likely you find yourself using the Wine program so that you can run many Windows programs under Linux. What is the performance impact though of using this method? In this article, we have a couple benchmarks comparing the performance of Wine, native Linux game binaries, and the native Microsoft Windows 7 Professional performance.
Oracle's been vigorously working on their VM VirtualBox 4.0 software and in just the past week they have delivered two public betas that bring a number of new features. Among the changes there is support for Intel HD audio / ICH9 to guest VMs, the concept of extension packs, user-interface improvements, support for limiting a virtual machine's CPU time and I/O bandwidth, 3D acceleration fixes for guests, and a great number of bug-fixes. How though is this updated Oracle/Sun virtualization platform comparing to the older VirtualBox 3.2 release and that of the upstream Linux KVM (the Kernel-based Virtual Machine) that most Linux distributions rely upon? Here are a number of benchmarks that seek to answer this very question.
Last month we reported on the 200 line Linux kernel patch that does wonders for improving the desktop responsiveness of the system. There was certainly much interest (over 100,000 views to both of our YouTube videos demonstrating the change) but this patch really didn't speed up the system per se but rather improved the desktop interactivity and reduced latency by creating task-groups per TTY so that the processes had more equal access to the CPU. There is though an entirely different patch-set now beginning to generate interest among early adopters that does improve the kernel performance itself in compute and memory intensive applications and it's the Transparent Hugepage Support patch-set. Here are our initial tests of the latest kernel patches that will hopefully be finding their way into the mainline Linux kernel soon.
Earlier this week I noted there's new Apple hardware in our labs being used to tighten up our Mac OS X support within the Phoronix Test Suite, OpenBenchmarking.org, Phoromatic, etc. However, in the middle of working on Iveland, I have been carrying out a few Mac OS X benchmarks comparing its performance under the 2010 Apple Mac Book Pro to other operating systems. With the Core i5 notebook being much faster than the past Apple Mac Minis used in comparisons like looking at their enhanced OpenGL stack and benchmarking Mac OS X against Linux and Windows 7, the results are more interesting and there's also a greater variety of testing possibilities now with the recent Phoronix Test Suite advancements. Next week there are some very interesting Apple-related benchmarks to be published, but before the weekend here are a few tests from this Apple Mac Book Pro looking at its power consumption under Mac OS X 10.6.5 and Ubuntu 10.10.
There is the first beta release of the Adobe 10.2 Flash Player now available for Microsoft Windows, Apple Mac OS X, and Linux platforms that brings a variety of improvements since the Flash Player 10.1 release from earlier this year. For Linux users this Adobe Flash update is quite important since it finally delivers GPU-based video acceleration support via their new Stage Video technology that is now supported on all platforms. Adobe's Stage Video offloads the entire video process to the GPU and in this article are some initial tests illustrating the benefits of this Flash update for Linux users.
A few weeks ago there were benchmarks of GCC, LLVM-GCC, DragonEgg, and Clang. In this compiler performance comparison the releases of GCC 4.2, 4.3, 4.4, 4.5, and a 4.6 development snapshot were benchmarked. On the LLVM side there was LLVM-GCC 4.2, DragonEgg with GCC 4.5 and LLVM 2.8, and then Clang with LLVM 2.8. This combination of eight open-source compilers were tested on three distinct Intel and AMD systems (even a 12-thread Core i7 Gulftown), but all of which were 64-bit capable and contained relatively high-end processors from their respective series. To complement this earlier article, available now are some new GCC/LLVM benchmarks but this time an older Intel Atom CPU was used to look at the 32-bit compiler performance on a slower, low-power netbook.
When Wayland started out in 2008 it was very difficult to build and run this lightweight, next-generation display server. Wayland leverages the very latest Linux graphics technologies and at that time all of Wayland's dependencies had to be patched or built from branched sources and Wayland even had its own EGL implementation at the time (Eagle) rather than Mesa and overall it was just a high barrier to entry. Wayland at that time also worked with only the open-source Intel driver, while now it can work with most any KMS / GEM / Mesa driver. It was not until recently that it became possible to build Wayland from mainline components beginning to ship in new Linux distributions, thereby making it much easier to experiment with the open-source display server. Now it's to a point where you can just run a simple script and be up and running with a Wayland Display Server in just minutes.
When publishing ATI Gallium3D benchmarks this week that compared the performance of the Radeon HD 4870 and Radeon HD 5770 graphics cards with this next-generation driver architecture to the classic open-source Mesa driver and AMD's high-performance proprietary Catalyst driver, the results were what one would mostly expect. The Gallium3D driver was faster than the classic Mesa driver in most tests, but both drivers seriously lagged behind the proprietary driver. Even on older generation ATI Radeon graphics cards this is the case. This though has led many to effectively ask, "what's keeping the open-source drivers from performing like the proprietary driver?" It all comes down to low-level optimizations as is discussed in this Phoronix Forums thread. There are very large development teams for the different Catalyst driver components within AMD and much of this work is shared across all platforms, but on the open-source Linux side there's very few paid full-time developers and just a number of part-time, community developers to cover the entire driver stack.
In August we delivered the news that Linux was soon to receive a native ZFS Linux kernel module. The Sun (now Oracle) ZFS file-system has long been sought after for Linux, though less now since Btrfs has emerged, but incompatibilities between the CDDL and GPL licenses have barred such support from entering the mainline Linux kernel. There has been ZFS-FUSE to run the ZFS file-system in user-space, but it comes with slow performance. There has also been work by the Lawrence Livermore National Laboratories in porting ZFS to Linux as a native Linux kernel module. This LLNL ZFS work though is incomplete but still progressing due to a US Department of Energy contract. It is though via this work that developers in India at KQ Infotech have made working a Linux kernel module for ZFS. In this article are some new details on KQ Infotech's ZFS kernel module and our results from testing out the ZFS file-system on Linux.
Last month I said what OpenBenchmarking.org is and how it should change the benchmarking / automated testing landscape once it's released in conjunction with Phoronix test Suite 3.0 "Iveland" early next year. I have also showed off the new graphing capabilities for this software and provided another update at the end of last month. Here now is another update with some more exciting details.
In recent weeks and months there has been quite a bit of work towards improving the responsiveness of the Linux desktop with some very significant milestones building up recently and new patches continuing to come. This work is greatly improving the experience of the Linux desktop when the computer is withstanding a great deal of CPU load and memory strain. Fortunately, the exciting improvements are far from over. There is a new patch that has not yet been merged but has undergone a few revisions over the past several weeks and it is quite small -- just over 200 lines of code -- but it does wonders for the Linux desktop.
Now that the Linux 2.6.37 kernel merge window is closed and this next major release is in the middle of its development cycle, we have new benchmarks to publish looking at the file-system performance of Btrfs and EXT4 compared to earlier releases. The Linux file-system performance is under constant evolution as shown by our five years of Linux kernel benchmarks and more recent file-system-focused articles such as looking at EXT4 and Btrfs regressions in Linux 2.6.36, solid-state drive Linux benchmarks, and even ZFS-FUSE benchmarks, among other similar articles.
LLVM 2.8 was released last month with the Clang compiler having feature-complete C++ support, enhancements to the DragonEgg GCC plug-in, a near feature-complete alternative to libstdc++, a drop-in system assembler, ARM code-generation improvements, and many other changes. With there being great interest in the Low-Level Virtual Machine, we have conducted a large LLVM-focused compiler comparison at Phoronix of GCC with versions 4.2.1 through 4.6-20101030, GCC 4.5.1 using the DragonEgg 2.8 plug-in, LLVM-GCC with LLVM 2.8 and GCC 4.2, and lastly with Clang on LLVM 2.8.
While we have conducted studies related to the Linux kernel performance in the past such as benchmarking up to twelve kernel releases, going out the door this morning are the results from the largest-ever Linux kernel comparison conducted at Phoronix, and very likely the largest ever of its kind regardless of source. Every major Linux kernel release from Linux 2.6.12, which was released in mid-2005, up through the latest Linux 2.6.37 development code was tested. This represents the past five years of the Linux kernel and shows how the performance has evolved over the past 25 stable kernel releases and the most recent 2.6.37 development kernel.
Phoronix Test Suite 3.0 (codenamed "Iveland") has been under heavy development for more than a month and there is still at least three more months left of work before this major release will be christened. Today though it is time to publicly share the first details (aside from those that learned about it in the Augustiner tent at Oktoberfest) for one of the new components to be making up a critical piece of the Phoronix Test Suite 3.0 platform: OpenBenchmarking.org.
With three laptops representing different generations of mobile hardware, we loaded up the past four stable releases of Fedora Linux plus the most recent Fedora 14 Alpha release and then carried out an arsenal of tests looking at how the battery power consumption rate has changed since 2008. If you are concerned at all about running Linux on your battery-powered mobile devices, this article is worth reading.
It's a pity Luca Barbieri or any Mesa / Gallium3D developers are not at Oktoberfest as they are deserving of more than a few Maß of Augustiner. In fact, today a new Gallium3D state tracker was pushed into Mesa and it's perhaps the most interesting state tracker for this open-source graphics driver architecture yet. It's a state tracker that exposes Microsoft's DirectX 10/11 API on Linux! And it's already working and can be hooked into Wine!
492 software articles published on Phoronix.