With the recent look at the major Linux power regressions taking place within the Linux kernel, some initially wondered if the increase in power consumption was correlated to an increase in system performance. Unfortunately, it is clear now that is not the case. With that said though, here's some performance benchmarks of all major kernel releases going back to Linux 2.6.24 and ending with the Linux 2.6.39 kernel.
Recently there were benchmarks on Phoronix looking at the Ubuntu 11.04 boot performance relative to past Ubuntu Linux releases. This was done with five mobile systems and going back as far as Ubuntu 8.04. The tests showed around Ubuntu 10.04 LTS was where the boot performance in Ubuntu's been the best but Ubuntu 10.10 and 11.04 have slowed down a bit in how fast it's reaching the desktop. In this article we are looking at the boot performance when simply changing out the kernels. Every kernel from Linux 2.6.24 to 2.6.39-rc4 was analyzed.
Matthew Tippett and I presented at the 2011 Linux Foundation Collaboration Summit today in San Francisco about benchmarking and continuous testing of LLVM and the sub-projects that depend upon this compiler infrastructure. As the slides are somewhat generic and can be applied to many other open-source projects, the slides are now available. It's basically how to leverage the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org for driving continuous benchmarking to monitor performance regressions.
Version 4.6 of GCC was released over the weekend with a multitude of improvements and version 2.9 of the Low-Level Virtual Machine is due out in early April with its share of improvements. How though do these two leading open-source compilers compare? In this article we are providing benchmarks of GCC 4.5.2, GCC 4.6.0, DragonEgg with LLVM 2.9, and Clang with LLVM 2.9 across five distinct AMD / Intel systems to see how the compiler performance compares.
Version 2.9 of the Low-Level Virtual Machine is set to be released in a little more than a week, but what will it mean much for users in terms of performance? We will be looking at the LLVM 2.9 and Clang performance in the coming days (along with GCC 4.6, which was just released). We are beginning this weekend by providing a look at how using LLVM 2.9 affects the performance of the Mesa Gallium3D LLVMpipe driver relative to the previous LLVM 2.6, 2.7, and 2.8 releases.
While the performance of the Btrfs file-system with its default mount options didn't change much with the just-released Linux 2.6.38 kernel as shown by our large HDD and SSD file-system comparison, this new kernel does bring LZO file-system compression support to Btrfs. This Oracle-sponsored file-system has supported Gzip compression for months as a means to boost performance and preserve disk space, but now there's support for using LZO compression. In this article we are looking at the Btrfs performance with its default options and then when using the transparent Zlib and LZO compression.
There have been a flurry of comments this week following my post why software defaults are important and why in the Linux benchmarks at Phoronix.com the tests are most often carried out in their default/stock configurations: it's what most everyone uses. There have been comments by Ted Ts'o on file-system default mount options and whether they are sane or not in the non-enterprise distributions and others have questioned if defaults like Compiz on in Ubuntu by default makes sense. Does using Compiz still hurt your graphics performance?
Here are the results from our largest Linux file-system comparison to date. Using the soon-to-be-released Linux 2.6.38 kernel, on a SATA hard drive and solid-state drive, we benchmarked seven file-systems on each drive with the latest kernel code as of this past weekend. The tested file-systems include EXT3, EXT4, Btrfs, XFS, JFS, ReiserFS, and NILFS2.
Last month there were benchmarks on Phoronix looking at the multi-core scaling performance of multiple operating systems, including CentOS 5.5, Fedora 14, FreeBSD 8.1, and OpenIndiana b148. CentOS 5.5 uses the long-term Linux 2.6.18 kernel while Fedora 14 has the more recent Linux 2.6.35 kernel by default, but a number of users asked how the Linux 2.6.38 kernel would fair for multi-core scaling with the removal of the Big Kernel Lock and various other low-level improvements in this forthcoming kernel. Here are some benchmarks showing just that.
VirtualBox, the Sun/Oracle virtualization platform, has supported OpenGL acceleration and Direct3D acceleration within virtual machines for more than two years. When the host system has hardware GPU acceleration, OpenGL/Direct3D calls can be passed from the guest to the host when the VirtualBox guest driver is installed. There has been the Linux 3D support since VirtualBox 2.2 and was initially limited to OpenGL 1.4 support and in the summer of 2009 it turned to OpenGL 2.0. We had not delivered any early benchmarks as the initial support was too buggy, but even with the recently released VirtualBox 4.0, while the support is usable and stable for the most part, it is still far from being very efficient and will crash under some OpenGL software.
Matthew Tippett and I talked this weekend at the Southern California Linux Expo on the matter of making more informed Linux hardware choices. While Linux hardware support has come along way, it is not perfect and there are still shortcomings. However, with Phoronix Test Suite 3.0 and OpenBenchmarking.org, which were released in Los Angeles, we believe there are now the capabilities to dramatically enhance the Linux hardware and software experience. These freely available tools are not only a game-changer for Linux, but have the capabilities to impact how projects and organizations handle their Windows, Mac OS X, BSD, and Solaris testing as well.
Earlier this month benchmarks were published on Phoronix showing the GCC 4.6 compiler performance with AVX support under Intel's new Sandy Bridge processors that are the first to provide Advanced Vector Extensions support. The Core i5 2500K CPU performance is already great under Linux, but once more Linux software supports taking advantage of this latest cross-vendor instruction set, there will be even more speed-ups. While the Low-Level Virtual Machine does not yet have full support for taking advantage of the Advanced Vector Extensions support, in this article we are looking at how the latest development code for LLVM 2.9 and the Clang compiler are performing on Intel's Sandy Bridge in relation to GCC.
February has finally arrived. Later this month Phoronix Test Suite 3.0 "Iveland" and OpenBenchmarking.org will be officially unveiled from the Southern California Linux Expo during the talk entitled "Making Better Linux Hardware Choices" by myself and Matthew Tippett, the former ATI/AMD Linux Core Engineering Manager. Before the California Linux event, there may also be a public demonstration in Munich of this major Linux testing/benchmarking breakthrough. While the Phoronix Test Suite 3.0-Iveland software can currently be downloaded as beta, OpenBenchmarking.org is not yet publicly available nor have we said much about the project. What has been said though is that it will cause Linux benchmarking to change, it will likely cause a greater impact than Phoronix.com, may result in my editorial departure from Phoronix, and will change the way that you find Linux compatible hardware. Here though is a primer of some of what you can expect out of OpenBenchmarking.org when it becomes available late in the month.
Started by one of our readers more than a week ago was a compiler deathmatch for comparing the performance of GCC, LLVM Clang, PCC (the Portable C Compiler), TCC (Tiny C Compiler), and Intel's C Compiler under Arch Linux. This user did not stop there with compiling these different x86_64 code compilers, but he also went on to look at the compiler performance with different compiler flags, among other options. The results are definitely worth looking at and here are some more.
Last summer we delivered the news that a native ZFS file-system implementation for Linux was coming by an Indian company known as KQ Infotech where they leveraged the Lawrence Livermore National Laboratories ZFS Linux code, finished it off in some areas, and took care of the POSIX support. This ZFS Linux module was eventually released to a group of beta testers -- us included -- and we ran some ZFS Linux benchmarks back in November using the latest beta code. Since that point, however, KQ Infotech has made their ZFS Linux port publicly available and earlier this month they declared this work as stable via its general availability release. We have decided to benchmark this latest ZFS Linux code to see where the performance now stands against the EXT4, Btrfs, and XFS file-systems.
Last month we delivered our first benchmarks of the Amazon EC2 Cloud, but those initial tests were limited to just a few of their cloud computing instances due to failures with the Ubuntu EC2 operating system on their other compute instances. Earlier this month we then showed how the Amazon EC2 Micro was comparable to a Nokia N900 and Intel Atom, but now we have a more exhaustive comparison complete of all major Amazon Elastic Compute Cloud types. Using the Amazon Linux AMI operating system, we have run a plethora of performance benchmarks on the m1.small, m1.large, m1.xlarge, m2.xlarge, m2.2xlarge, m2.4xlarge, c1.medium, and c1.xlarge cloud computing instances.
The most common Linux file-systems we talk about at Phoronix are of course Btrfs and EXT4 while the ZFS file-system, which is available on Linux as a FUSE (user-space) module or via a recent kernel module port, gets mentioned a fair amount too. When it comes to the FreeBSD and PC-BSD operating systems, ZFS is looked upon as the superior, next-generation option that is available to BSD users. However, with the DragonFlyBSD operating system there is another option: HAMMER. In this article we are seeing how the performance of this original creation within the DragonFlyBSD project competes with ZFS, UFS, EXT3, EXT4, and Btrfs.
In December we published our first set of Amazon EC2 benchmarks for their Elastic Compute Cloud using Ubuntu EC2 and the different instances that were compatible. Now though we are in the process of carrying out a new set of benchmarks from Amazon's cloud that not only contains more tests, but using the official Amazon Linux AMI we tested nearly every instance type. Except what is missing are the results for the "micro" (the t1.micro API name) instance. Why? It is simply too slow and irregular.
With 2010 now coming to an end, what were the most popular Phoronix stories this year? For those curious about the most viewed articles and news posts on Phoronix in 2010, here's a list. Exclusive information on Valve's forthcoming Linux Steam client, photographs from my adventure to the Chernobyl Nuclear Disaster Site, and multi-OS benchmarks had dominated 2010.
In early November we delivered benchmarks of EXT4 vs. Btrfs on an early Linux 2.6.37 kernel as our latest round of tests comparing these two leading Linux file-systems. There were some changes in the Linux disk performance with these file-systems using the latest Linux kernel code, but overall it was not too interesting. However, as the Linux 2.6.37 kernel does introduce a new mount option for Btrfs, the space_cache option, we decided to explore its performance in today's article.
Linux gaming has a bright future ahead with the forthcoming Unigine games, successful indie campaigns, and many other Linux-native game titles being just out on the horizon. Right now though if you are a dedicated PC gamer looking to satisfy your entertainment appetite under Linux, more than likely you find yourself using the Wine program so that you can run many Windows programs under Linux. What is the performance impact though of using this method? In this article, we have a couple benchmarks comparing the performance of Wine, native Linux game binaries, and the native Microsoft Windows 7 Professional performance.
Oracle's been vigorously working on their VM VirtualBox 4.0 software and in just the past week they have delivered two public betas that bring a number of new features. Among the changes there is support for Intel HD audio / ICH9 to guest VMs, the concept of extension packs, user-interface improvements, support for limiting a virtual machine's CPU time and I/O bandwidth, 3D acceleration fixes for guests, and a great number of bug-fixes. How though is this updated Oracle/Sun virtualization platform comparing to the older VirtualBox 3.2 release and that of the upstream Linux KVM (the Kernel-based Virtual Machine) that most Linux distributions rely upon? Here are a number of benchmarks that seek to answer this very question.
Last month we reported on the 200 line Linux kernel patch that does wonders for improving the desktop responsiveness of the system. There was certainly much interest (over 100,000 views to both of our YouTube videos demonstrating the change) but this patch really didn't speed up the system per se but rather improved the desktop interactivity and reduced latency by creating task-groups per TTY so that the processes had more equal access to the CPU. There is though an entirely different patch-set now beginning to generate interest among early adopters that does improve the kernel performance itself in compute and memory intensive applications and it's the Transparent Hugepage Support patch-set. Here are our initial tests of the latest kernel patches that will hopefully be finding their way into the mainline Linux kernel soon.
Earlier this week I noted there's new Apple hardware in our labs being used to tighten up our Mac OS X support within the Phoronix Test Suite, OpenBenchmarking.org, Phoromatic, etc. However, in the middle of working on Iveland, I have been carrying out a few Mac OS X benchmarks comparing its performance under the 2010 Apple Mac Book Pro to other operating systems. With the Core i5 notebook being much faster than the past Apple Mac Minis used in comparisons like looking at their enhanced OpenGL stack and benchmarking Mac OS X against Linux and Windows 7, the results are more interesting and there's also a greater variety of testing possibilities now with the recent Phoronix Test Suite advancements. Next week there are some very interesting Apple-related benchmarks to be published, but before the weekend here are a few tests from this Apple Mac Book Pro looking at its power consumption under Mac OS X 10.6.5 and Ubuntu 10.10.
There is the first beta release of the Adobe 10.2 Flash Player now available for Microsoft Windows, Apple Mac OS X, and Linux platforms that brings a variety of improvements since the Flash Player 10.1 release from earlier this year. For Linux users this Adobe Flash update is quite important since it finally delivers GPU-based video acceleration support via their new Stage Video technology that is now supported on all platforms. Adobe's Stage Video offloads the entire video process to the GPU and in this article are some initial tests illustrating the benefits of this Flash update for Linux users.
A few weeks ago there were benchmarks of GCC, LLVM-GCC, DragonEgg, and Clang. In this compiler performance comparison the releases of GCC 4.2, 4.3, 4.4, 4.5, and a 4.6 development snapshot were benchmarked. On the LLVM side there was LLVM-GCC 4.2, DragonEgg with GCC 4.5 and LLVM 2.8, and then Clang with LLVM 2.8. This combination of eight open-source compilers were tested on three distinct Intel and AMD systems (even a 12-thread Core i7 Gulftown), but all of which were 64-bit capable and contained relatively high-end processors from their respective series. To complement this earlier article, available now are some new GCC/LLVM benchmarks but this time an older Intel Atom CPU was used to look at the 32-bit compiler performance on a slower, low-power netbook.
When Wayland started out in 2008 it was very difficult to build and run this lightweight, next-generation display server. Wayland leverages the very latest Linux graphics technologies and at that time all of Wayland's dependencies had to be patched or built from branched sources and Wayland even had its own EGL implementation at the time (Eagle) rather than Mesa and overall it was just a high barrier to entry. Wayland at that time also worked with only the open-source Intel driver, while now it can work with most any KMS / GEM / Mesa driver. It was not until recently that it became possible to build Wayland from mainline components beginning to ship in new Linux distributions, thereby making it much easier to experiment with the open-source display server. Now it's to a point where you can just run a simple script and be up and running with a Wayland Display Server in just minutes.
When publishing ATI Gallium3D benchmarks this week that compared the performance of the Radeon HD 4870 and Radeon HD 5770 graphics cards with this next-generation driver architecture to the classic open-source Mesa driver and AMD's high-performance proprietary Catalyst driver, the results were what one would mostly expect. The Gallium3D driver was faster than the classic Mesa driver in most tests, but both drivers seriously lagged behind the proprietary driver. Even on older generation ATI Radeon graphics cards this is the case. This though has led many to effectively ask, "what's keeping the open-source drivers from performing like the proprietary driver?" It all comes down to low-level optimizations as is discussed in this Phoronix Forums thread. There are very large development teams for the different Catalyst driver components within AMD and much of this work is shared across all platforms, but on the open-source Linux side there's very few paid full-time developers and just a number of part-time, community developers to cover the entire driver stack.
In August we delivered the news that Linux was soon to receive a native ZFS Linux kernel module. The Sun (now Oracle) ZFS file-system has long been sought after for Linux, though less now since Btrfs has emerged, but incompatibilities between the CDDL and GPL licenses have barred such support from entering the mainline Linux kernel. There has been ZFS-FUSE to run the ZFS file-system in user-space, but it comes with slow performance. There has also been work by the Lawrence Livermore National Laboratories in porting ZFS to Linux as a native Linux kernel module. This LLNL ZFS work though is incomplete but still progressing due to a US Department of Energy contract. It is though via this work that developers in India at KQ Infotech have made working a Linux kernel module for ZFS. In this article are some new details on KQ Infotech's ZFS kernel module and our results from testing out the ZFS file-system on Linux.
Last month I said what OpenBenchmarking.org is and how it should change the benchmarking / automated testing landscape once it's released in conjunction with Phoronix test Suite 3.0 "Iveland" early next year. I have also showed off the new graphing capabilities for this software and provided another update at the end of last month. Here now is another update with some more exciting details.
529 software articles published on Phoronix.