Only two weeks have passed since the launch of Phoronix Test Suite 2.2, but it is already time to push out the first alpha release for Phoronix Test Suite 2.4! Phoronix Test Suite 2.4 (codenamed "Lenvik") Alpha 1 is what is running on our kernel test farm that launched yesterday and there is already a great deal of changes to be found in this release. In fact, the patch already between 2.2 Bardu and 2.4 Lenvik Alpha 1 is nearly 24,000 lines of code! There is some code reorganization, but a lot of new code has been introduced. Here is some of what can be found already in this development release.
This year with the Phoronix Test Suite we have delivered four major updates to this leading, widely adopted, multi-platform testing software that has brought dozens of new test profiles and literally hundreds of significant changes. These changes ranged from features to autonomously track performance regressions within any code-base, the ability to not only compare frame-rates within OpenGL tests but image quality comparisons too, support for mobile platforms, and so much other major work to further drive automated testing and benchmarking not only on Linux but OpenSolaris, *BSD, and Mac OS X too. In 2009 we also launched PTS Desktop Live, our own operating system for carrying out standardized benchmarks in an easy-to-use and repeatable manner from a live Linux environment, and also Phoromatic, which is designed for the enterprise world and allows the Phoronix Test Suite to be easily deployed across many systems and then managed from a central interface. The year is not over yet, nor is our work on ensuring that the Phoronix Test Suite is the most powerful and robust testing/benchmarking platform. With that said, as of this morning our Phoronix kernel test farm is now alive!
With the Linux 2.6.32 kernel being released in a few days, we found it time to benchmark this newest kernel release that brings new drivers, kernel mode-setting improvements, virtualization enhancements, and more.
Yesterday marked the release of Phoronix Test Suite 2.2 and it was the best version yet with the addition of many new exciting and useful features. While this release was gratifying, there are much greater plans for the Phoronix Test Suite going into the next decade. It has already been shared that Windows support is coming, but there are other huge features coming too as soon as Q1'2010. Up to this point, most of the tests and the design of pts-core (the Phoronix Test Suite engine) have been focused on quantitative benchmarks with many of the tests spitting out a frame-rate, time, or some other measurement. However, now being supported in the Phoronix Test Suite is the ability to produce abstract results, such as screenshots used for image quality comparisons. The Phoronix Test Suite can now track the image quality of various test profiles (such as OpenGL games) across hardware configurations, drivers, and more. All of this is still leveraged upon the existing Phoronix Test Suite framework and our design philosophies so that even image quality comparisons can be carried out autonomously, the ability to compare many results side-by-side, support for carrying out these tests remotely via Phoromatic, and the ability to share your abstract results with others via Phoronix Global. Now not only can you be sure you are satisfied with the quantitative frame-rate of the hardware you have -- or are about to purchase -- but you have a plethora of options for looking at the qualitative performance too.
Continuing in the tradition of providing feature-rich, quarterly updates to the Phoronix Test Suite, Phoronix Media has announced the immediate availability of Phoronix Test Suite 2.2 (codenamed "Bardu"). Phoronix Test Suite 2.2 continues to expand the capabilities and feature set for this open-source testing framework with the introduction of many new features, a new graphical user-interface, numerous new test profiles and suites, and a public beta of the Phoromatic remote test management system.
There's the Phoronix Test Suite, Phoronix Global, and PTS Desktop Live as our family of free software products to provide extensive benchmarking and automated testing capabilities atop Linux, OpenSolaris, BSD, and Mac OS X operating systems. The Phoronix Test Suite has more than 120 test profiles and 50 test suites with new suites and tests continuing to come in through its extensible architecture, but for organizations with multiple test systems or entire testing farm(s) devoted to performance monitoring and regression tracking, they have had to strap the Phoronix Test Suite atop their own management systems or hack away at simple scripts to deploy our testing software across an array of systems. Today though we are announcing the public beta launch of Phoromatic. Phoromatic is a remote test management system that allows controlling any number of PTS-powered systems through a single web-based interface, which also allows all of the test results to be viewed from a central source. This article provides a first-look and guide for some of the possibilities of Phoromatic from those looking to build a benchmarking test farm or for individuals simply wanting to benchmark computers across the world. We also share in this article what may be coming next to our Linux-focused benchmarking empire.
After a three month development period following the release of Phoronix Test Suite 2.0, the first beta release of Phoronix Test Suite 2.2 "Bardu" is now available for all of your testing needs on Linux, Mac OS X, OpenSolaris, and BSD platforms. Phoronix Test Suite 2.2 Beta 1 carries more than 200 changes since the release of 2.0 Sandtorg with many new prominent features being introduced, new test profiles added, and greater usability enhancements. In this article, we will go over some of the key improvements to be found in Phoronix Test Suite 2.2.
Last weekend a few Phoronix benchmarks were underway of the Linux 2.6.32-rc5 kernel when a very significant performance regression was spotted. This regression caused the PostgreSQL server to run at about 18% of the performance found in earlier kernel releases. Long story short, in tracking down this performance regression we have finally devised a way to autonomously locate performance regressions within the Linux kernel and potentially any Git-based project for that matter. Here are a few details.
Earlier this month at the Red Hat Summit where Red Hat Enterprise Linux 5.4 was released with support for the Kernel-based Virtual Machine. At this Red Hat event, virtualization -- particularly KVM -- and cloud computing were the most talked about topics. But how is KVM performing these days? With new virtualization refinements going into almost every new Linux kernel release, we have published a new set of KVM benchmarks using the Linux 2.6.31 kernel, to provide updated numbers against our KVM benchmarks from last year and our Core i7 virtualization numbers. This time around, we are also using a Phenom II processor for testing out the AMD-V technology.
Last December we had looked at the Ubuntu 9.04 home encryption performance after this feature appeared in a development snapshot as an alternative to those looking for security some of their data but are not looking for completely encrypting the hard drive due to the performance impact or other reasons. The home encryption feature ended up being disabled in Ubuntu 9.04 unless a special boot parameter was used, but it has now reappeared in Ubuntu 9.10.
A few weeks back Con Kolivas returned to the Linux kernel scene after parting ways with kernel development for two years. Con, who has contributed a great deal to the Linux kernel in the past particularly with CPU schedulers, returned and introduced BFS. BFS (not to be confused with the file-system of the same name) is a new scheduler for the Linux kernel that's designed for optimal performance on hardware that's more common with a majority of Linux desktop users, not massive data centers running dozens (and in some cases, hundreds) of CPUs. The BFS scheduler is designed to offer "extremely low latencies for excellent interactivity", according to Con Kolivas. In this article we have a set of benchmarks comparing BFS and the current default scheduler within the Linux kernel, the Completely Fair Scheduler.
Last Friday we published Mac OS X 10.6 benchmarks and then on Monday they were joined by Ubuntu 9.10 vs. Mac OS X 10.6 benchmarks. One of the requests that has come up since publishing those articles are to carry out a set of tests comparing the performance of LLVM and LLVM-GCC. With Apple's Snow Leopard release, some parts of the operating system were built using LLVM-GCC for optimized performance, although this compiler is not yet matured. In this article we have a set of 12 benchmarks comparing GCC to LLVM-GCC.
Beyond pushing out a new graphical boot screen just before the feature freeze went into effect for Ubuntu 9.10, Canonical released the first public version of their own app store, previously codenamed AppCenter, but now known as the Ubuntu Software Store (or software-store as its package is called). Canonical does have some grand plans for the Ubuntu Software Store and in this article we have some screenshots of what it looks like currently and how it functions along with some of their plans for the future.
When benchmarking development releases of Fedora in particular, they often end up being much slower than the final build and perform lower when compared against some of the other leading desktop distributions. As we have mentioned in previous articles, this is generally due to the debugging support enabled within the development builds of Fedora. To see just what the performance cost is, we have compared the Fedora 11 performance of the normal kernel against the kernel-debug package. Additionally, we also compared the performance when disabling SELinux and system auditing support.
Have you considered embracing Linux in any of your articles? If you have, but have not acted on such thoughts, why is that? Is it the Linux learning curve? The "lack of benchmarks"? Simply the lack of resources on the part of your editors and product evaluators? After speaking with several editors from fellow publications, these seem to be most of the excuses at hand. However, at Phoronix Media, we have the solutions to these problems -- and they are free and easy to adopt. I would invite you to think how using Linux to complement your Windows testing in hardware reviews could benefit your publication by providing more thorough reviews to fulfill the needs of more readers, wooing more hardware companies with having another feature to offer, and generate additional page views from having more content.
Phoronix Media has released version 2.0 (codenamed "Sandtorg") of the Phoronix Test Suite, which encompasses hundreds of updates to its flagship testing and performance profiling software. Phoronix Media has also released PTS Desktop Live 2009.3 (codenamed "Gernlinden"), which is the first Linux-based desktop operating system designed exclusively for carrying out automated tests using the Phoronix Test Suite from a live environment. Phoromatic, a web-based remote test management system, has also entered closed beta testing.
In less than two weeks we will be officially releasing Phoronix Test Suite 2.0 "Sandtorg" and this by far is the biggest upgrade ever to our flagship testing and benchmarking software. While the Phoronix Test Suite is most often associated with Linux, this open-source software is also compatible with Mac OS X, OpenSolaris, and BSD operating systems too, all of which offer new improvements with Phoronix Test Suite 2.0. In this article we have detailed some of the major highlights of Phoronix Test Suite 2.0 and how we seek to drive innovation into PC benchmarking and performance profiling.
Since we began benchmarking Btrfs a few months ago we have found it to not deliver any spectacular file-system performance results on Linux. This next-generation Linux file-system that has often been compared to Sun's ZFS has not really performed that well, granted it's still very much under development. Btrfs is far from being the performance king and even its SSD mode has had little positive effect. Just weeks ago we delivered EXT4, Btrfs, and NILFS2 benchmarks, but now there is a new release of Btrfs available. Committed to the Linux 2.6.31 kernel was Btrfs v0.19. Does this release bring any performance improvements? Yes and no.
The Linux 2.6.31 kernel is still under active development until it is released later this quarter, but the merge window is closed and most of the work going on is to address bugs and other regressions within this massive code-base. Some of the key additions to the Linux 2.6.31 kernel include many graphics-related advancements (merging of the TTM memory manager, Radeon kernel mode-setting, Intel DisplayPort, etc), an ALSA driver for the Creative X-Fi, initial USB 3.0 support, file-system improvements, and much more. To see how the general system performance has been impacted by the new Linux kernel that is in development, we have a few benchmarks today.
The past few Linux kernel releases have brought a number of new file-systems to the Linux world, such as with EXT4 having been stabilized in the Linux 2.6.28 kernel, Btrfs being merged into Linux 2.6.29, and most recently the NILFS2 file-system premiering with the Linux 2.6.30 kernel. Other file-systems have been introduced too during the past few Linux kernel release cycles, but these three have been the most talked about and are often looked at as being the next-generation Linux file-systems. Being the benchmarking junkies that we are, we have set out to compare the file-system performance of EXT4, Btrfs, and NILFS2 under Ubuntu using the Linux 2.6.30 kernel. We also looked at how these file-systems compared to EXT3 and XFS.
A beta version of StormOS has emerged, which is a desktop distribution that is based upon the Nexenta Core Platform that in turn is derived from OpenSolaris but with an Ubuntu user-land. The StormOS project emerged out of the an OpenSolaris user being dissatisfied with the slow pace of OpenSolaris on netbooks and preferring the APT packaging system to Sun's Image Packaging System. The beta version of StormOS is shipping with an Xfce 4 desktop and -- unlike the current releases of OpenSolaris -- even ships with a word processor.
One month ago we provided benchmarks of the Btrfs file-system and found that while it contained many features to make it a next-generation Linux file-system, its disk performance was rather displeasing. We had found the EXT4 file-system ran faster in a number of the tests and even EXT3 and XFS had their own advantages. Besides offering features like snapshots and online defragmentation, Btrfs has a mode that is optimized for solid-state drives. Will the Btrfs SSD mode cause this new Oracle-sponsored file-system to be the best for non-rotating media? We have benchmarks in this article, but the results may not be what one would expect.
With the Linux 2.6.30 kernel being prepped for release in early June, we have set out to provide a few benchmarks of this latest Linux kernel to see how it compares to its two earlier predecessors. While this new kernel may offer support for new file-systems (NILFS2, in particular), support for LZMA/BZIP2 kernel image compression, a new CPU architecture (Microblaze) and many other changes, are there any major performance regressions or improvements like we have spotted with our previous Linux kernel benchmarks?
Last year the Wayland Display Server project was started by Kristian Høgsberg, a Red Hat developer and a name known well within the X.Org community for his work on AIGLX, Direct Rendering Infrastructure 2, and various other projects. We were first to talk about the Wayland Display Server in detail, which aims to provide a mini display server that is designed around the latest X/kernel technologies like the Graphics Execution Manager and kernel mode-setting. Wayland also integrates its own compositing manager and is designed to produce a perfect frame (a.k.a. no tearing) each and every time. There has not been much to report on this project recently, but we now have a status update courtesy of Kristian.
Last month the plans for Phoronix Test Suite 2.0 "Sandtorg" were outlined with this next major release of our Linux (and Mac OS X, OpenSolaris, and BSD too) benchmarking software set to introduce many new features for the testing core, Phoromatic for providing remote benchmarking support, a performance and benchmarking oriented Linux distribution, and many other advancements. Phoronix Test Suite 2.0 will not be released until late July or early August, but the first alpha release has been made available this afternoon.
With the release this week of Fedora 11 Preview, which incorporates install-time support for the Btrfs file-system into Red Hat's Anaconda installer, we have now delivered our first set of benchmark results for this next-generation Linux file-system. Through a horde of disk tests we have looked at the Btrfs file-system performance and compared it to that of EXT3, EXT4, and XFS. While Btrfs does perform well in some areas, it is not yet the performance king for Linux file-systems. As our results show, in some tests it even has a hard time competing with the incremental EXT4 file-system.
We have invested a lot of resources into enriching the Linux hardware experience particularly by improving Linux performance benchmarks and taking the necessary steps to make Linux-based benchmarking an attractive offer for hardware and software vendors. We have also strived to ensure that open-source developers understand the importance of automated testing and that they have the proper tools to fully automate tests relevant to them when looking for performance regressions and other conditions that otherwise would not easily be caught in an efficient and effective manner. At the same time, we have sought to standardize the benchmarking process of Linux desktops to make it easier for end-users and companies when looking to gauge how well something works on Linux. The Phoronix Test Suite has made immense progress over the past year, but today it is now time to expose our latest endeavor, Sandtorg.
Phoronix Media has today released Phoronix Test Suite 1.8 (codenamed "Selbu"), which is a sizable update to its very popular testing software. Phoronix Test Suite 1.8 introduces a graphical user-interface making it easier for end-users to test out their computer systems, adds support for reference system comparisons, is compatible with more *BSD operating systems, and adds a number of new test profiles and suites. The Phoronix Test Suite is designed to run benchmarks/tests atop Linux, Mac OS X, *BSD, and OpenSolaris systems in a clean, reproducible, and easy-to-use way.
Today X.Org 7.5 with X Server 1.7 is scheduled to be released, per the release schedule that Daniel Stone proposed earlier this year. X Server 1.7 includes X Input 2 (a.k.a. Input Hotness) and Multi-Pointer X is now enabled by default (it has been in the master branch for about a year, but it has been disabled due to X Input 2 missing). This key piece to the open-source Linux desktop also features E-EDID support, the X Server no longer needing to symlink to Mesa sources, and a horde of bug-fixes. Aside from an updated X Server, X.Org 7.5 will include various updates to different input and graphics drivers.
With the release yesterday of the Linux 2.6.29 kernel, we have set out to explore how the desktop performance has evolved over the past six major kernel releases. On a few occasions in the past we have provided kernel benchmarks (at one point even benchmarking 12 kernels), but this time around we have included nearly two dozen benchmarks using the Phoronix Test Suite. How has the Linux performance evolved since the release of the Linux 2.6.24 kernel back in early 2008? Well, simply put, the Linux 2.6.29 kernel in a few areas does pack some serious performance boosts.
509 software articles published on Phoronix.