1. Computers
  2. Display Drivers
  3. Graphics Cards
  4. Memory
  5. Motherboards
  6. Processors
  7. Software
  8. Storage
  9. Operating Systems


Facebook RSS Twitter Twitter Google Plus


Phoronix Test Suite

OpenBenchmarking.org

Autonomously Generating An Ideal Kernel Configuration

Phoronix

Published on 10 April 2010 09:53 PM EDT
Written by Michael Larabel in Phoronix
33 Comments

While most Linux users are fine with just using the kernel supplied by their distribution vendor, there are some enthusiasts and professional users who end up tweaking their kernel configuration extensively for their needs, particularly if they are within a corporate environment where the very best performance and reliability is demanded for a particular workload.

Unfortunately, with there being hundreds of different Linux kernel configuration options, this is often a deterrent for any hobbyist to sit down and invest a great deal of time in testing out the different combinations of kernel options to generate the best performance for one's needs. Even for the experienced professionals the process of tuning the kernel configuration for a specific workload can require significant man hours and manual testing.

But how would it be if you could find the optimal kernel configuration for your specific workload without any real human involvement? Well, it's possible to quite easily generate an ideal Linux kernel configuration in an autonomous manner.

Last October I shared how it was possible to autonomously find performance regressions in the Linux kernel. This was done by writing a module for the Phoronix Test Suite that hooked our testing framework into Git's bisect command to be able to autonomously traverse a Git repository and running some automated tests each step of the way looking for the lone commit that caused the targeted regression. This was a success and in a fully automated manner we were able to track down the individual commit that caused a severe performance drop in the disk performance for EXT4. This Phoronix Test Suite module could also be hooked in to find a regression in any other Git-managed code-base by simply adjusting a few test/code-specific bits.

Of course, this bisecting module isn't even needed if you use Phoromatic where you can automatically have the targeted code based on a daily basis or even a per-commit basis, such as we have done with benchmarking the Linux kernel on a daily basis and even benchmarking Ubuntu daily in looking for performance changes. However, inspired to see what else could be delivered after writing the autonomous kernel regression finder, an autonomous kernel configuration optimizer has been conceived.

With this new module that I have been writing for Phoronix Test Suite 2.6 "Lyngen" over the weekend, it becomes possible to find the ideal kernel configuration options for your specific workload by what boils down to an automated feedback optimization loop. It's just a matter of supplying the module with the Linux kernel source code version you wish to use, what kernel configuration options you wish to test and with what values to use, and then the specific performance test(s) you want to cater your kernel towards. Following that, this Phoronix Test Suite module will go through the process of autonomously building the kernel in each configuration (currently this module is just supported on Ubuntu), rebooting each time, and then carrying out the tests.

Once the automated kernel testing has finished, all of the results will be analyzed -- again, in a completely autonomous manner -- and a report will be generated showing the impact that each kernel configuration option has on your specific workload of tests. It's really meant to be that easy!

The code and related documentation will be published shortly for Phoronix Test Suite 2.6 along with a few example kernel configurations that have been auto-generated showing some performance improvements that were automatically detected. In the mean time though, if you have any feedback on the concept or any other ideas, feel free to voice them in the forums or by contacting us. This module could also be adapted to test out different combinations of options for other pieces of the OS stack, like graphics driver options too.

Phoronix Test Suite 2.6 (codenamed "Lyngen") is expected to be officially released in May. Among Phoromatic Tracker improvements, this self-optimizing kernel configuration tester, and other improvements, there should also be better Windows 7 support.

About The Author
Michael Larabel is the principal author of Phoronix.com and founded the web-site in 2004 with a focus on enriching the Linux hardware experience and being the largest web-site devoted to Linux hardware reviews, particularly for products relevant to Linux gamers and enthusiasts but also commonly reviewing servers/workstations and embedded Linux devices. Michael has written more than 10,000 articles covering the state of Linux hardware support, Linux performance, graphics hardware drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org automated testing software. He can be followed via and or contacted via .
Latest Linux Hardware Reviews
  1. AMD Launches New FX CPUs, Cuts Prices On Existing Processors
  2. Preview: AMD's FX-9590 Eight-Core At Up To 5.0GHz On Linux
  3. Intel Launches The Core i7 5960X, Mighty Powerful Haswell-E CPUs
  4. AMD Radeon R9 290: Gallium3D vs. Catalyst Drivers
Latest Linux Articles
  1. Ondemand vs. Performance CPU Governing For AMD FX CPUs On Linux 3.17
  2. How Intel Graphics On Linux Compare To Open-Source AMD/NVIDIA Drivers
  3. The Fastest NVIDIA GPUs For Open-Source Nouveau With Steam Linux Gaming
  4. Testing For The Latest Linux Kernel Power Regression
Latest Linux News
  1. Trying Intel OpenCL On Linux For Video Encoding
  2. GSoC 2014 Yielded Some Improvements For Mesa/X.Org This Year
  3. webOS Lives On As LuneOS With New Release
  4. Marek Lands Radeon Gallium3D HyperZ Improvements
  5. Mozilla Firefox 32 Surfaces With HTML5, Developer Changes
  6. Nouveau X.Org Driver Released With DRI3+Present, Maxwell, GLAMOR
  7. Microsoft & AMD Release C++ AMP Compiler With Linux Support
  8. AMD, Wine & Valve Dominated August For Linux Users
  9. Linux 3.17-rc3 Kernel Released Back On Schedule
  10. Lennart Poettering Talks Up His New Linux Vision That Involves Btrfs
Latest Forum Discussions
  1. Lennart Poettering Talks Up His New Linux Vision That Involves Btrfs
  2. nv and xorg.conf under Debian PPC
  3. AMD graphics doesn't work with AMD Catalyst drivers
  4. Best Radeon for a Power Mac G5?
  5. The dangers of Linux kernel development
  6. Updated and Optimized Ubuntu Free Graphics Drivers
  7. AMD Releases UVD Video Decode Support For R600 GPUs
  8. SSD seems slow