1. Computers
  2. Display Drivers
  3. Graphics Cards
  4. Memory
  5. Motherboards
  6. Processors
  7. Software
  8. Storage
  9. Operating Systems


Facebook RSS Twitter Twitter Google Plus


Phoronix Test Suite

OpenBenchmarking.org

Autonomously Generating An Ideal Kernel Configuration

Phoronix

Published on 10 April 2010 09:53 PM EDT
Written by Michael Larabel in Phoronix
33 Comments

While most Linux users are fine with just using the kernel supplied by their distribution vendor, there are some enthusiasts and professional users who end up tweaking their kernel configuration extensively for their needs, particularly if they are within a corporate environment where the very best performance and reliability is demanded for a particular workload.

Unfortunately, with there being hundreds of different Linux kernel configuration options, this is often a deterrent for any hobbyist to sit down and invest a great deal of time in testing out the different combinations of kernel options to generate the best performance for one's needs. Even for the experienced professionals the process of tuning the kernel configuration for a specific workload can require significant man hours and manual testing.

But how would it be if you could find the optimal kernel configuration for your specific workload without any real human involvement? Well, it's possible to quite easily generate an ideal Linux kernel configuration in an autonomous manner.

Last October I shared how it was possible to autonomously find performance regressions in the Linux kernel. This was done by writing a module for the Phoronix Test Suite that hooked our testing framework into Git's bisect command to be able to autonomously traverse a Git repository and running some automated tests each step of the way looking for the lone commit that caused the targeted regression. This was a success and in a fully automated manner we were able to track down the individual commit that caused a severe performance drop in the disk performance for EXT4. This Phoronix Test Suite module could also be hooked in to find a regression in any other Git-managed code-base by simply adjusting a few test/code-specific bits.

Of course, this bisecting module isn't even needed if you use Phoromatic where you can automatically have the targeted code based on a daily basis or even a per-commit basis, such as we have done with benchmarking the Linux kernel on a daily basis and even benchmarking Ubuntu daily in looking for performance changes. However, inspired to see what else could be delivered after writing the autonomous kernel regression finder, an autonomous kernel configuration optimizer has been conceived.

With this new module that I have been writing for Phoronix Test Suite 2.6 "Lyngen" over the weekend, it becomes possible to find the ideal kernel configuration options for your specific workload by what boils down to an automated feedback optimization loop. It's just a matter of supplying the module with the Linux kernel source code version you wish to use, what kernel configuration options you wish to test and with what values to use, and then the specific performance test(s) you want to cater your kernel towards. Following that, this Phoronix Test Suite module will go through the process of autonomously building the kernel in each configuration (currently this module is just supported on Ubuntu), rebooting each time, and then carrying out the tests.

Once the automated kernel testing has finished, all of the results will be analyzed -- again, in a completely autonomous manner -- and a report will be generated showing the impact that each kernel configuration option has on your specific workload of tests. It's really meant to be that easy!

The code and related documentation will be published shortly for Phoronix Test Suite 2.6 along with a few example kernel configurations that have been auto-generated showing some performance improvements that were automatically detected. In the mean time though, if you have any feedback on the concept or any other ideas, feel free to voice them in the forums or by contacting us. This module could also be adapted to test out different combinations of options for other pieces of the OS stack, like graphics driver options too.

Phoronix Test Suite 2.6 (codenamed "Lyngen") is expected to be officially released in May. Among Phoromatic Tracker improvements, this self-optimizing kernel configuration tester, and other improvements, there should also be better Windows 7 support.

About The Author
Michael Larabel is the principal author of Phoronix.com and founded the web-site in 2004 with a focus on enriching the Linux hardware experience and being the largest web-site devoted to Linux hardware reviews, particularly for products relevant to Linux gamers and enthusiasts but also commonly reviewing servers/workstations and embedded Linux devices. Michael has written more than 10,000 articles covering the state of Linux hardware support, Linux performance, graphics hardware drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org automated testing software. He can be followed via and or contacted via .
Latest Linux Hardware Reviews
  1. Intel Launches The Core i7 5960X, Mighty Powerful Haswell-E CPUs
  2. AMD Radeon R9 290: Gallium3D vs. Catalyst Drivers
  3. AMD Radeon R9 290 Open-Source Driver Works, But Has A Ways To Go
  4. Trying The Configurable 45 Watt TDP With AMD's A10-7800 / A6-7400K
Latest Linux Articles
  1. The Fastest NVIDIA GPUs For Open-Source Nouveau With Steam Linux Gaming
  2. Testing For The Latest Linux Kernel Power Regression
  3. The Most Energy Efficient Radeon GPU For AMD Linux Gaming
  4. 20-Way Radeon Comparison With Open-Source Graphics For Steam On Linux Gaming
Latest Linux News
  1. Intel Beignet Is Working Out Surprisingly Well For OpenCL On Linux
  2. Coreboot Adds Lenovo X220 With Native Sandy Bridge Support
  3. Canonical Has Yet To Land X.Org Server 1.16 For Ubuntu 14.10
  4. Imagination Launches A MIPS Development Board
  5. Getting Involved With The New Raspberry Pi Graphics Driver
  6. A New AMD Catalyst Linux Driver Unofficially Surfaces
  7. LibreOffice Ported To 64-bit ARM (AArch64)
  8. Enlightenment E19 RC3 Shows Off The New Wayland Compositor
  9. Metro Redux Is Going To Require OpenGL 4.x On Linux
  10. Jailhouse v0.1 Released As A Basic Hypervisor For Linux
Latest Forum Discussions
  1. Btrfs Gets Talked Up, Googler Encourages You To Try Btrfs
  2. Updated graphics drivers for Ubuntu 12.04 Precise LTS
  3. Catalyst 14.201.1008
  4. It's Now Possible To Play Netflix Natively On Linux Without Wine Plug-Ins
  5. Users defect to Linux as OpenBSD removes Lynx from base system
  6. Updated and Optimized Ubuntu Free Graphics Drivers
  7. Canonical Joined The Khronos Group To Help Mir/Wayland Drivers
  8. Radeon HD5670 and Ubuntu 14.04