1. Computers
  2. Display Drivers
  3. Graphics Cards
  4. Memory
  5. Motherboards
  6. Processors
  7. Software
  8. Storage
  9. Operating Systems


Facebook RSS Twitter Twitter Google Plus


Phoronix Test Suite

OpenBenchmarking.org

Bufferbloat To Be Fought In Linux 3.3 With BQL

Linux Kernel

Published on 07 January 2012 12:29 PM EST
Written by Michael Larabel in Linux Kernel
9 Comments

Another feature coming to the Linux 3.3 kernel is Byte Queue Limits (BQL), which attempts to fight "bufferbloat" in networking.

Byte Queue Limits is reported to bring significant performance improvements across nearly all Linux package schedulers and AQMs. Byte Queue Limits is a way to limit a network controller's hardware queues by number of bytes rather than number of packets, which can reduce buffer bloat. A much more detailed description of BQL can be found from the 2011 LPC page. This is merged into the Linux 3.3 kernel with the "net-next" pull.

Dave Taht, a Linux kernel network developer working to fight the "bufferbloat" problems has written into Phoronix about BQL in the Linux 3.3 kernel. Since networking isn't one of my areas of interest, I'll leave it at this and let those interested to read more about Linux Byte Queue Limits from his provided resources.
You may or may not be aware of the latest efforts towards defeating 'bufferbloat' [1] that have gone into the linux 3.3 kernel.

They are - Byte Queue Limits [2], and huge improvements across nearly all the packet schedulers and AQMs in Linux.

The test results thus far for 'latency under load' are *compelling*.

http://www.teklibre.com/~d/bloat/pfifo_fast_vs_sfq_qfq_linear.png

Someone doing more extensive testing of various subsystems affected... network I/O, network filesystems, web performance, voip... would be *comforting*. I'm curious if it were possible to sign you up to evaluate some scenarios using this new stuff?

(after this test, SFQ was fixed to perform equivalently to QFQ [3], and in either case, now, we see about a 65x improvement vs the default pfifo_fast qdisc... and there is more in the loop for 3.3, notably SFQRED [5])

While I am writing some tests on my own, my own efforts are focused on fixing the home router disaster[4], and the beneficial effects of all the new stuff extend out to servers and desktops as well, and I lack the hardware and time to play with your test suite all that much, although I'm going to try a few things in the coming weeks.

I can, however, suggest several useful test scenarios for you... this is the simplest

Build a couple 3.3 kernels, test for a baseline, then in order:

1) switch the qdiscs to 'sfq' (tc qdisc add dev whatever root sfq) run your network related tests

2) Turn off GSO and TSO (via ethtool) and with sfq on, run your network related tests.

3) Hammer down on BQL's controller some with max_limit

There are many other options available to play with such as qfq, and sfq can be tuned up to handle bigger workloads soon [5] but that requires somewhat more setup than what I describe above.

I figure fixing bufferbloat would be of deep interest to your readers, particularly the network gamers.

Footnotes:

1: two bloat articles in acm queue
http://queue.acm.org/detail.cfm?id=2076798
http://queue.acm.org/detail.cfm?id=2071893
2: http://linuxplumbersconf.org/2011/ocw/proposals/171
3: http://www.spinics.net/lists/netdev/msg184613.html
4: http://www.bufferbloat.net/projects/cerowrt
5: http://www.spinics.net/lists/netdev/msg185147.html

If any Phoronix readers do do some further exploring of Byte Queue Limits, feel free to share your findings within the forums.

About The Author
Michael Larabel is the principal author of Phoronix.com and founded the web-site in 2004 with a focus on enriching the Linux hardware experience and being the largest web-site devoted to Linux hardware reviews, particularly for products relevant to Linux gamers and enthusiasts but also commonly reviewing servers/workstations and embedded Linux devices. Michael has written more than 10,000 articles covering the state of Linux hardware support, Linux performance, graphics hardware drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org automated testing software. He can be followed via and or contacted via .
Latest Linux Hardware Reviews
  1. NVIDIA GeForce GTX 970 Offers Great Linux Performance
  2. CompuLab Intense-PC2: An Excellent, Fanless, Mini PC Powered By Intel's i7 Haswell
  3. From The Atom 330 To Haswell ULT: Intel Linux Performance Benchmarks
  4. AMD Radeon R9 285 Tonga Performance On Linux
Latest Linux Articles
  1. AMD Moves Forward With Unified Linux Driver Strategy, New Kernel Driver
  2. MSI: Update Your BIOS From The Linux Desktop
  3. NVIDIA vs. AMD 2D Linux Drivers: Catalyst Is Getting Quite Good At 2D
  4. 15-Way GPU Comparison With Mesa 10.3 + Linux 3.17
Latest Linux News
  1. Linux 3.19 To Have Skylake Graphics, PPGTT Enablement
  2. Ubuntu 16.04 Might Be The Distribution's Last 32-Bit Release
  3. Imagination Releases Full ISA Documentation For PowerVR Rogue GPUs
  4. Features GNOME Developers Want In The Linux Kernel
  5. GTK+ Gains Experimental Overlay Scrollbars
  6. Phoronix Test Suite 5.4 M3 Is Another Hearty Update
  7. GParted 0.20 Improves Btrfs Support
  8. EXT4 In Linux 3.18 Has Clean-ups, Bug Fixes
  9. Emacs 24.4 Has Built-In Web Browser, Improved Multi-Monitor Support
  10. NVIDIA's NVPTX Support For GCC Is Close To Being Merged
Latest Forum Discussions
  1. Users/Developers Threatening Fork Of Debian GNU/Linux
  2. HOPE: The Ease Of Python With The Speed Of C++
  3. Proof that strlcpy is un-needed
  4. Bye bye BSD, Hello Linux: A Sys Admin's Story
  5. Updated and Optimized Ubuntu Free Graphics Drivers
  6. NVIDIA Presents Its Driver Plans To Support Mir/Wayland & KMS On Linux
  7. AMD Is Restructuring Again, Losing 7% Of Employees
  8. Open-Source AMD Fusion E-350 Support Takes A Dive