1. Computers
  2. Display Drivers
  3. Graphics Cards
  4. Memory
  5. Motherboards
  6. Processors
  7. Software
  8. Storage
  9. Operating Systems


Facebook RSS Twitter Twitter Google Plus


Phoronix Test Suite

OpenBenchmarking.org

Moonlight Gets Generic GPU Video Acceleration

Free Software

Published on 23 March 2011 08:12 PM EDT
Written by Michael Larabel in Free Software
16 Comments

Miguel de Icaza, David Reveman, and their Novell team working on Mono/Moonlight began working on GPU acceleration support. This initial GPU acceleration support was largely focused on accelerating 3D transforms of objects -- just not videos, but all of the Silverlight content -- and other surfaces. They also landed a new rendering pipeline and other work. Pushed into Moonlight's Git repository today is more GPU acceleration work, but this time focusing upon optimizing Moonlight's engine for video rendering operations.

This video acceleration work in Moonlight, which makes Microsoft Silverlight content available under Linux and other non-Windows platforms, does not use VA-API, VDPAU, or any of the other Linux video acceleration APIs. It's a custon OpenGL shader-based solution.

Up to this point when handling video playback, Moonlight has converted H.264 video frames to YUV buffers, perform YUV to RGB conversions, scaled the frame (as an RGB bitmap) to the desired size, and then displayed the frame via transferring its contents through X. Thus it's very dependent upon the CPU and system memory.

With the just-committed GPU hardware accelerated video playback method, the H.264 video frame is still decoded to a YUV buffer by Moonlight, but then submitted directly to the graphics processor. There is then a custom OpenGL shader that's doing the pixel scaling/conversion. That transformed buffer is then composited using the new rendering pipeline already introduced in Moonlight 4.

Using this method, Moonlight is still doing the H.264 video decoding on the CPU, but the frames are being immediately offloaded to the GPU for the rest of the work. On the plus side, this should be quite portable with any OpenGL GPU/driver and does not depend upon any particular video API (VA-API, XvBA, X-Video, XvMC, VDPAU, etc) or Gallium3D state tracker.

For those not concerned with Microsoft Silverlight but the much more abundant Adobe Flash/SWF content, Gnash is carrying VA-API support, Lightspark is using an OpenGL engine (they've even debated having their own Gallium3D state tracker), and Adobe's official Flash Linux plug-in as of a few months back officially supports NVIDIA VDPAU and Broadcom's Crystal HD chipset. Intel VA-API support is forthcoming. Right now though for NVIDIA customers with the binary graphics driver, VDPAU with Flash works well.

This video acceleration work that was just pushed into their Git repository was mentioned on Miguel's blog.
Although native video playback solutions have been doing similar things for a while on Linux, we had to integrate this into the larger retained graphics system that is Moonlight. We might be late to the party, but it is now a hardware accelerated and smooth party.

And what does this looks like? It looks like heaven.

We were watching 1080p videos, running at full screen in David's office and it is absolutely perfect.

About The Author
Michael Larabel is the principal author of Phoronix.com and founded the web-site in 2004 with a focus on enriching the Linux hardware experience and being the largest web-site devoted to Linux hardware reviews, particularly for products relevant to Linux gamers and enthusiasts but also commonly reviewing servers/workstations and embedded Linux devices. Michael has written more than 10,000 articles covering the state of Linux hardware support, Linux performance, graphics hardware drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org automated testing software. He can be followed via and or contacted via .
Latest Linux Hardware Reviews
  1. NVIDIA GeForce GTX 970 Offers Great Linux Performance
  2. CompuLab Intense-PC2: An Excellent, Fanless, Mini PC Powered By Intel's i7 Haswell
  3. From The Atom 330 To Haswell ULT: Intel Linux Performance Benchmarks
  4. AMD Radeon R9 285 Tonga Performance On Linux
Latest Linux Articles
  1. AMD Moves Forward With Unified Linux Driver Strategy, New Kernel Driver
  2. MSI: Update Your BIOS From The Linux Desktop
  3. NVIDIA vs. AMD 2D Linux Drivers: Catalyst Is Getting Quite Good At 2D
  4. 15-Way GPU Comparison With Mesa 10.3 + Linux 3.17
Latest Linux News
  1. Linux 3.19 To Have Skylake Graphics, PPGTT Enablement
  2. Ubuntu 16.04 Might Be The Distribution's Last 32-Bit Release
  3. Imagination Releases Full ISA Documentation For PowerVR Rogue GPUs
  4. Features GNOME Developers Want In The Linux Kernel
  5. GTK+ Gains Experimental Overlay Scrollbars
  6. Phoronix Test Suite 5.4 M3 Is Another Hearty Update
  7. GParted 0.20 Improves Btrfs Support
  8. EXT4 In Linux 3.18 Has Clean-ups, Bug Fixes
  9. Emacs 24.4 Has Built-In Web Browser, Improved Multi-Monitor Support
  10. NVIDIA's NVPTX Support For GCC Is Close To Being Merged
Latest Forum Discussions
  1. Users/Developers Threatening Fork Of Debian GNU/Linux
  2. HOPE: The Ease Of Python With The Speed Of C++
  3. Proof that strlcpy is un-needed
  4. Bye bye BSD, Hello Linux: A Sys Admin's Story
  5. Updated and Optimized Ubuntu Free Graphics Drivers
  6. NVIDIA Presents Its Driver Plans To Support Mir/Wayland & KMS On Linux
  7. AMD Is Restructuring Again, Losing 7% Of Employees
  8. Open-Source AMD Fusion E-350 Support Takes A Dive