1. Computers
  2. Display Drivers
  3. Graphics Cards
  4. Memory
  5. Motherboards
  6. Processors
  7. Software
  8. Storage
  9. Operating Systems


Facebook RSS Twitter Twitter Google Plus


Phoronix Test Suite

OpenBenchmarking.org

Phoromatic Tracker Strides Forward

Phoronix

Published on 12 March 2010 10:20 AM EST
Written by Michael Larabel in Phoronix
4 Comments

Following in the success of the Phoronix Test Suite, last month we launched Phoromatic as a remote test management system targeted for enterprise users of the Phoronix Test Suite that allows the automatic scheduling of tests, remote installation of new tests, and the management of multiple test systems all through an intuitive, easy-to-use web interface. Whether you are looking to build a test farm or just benchmark systems around the world, Phoromatic can turn this otherwise taxing work into a really easy process with turn-key deployment capabilities. As an extension of Phoromatic, we then wrote Phoromatic Tracker that is designed to track any software component (either on a timed or per-commit basis) and automatically execute a set of tests each time around all in an autonomous matter and then pump the data back to the Phoromatic server and showcase it on the Phoromatic Tracker interface.

To showcase the capabilities of the Phoronix Test Suite combined with Phoromatic, we launched a reference implementation back in December by building a kernel test farm. Since December we have been monitoring the performance of the Linux kernel and its latest code on a daily basis over at kernel-tracker.phoromatic.com. The Phoromatic Tracker for the Linux kernel has already pointed out a few performance regressions during the Linux 2.6.33 and 2.6.34 development cycles all in an autonomous manner.

Phoromatic Tracker Strides Forward


A few weeks back we added an Atom Z530 test-system running with a Btrfs file-system and another system using a dual-core Atom 330. This month though we have been enriching Phoromatic and the Tracker extension further by adding several new features as well as building another Phoromatic Tracker implementation that will be made public later this month.

The Phoromatic Server is now able to take advantage of underlying improvements made in the Phoronix Test Suite 2.6 development code thus far to provide better rendering of SVG graphs, quicker loading of Phoromatic Tracker pages, faster merging of test results, and other key improvements. We have also been investing in making specific improvements to Phoromatic Tracker, some of which are now public.

The automated regression detector available through Phoromatic Tracker (such as on the kernel page) is now smarter and can better handle multiple systems, the page size with its graph is now of a smaller file size, and we have begun adding additional overview-type graphs to the page. Through the options found at the top of the Phoromatic Tracker page you can access graphs that generate show the geometric mean and aggregate sum for all of the actual tests that day. This way rather than having to look at the detected regressions table or needing to scroll through 60+ graphs daily, you can look at these overview graphs that can indicate if there are any major changes on a given day to warrant digging deeper. We will also be adding overviews for other types such as weighted means.

Some other features that will be launched when we introduce our new tracker later this month is RSS notifications for new test results, a real-time ETA for how long until a test system is expected to upload new test results along with its current position in the test queue, an integrated test/system log viewer, and a few other features we'll hold back on announcing until they're launched.

The new, yet-to-be-announced tracker coming later this month will start out with three test systems that are pumping benchmarks out 24/7 (two of which systems are the new MSI Wind Box nettops, but more systems are expected to be added) and the test suite being run is even larger than our kernel tracker with there being 70+ tests as part of its execution queue. This public tracker should also be of great benefit to a particular Linux community in a similar fashion to our kernel tracker.

You can join in on the automated testing fun by grabbing the Phoronix Test Suite at Phoronix-Test-Suite.com and you can even make a free account at Phoromatic.com. Organizations looking to install a Phoromatic Server and/or the Phoromatic Tracker on their intranet can contact PTS Commercial for licensing details or to obtain professional support for the Phoronix Test Suite.

Stay tuned for more announcements.

About The Author
Michael Larabel is the principal author of Phoronix.com and founded the web-site in 2004 with a focus on enriching the Linux hardware experience and being the largest web-site devoted to Linux hardware reviews, particularly for products relevant to Linux gamers and enthusiasts but also commonly reviewing servers/workstations and embedded Linux devices. Michael has written more than 10,000 articles covering the state of Linux hardware support, Linux performance, graphics hardware drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org automated testing software. He can be followed via and or contacted via .
Latest Linux Hardware Reviews
  1. A Walkthrough Of The New 32 System Open-Source Linux Benchmarking Test Farm
  2. Habey MITX-6771: Mini-ITX Board With Quad-Core J1900 Bay Trail
  3. OCZ Vector 150 SSD On Linux
  4. Noctua i4 CPU Cooler: Great For Cooling High-End LGA-2011v3 CPUs
Latest Linux Articles
  1. AMD Kaveri: Open-Source Radeon Gallium3D vs. Catalyst 14.12 Omega Driver
  2. 12-Way AMD Catalyst 14.12 vs. NVIDIA 346 Series Linux GPU Comparison
  3. AMD Catalyst 14.12 Omega Driver Brings Mixed Results For Linux Users
  4. 6-Way Winter 2014 Linux Distribution Comparison
Latest Linux News
  1. Civilization: Beyond Earth Linux GPU/Driver Benchmarks
  2. X.Org Server 1.16.3 Released To Fix Security Issues
  3. Linux 3.19 Merge Window Closes Ahead Of Schedule
  4. MIPS R6 Architecture Now Supported By GCC
  5. LowRISC To Feature Tagged Memory & Minion Cores
  6. Intel Skylake Audio Support For Linux 3.19
  7. After 10+ Years, NetworkManager Reaches v1.0
  8. VDPAU Updated To v0.9
  9. An Open Hardware Random Number Generator Proposed
  10. LLVM 3.6 Will Be Branched Next Month
Latest Forum Discussions
  1. Are there an app using HSA ?
  2. Need some hand holding with upgrading xserver
  3. The New SuperTuxKart Looks Better, But Can Cause GPU/Driver Problems
  4. XLennart: A Game For Systemd Haters With Nothing Better To Do
  5. Updated and Optimized Ubuntu Free Graphics Drivers
  6. Debian init discussion in Phoenix Wright format
  7. FPS capped on Linux (AMD fglrx drivers)
  8. Bench specific mount point