1. Computers
  2. Display Drivers
  3. Graphics Cards
  4. Memory
  5. Motherboards
  6. Processors
  7. Software
  8. Storage
  9. Operating Systems


Facebook RSS Twitter Twitter Google Plus


Phoronix Test Suite

OpenBenchmarking.org

Phoromatic Tracker Strides Forward

Phoronix

Published on 12 March 2010 10:20 AM EST
Written by Michael Larabel in Phoronix
4 Comments

Following in the success of the Phoronix Test Suite, last month we launched Phoromatic as a remote test management system targeted for enterprise users of the Phoronix Test Suite that allows the automatic scheduling of tests, remote installation of new tests, and the management of multiple test systems all through an intuitive, easy-to-use web interface. Whether you are looking to build a test farm or just benchmark systems around the world, Phoromatic can turn this otherwise taxing work into a really easy process with turn-key deployment capabilities. As an extension of Phoromatic, we then wrote Phoromatic Tracker that is designed to track any software component (either on a timed or per-commit basis) and automatically execute a set of tests each time around all in an autonomous matter and then pump the data back to the Phoromatic server and showcase it on the Phoromatic Tracker interface.

To showcase the capabilities of the Phoronix Test Suite combined with Phoromatic, we launched a reference implementation back in December by building a kernel test farm. Since December we have been monitoring the performance of the Linux kernel and its latest code on a daily basis over at kernel-tracker.phoromatic.com. The Phoromatic Tracker for the Linux kernel has already pointed out a few performance regressions during the Linux 2.6.33 and 2.6.34 development cycles all in an autonomous manner.

Phoromatic Tracker Strides Forward


A few weeks back we added an Atom Z530 test-system running with a Btrfs file-system and another system using a dual-core Atom 330. This month though we have been enriching Phoromatic and the Tracker extension further by adding several new features as well as building another Phoromatic Tracker implementation that will be made public later this month.

The Phoromatic Server is now able to take advantage of underlying improvements made in the Phoronix Test Suite 2.6 development code thus far to provide better rendering of SVG graphs, quicker loading of Phoromatic Tracker pages, faster merging of test results, and other key improvements. We have also been investing in making specific improvements to Phoromatic Tracker, some of which are now public.

The automated regression detector available through Phoromatic Tracker (such as on the kernel page) is now smarter and can better handle multiple systems, the page size with its graph is now of a smaller file size, and we have begun adding additional overview-type graphs to the page. Through the options found at the top of the Phoromatic Tracker page you can access graphs that generate show the geometric mean and aggregate sum for all of the actual tests that day. This way rather than having to look at the detected regressions table or needing to scroll through 60+ graphs daily, you can look at these overview graphs that can indicate if there are any major changes on a given day to warrant digging deeper. We will also be adding overviews for other types such as weighted means.

Some other features that will be launched when we introduce our new tracker later this month is RSS notifications for new test results, a real-time ETA for how long until a test system is expected to upload new test results along with its current position in the test queue, an integrated test/system log viewer, and a few other features we'll hold back on announcing until they're launched.

The new, yet-to-be-announced tracker coming later this month will start out with three test systems that are pumping benchmarks out 24/7 (two of which systems are the new MSI Wind Box nettops, but more systems are expected to be added) and the test suite being run is even larger than our kernel tracker with there being 70+ tests as part of its execution queue. This public tracker should also be of great benefit to a particular Linux community in a similar fashion to our kernel tracker.

You can join in on the automated testing fun by grabbing the Phoronix Test Suite at Phoronix-Test-Suite.com and you can even make a free account at Phoromatic.com. Organizations looking to install a Phoromatic Server and/or the Phoromatic Tracker on their intranet can contact PTS Commercial for licensing details or to obtain professional support for the Phoronix Test Suite.

Stay tuned for more announcements.

Latest Linux Hardware Reviews
  1. Overclocking The AMD AM1 Athlon & Sempron APUs
  2. AMD Athlon 5350 / 5150 & Sempron 3850 / 2650
  3. Upgraded Kernel & Mesa Yield A Big Boost For Athlon R3 Graphics
  4. AMD Athlon 5350 APU On Linux
Latest Linux Articles
  1. A Quick Look At GCC 4.9 vs. LLVM Clang 3.5
  2. Are AMD Athlon/Sempron APUs Fast Enough For Steam On Linux?
  3. AMD Athlon's R3 Graphics: RadeonSI Gallium3D vs. Catalyst
  4. GCC 4.9 Compiler Optimization Benchmarks For Faster Binaries
Latest Linux News
  1. Trying Out Radeon R9 290 Graphics On Open-Source
  2. Intel Broadwell GT3 Graphics Have Dual BSD Rings
  3. Early Linux 3.15 Benchmarks Of Intel Core i7 + Radeon
  4. Red Hat Releases Its RHEL 7 Release Candidate
  5. New Features Coming To Xubuntu 14.04 LTS
  6. NVIDIA Officially Releases CUDA 6
  7. Google Releases An AutoFDO Converter For Perf In LLVM
  8. Fedora 21 To Evaluate Remote Journal Logging, 64-bit ARM Emulation
  9. Star Citizen Will Be Coming To Linux
  10. Ubuntu 14.10 Convergence To Focus On Replacing Core Apps
  11. The Results Of Optimizing Radeon's VRAM Behavior
  12. Kernel Developers Discuss Improving Kernel Configurations
Latest Forum Discussions
  1. Linux Kernel Developers Fed Up With Ridiculous Bugs In Systemd
  2. The GNOME Foundation Is Running Short On Money
  3. Bye bye BSD, Hello Linux: A Sys Admin's Story
  4. New tool for undervolt/overclock AMD K8L and K10 processors
  5. How to enable opengl 3.3 on r9 270?
  6. R290x sound problems
  7. radeon-profile: tool for changing profiles and monitoring some GPU parameters
  8. Torvalds Is Unconvinced By LTO'ing A Linux Kernel