1. Computers
  2. Display Drivers
  3. Graphics Cards
  4. Memory
  5. Motherboards
  6. Processors
  7. Software
  8. Storage
  9. Operating Systems


Facebook RSS Twitter Twitter Google Plus


Phoronix Test Suite

OpenBenchmarking.org

PTS 5.2 M2: Build A New Test Farm In Minutes With Phoromatic

Phoronix

Published on 19 May 2014 01:00 AM EDT
Written by Michael Larabel in Phoronix
Comment On This Article

Phoronix Test Suite 5.2-Khanino Milestone 2 is now available and it has working all of the fundamentals of the new Phoromatic server and client features for easily and quickly building your own open-source test farm.

PTS 5.2 M2: Build A New Test Farm In Minutes With Phoromatic


As most reading this article probably know, Phoromatic is the component to the Phoronix Test Suite for providing centralized test management and orchestration capabilities... Phoromatic allows the automatic scheduling of tests, remote installation of new tests, and the management of multiple test systems all through an intuitive, easy-to-use web interface. Phoromatic is mostly an enterprise-oriented feature for those wishing to run benchmarks on a routine basis across a large test farm / cluster of systems. Phoromatic has been under development for the past half-decade.

PTS 5.2 M2: Build A New Test Farm In Minutes With Phoromatic


Up to now the Phoromatic server has been publicly available at Phoromatic.com as a hosted instance but with Phoronix Test Suite 5.2-Khanino, there's a brand new server and it's mostly open-source and mainline with the Phoronix Test Suite itself. The only bits not part of the Phoromatic server within the phoronix-test-suite source tree is the add-on module to deal with local "behind the firewall" results management/analytics and other strictly enterprise-oriented features for those that don't want their data stored in the OpenBenchmarking.org cloud. For interested enterprises in these features or other work, contact us.

PTS 5.2 M2: Build A New Test Farm In Minutes With Phoromatic


With Phoronix Test Suite 5.2 Milestone 2, the foundation is laid well. The new Phoromatic server is working well; on any Phoronix Test Suite 5.2 M2+ system, simply run phoronix-test-suite start-phoromatic-server to deploy a Phoromatic server instance. The only new potential dependency is PHP5 SQLite support, but that's easily obtainable on nearly all Linux distributions. The web server component is self-hosted using the built-in server of recent versions of PHP and HHVM. There's also going to be supported WebSocket communication support similar to our HTML5 GUI introduced in PTS 5.0-Plavsk.

PTS 5.2 M2: Build A New Test Farm In Minutes With Phoromatic


Once deploying a Phoromatic server locally using the aforementioned command, it's just a matter of connecting to the server via a web-browser. When connected, you can quickly create a new account and from the main page it walks through the basic setup steps, which are very easy. For other systems you wish to have managed by the Phoromatic server, it comes down to running a command like phoronix-test-suite phoromatic.connect 192.168.1.211:5441/8PM85S based upon your IP/port of course and account information. After approving the connected systems via the web interface, you can create a test schedule either on a timed basis (e.g. nightly testing) or on a triggered basis. A trigger to Phoromatic can be virtually anything like a Git commit, new package, or anything else. Triggers can be passed to the Phoromatic server via a customized URL and from there the Phoromatic server will pass the "trigger" to the connected test systems along with any necessary scripts for setting the system context prior to benchmarking (e.g. installing a software component from the specified Git commit hash passed as the trigger) and then proceed to benchmarking, uploading the data to OpenBenchmarking.org, and then making it available via the centralized Phoromatic web interface.

PTS 5.2 M2: Build A New Test Farm In Minutes With Phoromatic


That's the short story of the Phoromatic walk-through. I've also recorded a brief, impromptu video tonight trying to show off a bit more of it... The hastily recorded video is embedded below, though I encourage interested parties to just try out the new Phoromatic code themselves; just make sure you're running Phoronix Test Suite 5.2 Milestone 2 or newer on both ends. There's also many TODO list items remaining and a ton of other improvements I intend to land in the next few days, but overall the foundation is in place so bug-fixes and other new additions should come quite quickly. Of course, code contributions are also welcome, Phoronix Test Suite is on GitHub, while commercial support is also most welcome.


Other changes outside of the new Phoromatic code to find with Phoronix Test Suite 5.2 Milestone 2 is new line graph improvements, various bug fixes, a RUN_TESTS_IN_RANDOM_ORDER environment variable to cause tests to run in a randomized order, and various other changes. The official Phoronix Test Suite 5.2-Khanino release is expected in June.

Download the Phoronix Test Suite for free at Phoronix-Test-Suite.com.

About The Author
Michael Larabel is the principal author of Phoronix.com and founded the web-site in 2004 with a focus on enriching the Linux hardware experience and being the largest web-site devoted to Linux hardware reviews, particularly for products relevant to Linux gamers and enthusiasts but also commonly reviewing servers/workstations and embedded Linux devices. Michael has written more than 10,000 articles covering the state of Linux hardware support, Linux performance, graphics hardware drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org automated testing software. He can be followed via and or contacted via .
Latest Linux Hardware Reviews
  1. A Walkthrough Of The New 32 System Open-Source Linux Benchmarking Test Farm
  2. Habey MITX-6771: Mini-ITX Board With Quad-Core J1900 Bay Trail
  3. OCZ Vector 150 SSD On Linux
  4. Noctua i4 CPU Cooler: Great For Cooling High-End LGA-2011v3 CPUs
Latest Linux Articles
  1. AMD Kaveri: Open-Source Radeon Gallium3D vs. Catalyst 14.12 Omega Driver
  2. 12-Way AMD Catalyst 14.12 vs. NVIDIA 346 Series Linux GPU Comparison
  3. AMD Catalyst 14.12 Omega Driver Brings Mixed Results For Linux Users
  4. 6-Way Winter 2014 Linux Distribution Comparison
Latest Linux News
  1. An Open Hardware Random Number Generator Proposed
  2. LLVM 3.6 Will Be Branched Next Month
  3. Opera Browser Puts Out Linux Updates For The Holidays
  4. GNOME Shell 3.15.3 Adds Support For High-Contrast Themes
  5. Linux 3.19: ThinkPad Muting Redone, New Dell Backlight Support, Acer Is Banging
  6. KVM Drops Support For IA64 While Adding Various x86 Improvements
  7. GCC 4.8.4 Officially Released
  8. FSF's High Priority Project List Now Has A Committee
  9. Details On Using OpenACC & GPUs With GCC
  10. Ubuntu 15.04 Alpha 1 For Its Various Flavors
Latest Forum Discussions
  1. Debian init discussion in Phoenix Wright format
  2. The New SuperTuxKart Looks Better, But Can Cause GPU/Driver Problems
  3. Need some hand holding with upgrading xserver
  4. XLennart: A Game For Systemd Haters With Nothing Better To Do
  5. FPS capped on Linux (AMD fglrx drivers)
  6. Are there an app using HSA ?
  7. Bench specific mount point
  8. Tool for measuring FPS in games