1. Computers
  2. Display Drivers
  3. Graphics Cards
  4. Memory
  5. Motherboards
  6. Processors
  7. Software
  8. Storage
  9. Operating Systems


Facebook RSS Twitter Twitter Google Plus


Phoronix Test Suite

OpenBenchmarking.org

PTS 5.2 M2: Build A New Test Farm In Minutes With Phoromatic

Phoronix

Published on 19 May 2014 01:00 AM EDT
Written by Michael Larabel in Phoronix
Comment On This Article

Phoronix Test Suite 5.2-Khanino Milestone 2 is now available and it has working all of the fundamentals of the new Phoromatic server and client features for easily and quickly building your own open-source test farm.

PTS 5.2 M2: Build A New Test Farm In Minutes With Phoromatic


As most reading this article probably know, Phoromatic is the component to the Phoronix Test Suite for providing centralized test management and orchestration capabilities... Phoromatic allows the automatic scheduling of tests, remote installation of new tests, and the management of multiple test systems all through an intuitive, easy-to-use web interface. Phoromatic is mostly an enterprise-oriented feature for those wishing to run benchmarks on a routine basis across a large test farm / cluster of systems. Phoromatic has been under development for the past half-decade.

PTS 5.2 M2: Build A New Test Farm In Minutes With Phoromatic


Up to now the Phoromatic server has been publicly available at Phoromatic.com as a hosted instance but with Phoronix Test Suite 5.2-Khanino, there's a brand new server and it's mostly open-source and mainline with the Phoronix Test Suite itself. The only bits not part of the Phoromatic server within the phoronix-test-suite source tree is the add-on module to deal with local "behind the firewall" results management/analytics and other strictly enterprise-oriented features for those that don't want their data stored in the OpenBenchmarking.org cloud. For interested enterprises in these features or other work, contact us.

PTS 5.2 M2: Build A New Test Farm In Minutes With Phoromatic


With Phoronix Test Suite 5.2 Milestone 2, the foundation is laid well. The new Phoromatic server is working well; on any Phoronix Test Suite 5.2 M2+ system, simply run phoronix-test-suite start-phoromatic-server to deploy a Phoromatic server instance. The only new potential dependency is PHP5 SQLite support, but that's easily obtainable on nearly all Linux distributions. The web server component is self-hosted using the built-in server of recent versions of PHP and HHVM. There's also going to be supported WebSocket communication support similar to our HTML5 GUI introduced in PTS 5.0-Plavsk.

PTS 5.2 M2: Build A New Test Farm In Minutes With Phoromatic


Once deploying a Phoromatic server locally using the aforementioned command, it's just a matter of connecting to the server via a web-browser. When connected, you can quickly create a new account and from the main page it walks through the basic setup steps, which are very easy. For other systems you wish to have managed by the Phoromatic server, it comes down to running a command like phoronix-test-suite phoromatic.connect 192.168.1.211:5441/8PM85S based upon your IP/port of course and account information. After approving the connected systems via the web interface, you can create a test schedule either on a timed basis (e.g. nightly testing) or on a triggered basis. A trigger to Phoromatic can be virtually anything like a Git commit, new package, or anything else. Triggers can be passed to the Phoromatic server via a customized URL and from there the Phoromatic server will pass the "trigger" to the connected test systems along with any necessary scripts for setting the system context prior to benchmarking (e.g. installing a software component from the specified Git commit hash passed as the trigger) and then proceed to benchmarking, uploading the data to OpenBenchmarking.org, and then making it available via the centralized Phoromatic web interface.

PTS 5.2 M2: Build A New Test Farm In Minutes With Phoromatic


That's the short story of the Phoromatic walk-through. I've also recorded a brief, impromptu video tonight trying to show off a bit more of it... The hastily recorded video is embedded below, though I encourage interested parties to just try out the new Phoromatic code themselves; just make sure you're running Phoronix Test Suite 5.2 Milestone 2 or newer on both ends. There's also many TODO list items remaining and a ton of other improvements I intend to land in the next few days, but overall the foundation is in place so bug-fixes and other new additions should come quite quickly. Of course, code contributions are also welcome, Phoronix Test Suite is on GitHub, while commercial support is also most welcome.


Other changes outside of the new Phoromatic code to find with Phoronix Test Suite 5.2 Milestone 2 is new line graph improvements, various bug fixes, a RUN_TESTS_IN_RANDOM_ORDER environment variable to cause tests to run in a randomized order, and various other changes. The official Phoronix Test Suite 5.2-Khanino release is expected in June.

Download the Phoronix Test Suite for free at Phoronix-Test-Suite.com.

About The Author
Michael Larabel is the principal author of Phoronix.com and founded the web-site in 2004 with a focus on enriching the Linux hardware experience and being the largest web-site devoted to Linux hardware reviews, particularly for products relevant to Linux gamers and enthusiasts but also commonly reviewing servers/workstations and embedded Linux devices. Michael has written more than 10,000 articles covering the state of Linux hardware support, Linux performance, graphics hardware drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org automated testing software. He can be followed via and or contacted via .
Latest Linux Hardware Reviews
  1. ASRock X99 Extreme3 Is An Affordable Choice For Linux Users
  2. A Walkthrough Of The New 32 System Open-Source Linux Benchmarking Test Farm
  3. Habey MITX-6771: Mini-ITX Board With Quad-Core J1900 Bay Trail
  4. OCZ Vector 150 SSD On Linux
Latest Linux Articles
  1. 2014 Year-End NVIDIA Linux Benchmark Comparison
  2. 2014 Catalyst Linux Graphics Benchmarks Year-In-Review
  3. 17-Way Linux Graphics Card Comparison With Civilization Beyond Earth
  4. AMD Kaveri: Open-Source Radeon Gallium3D vs. Catalyst 14.12 Omega Driver
Latest Linux News
  1. GNU Binutils 2.25 Released With Port To Andes NDS32
  2. Merry Christmas & Happy Holidays 2014
  3. OpenMW 0.34 Released With Many Changes
  4. Ruby 2.2 Released With A Better Garbage Collector
  5. Xonotic 0.8 Is Slowly Creeping Closer To Being Released
  6. NVIDIA Sends Out 11 Nouveau Patches For Christmas
  7. Kodi 14.0 Released For The Holidays - Formerly Known As XBMC
  8. Devuan Is Still Moving Along As A Debian Fork Without Systemd
  9. UEFI Secure Boot Tools Updated For v2.4
  10. Phoronix Test Suite 5.4.1 Released
Latest Forum Discussions
  1. Why is it that Radeon cannot run good old (ancient) Doom 3 engine games?
  2. Aliens vs predator for Linux
  3. Debian init discussion in Phoenix Wright format
  4. FPS capped on Linux (AMD fglrx drivers)
  5. Speeding up systemd networking service
  6. Storm Engine 2 (Doom 3 BFG GPL fork) got entry on IndieDb
  7. Need some hand holding with upgrading xserver
  8. New build, first Linux PC, what could go wrong? ;)