1. Computers
  2. Display Drivers
  3. Graphics Cards
  4. Memory
  5. Motherboards
  6. Processors
  7. Software
  8. Storage
  9. Operating Systems


Facebook RSS Twitter Twitter Google Plus


Phoronix Test Suite

OpenBenchmarking.org

PTS 5.2 M2: Build A New Test Farm In Minutes With Phoromatic

Phoronix

Published on 19 May 2014 01:00 AM EDT
Written by Michael Larabel in Phoronix
Comment On This Article

Phoronix Test Suite 5.2-Khanino Milestone 2 is now available and it has working all of the fundamentals of the new Phoromatic server and client features for easily and quickly building your own open-source test farm.

PTS 5.2 M2: Build A New Test Farm In Minutes With Phoromatic


As most reading this article probably know, Phoromatic is the component to the Phoronix Test Suite for providing centralized test management and orchestration capabilities... Phoromatic allows the automatic scheduling of tests, remote installation of new tests, and the management of multiple test systems all through an intuitive, easy-to-use web interface. Phoromatic is mostly an enterprise-oriented feature for those wishing to run benchmarks on a routine basis across a large test farm / cluster of systems. Phoromatic has been under development for the past half-decade.

PTS 5.2 M2: Build A New Test Farm In Minutes With Phoromatic


Up to now the Phoromatic server has been publicly available at Phoromatic.com as a hosted instance but with Phoronix Test Suite 5.2-Khanino, there's a brand new server and it's mostly open-source and mainline with the Phoronix Test Suite itself. The only bits not part of the Phoromatic server within the phoronix-test-suite source tree is the add-on module to deal with local "behind the firewall" results management/analytics and other strictly enterprise-oriented features for those that don't want their data stored in the OpenBenchmarking.org cloud. For interested enterprises in these features or other work, contact us.

PTS 5.2 M2: Build A New Test Farm In Minutes With Phoromatic


With Phoronix Test Suite 5.2 Milestone 2, the foundation is laid well. The new Phoromatic server is working well; on any Phoronix Test Suite 5.2 M2+ system, simply run phoronix-test-suite start-phoromatic-server to deploy a Phoromatic server instance. The only new potential dependency is PHP5 SQLite support, but that's easily obtainable on nearly all Linux distributions. The web server component is self-hosted using the built-in server of recent versions of PHP and HHVM. There's also going to be supported WebSocket communication support similar to our HTML5 GUI introduced in PTS 5.0-Plavsk.

PTS 5.2 M2: Build A New Test Farm In Minutes With Phoromatic


Once deploying a Phoromatic server locally using the aforementioned command, it's just a matter of connecting to the server via a web-browser. When connected, you can quickly create a new account and from the main page it walks through the basic setup steps, which are very easy. For other systems you wish to have managed by the Phoromatic server, it comes down to running a command like phoronix-test-suite phoromatic.connect 192.168.1.211:5441/8PM85S based upon your IP/port of course and account information. After approving the connected systems via the web interface, you can create a test schedule either on a timed basis (e.g. nightly testing) or on a triggered basis. A trigger to Phoromatic can be virtually anything like a Git commit, new package, or anything else. Triggers can be passed to the Phoromatic server via a customized URL and from there the Phoromatic server will pass the "trigger" to the connected test systems along with any necessary scripts for setting the system context prior to benchmarking (e.g. installing a software component from the specified Git commit hash passed as the trigger) and then proceed to benchmarking, uploading the data to OpenBenchmarking.org, and then making it available via the centralized Phoromatic web interface.

PTS 5.2 M2: Build A New Test Farm In Minutes With Phoromatic


That's the short story of the Phoromatic walk-through. I've also recorded a brief, impromptu video tonight trying to show off a bit more of it... The hastily recorded video is embedded below, though I encourage interested parties to just try out the new Phoromatic code themselves; just make sure you're running Phoronix Test Suite 5.2 Milestone 2 or newer on both ends. There's also many TODO list items remaining and a ton of other improvements I intend to land in the next few days, but overall the foundation is in place so bug-fixes and other new additions should come quite quickly. Of course, code contributions are also welcome, Phoronix Test Suite is on GitHub, while commercial support is also most welcome.


Other changes outside of the new Phoromatic code to find with Phoronix Test Suite 5.2 Milestone 2 is new line graph improvements, various bug fixes, a RUN_TESTS_IN_RANDOM_ORDER environment variable to cause tests to run in a randomized order, and various other changes. The official Phoronix Test Suite 5.2-Khanino release is expected in June.

Download the Phoronix Test Suite for free at Phoronix-Test-Suite.com.

About The Author
Michael Larabel is the principal author of Phoronix.com and founded the web-site in 2004 with a focus on enriching the Linux hardware experience and being the largest web-site devoted to Linux hardware reviews, particularly for products relevant to Linux gamers and enthusiasts but also commonly reviewing servers/workstations and embedded Linux devices. Michael has written more than 10,000 articles covering the state of Linux hardware support, Linux performance, graphics hardware drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org automated testing software. He can be followed via and or contacted via .
Latest Linux Hardware Reviews
  1. The MSI X99S SLI PLUS Is Working & Running Well On Linux
  2. NVIDIA GeForce GTX 980: The Best GPU For Linux Gamers
  3. ROCCAT LUA: A Linux-Friendly Gaming Mouse
  4. Cheetah Mounts: The Affordable Way To Put Your TV On The Wall
Latest Linux Articles
  1. Preview: Radeon Gallium3D Performance For CS:GO On Linux
  2. XWayland Linux Gaming Performance With GNOME Wayland On Fedora 21
  3. EXT4/Btrfs/XFS/F2FS Benchmarks On Linux 3.17
  4. Fedora 21 Alpha First Impressions: It's Great
Latest Linux News
  1. Dash As The Default Shell For Fedora?
  2. CUPS Turn 15 Years Old, CUPS 2.0 Released
  3. VA-API Gallium3D State Tracker Added Back To Mesa
  4. Radeon DRM Gets New Information Ioctl Queries
  5. Mir 0.8 Works On Less ABI Breakage, Touchspots, Responsiveness
  6. CS:GO For Linux Gains Better Stability, Community Server Support
  7. NVIDIA Issues Updated 340.46 Long-Lived Driver Release
  8. KDE Plasma 5.1 Now In Beta
  9. Systemd & Debian Were Most Popular In September
  10. Microsoft Announces... Windows 10 With A Start Menu
Latest Forum Discussions
  1. Take the Steam Survey results with a grain of salt. It is flawed.
  2. X.Org Is Looking For Some Female Help
  3. Hacking Express gate (Asus Splashtop)
  4. Microsoft Announces... Windows 10 With A Start Menu
  5. NVIDIA Alerts Nouveau: They're Starting To Sign/Validate GPU Firmware Images
  6. Updated and Optimized Ubuntu Free Graphics Drivers
  7. Nero CD/DVD Burning Software On Linux Is Dead
  8. New Group Calls For Boycotting Systemd