Simply looking at the tables is not everything as they are actually interactive when using Phoromatic. You can go to any of the public Phoromatic Trackers and hover your cursor over that number and you will see the standard deviation for that test on a specific day along with any significant performance changes relative to the previous day as a percent. If you are working to analyze one of the spotted regressions, you can simply click on the date at the top of the graph and you are redirected to Phoromatic's integrated test log viewer -- another new feature of Phoromatic. From the integrated log viewer you are exposed to the system information that was autonomously supplied by the Phoronix Test Suite node (such as the dmesg, lspci, Xorg.0.log, and other relevant outputs). Here is a live example of the integrated log viewer.
There is also many other features to explore in Phoromatic and Phoromatic Tracker, but now it is time to share the other news. If you go over to http://ubuntu-tracker.phoromatic.com/ you can view our newest public tracker. The Phoromatic Ubuntu Tracker is providing results on a daily basis of the very latest Ubuntu packages. With the Phoromatic Ubuntu Tracker we are running over 70 benchmarks a day on three different systems -- a Core 2 Duo Mac Mini and two Atom 330 NetTops -- and the data collection period began earlier this month. From this tracker you are exposed to the very latest features as these test systems are running a development snapshot of Phoronix Test Suite 2.6 "Lyngen" with its latest Phoromatic client module. This tracker was launched in cooperation with Canonical and as a result there are these new features to Phoromatic Tracker (though many more features are on the way!) and Canonical has pledged to add systems going forward as they leverage this daily-updated data that allows them to understand how their constant stream of package updates is impacting the performance for many different components and spot regressions as they occur with minimal human labor. We will also be working on providing other functionality testing (suspend-and-resume support, etc) to Phoromatic and the Phoronix Test Suite. Other announcements to come.
Phoromatic and Phoromatic Tracker can also just as easily be used to facilitate regression monitoring and performance tracking for any other Linux distribution or software project. While the Phoronix Test Suite is most frequently shown off on Linux, you can use all of our testing software components across *BSD, Mac OS X, and OpenSolaris platforms too. The Windows support is also emerging.
Phoromatic 1.0 is, of course, only one part of the puzzle as one of the other key components that we are working expeditiously on is Phoronix Test Suite 2.6, which will be officially released in May. Phoronix Test Suite 2.6 (codenamed "Lyngen") brings even more features to our GPLv3-licensed automated testing platform that we have been issuing major updates quarterly since its inception, but we will save those details for another article. There is also Phoronix Global and we have already confirmed that it's due for some radical and unique changes with Phoronix Test Suite 3.0. Those looking to try out Phoromatic 1.0 / Phoromatic Tracker can create a free online account to manage your remote test systems at Phoromatic.com and be sure to visit our new Phoromatic Ubuntu Tracker to see the features from the tracking side. Organizations looking to deploy Phoromatic within an intranet for their own testing can contact us at commercial.phoronix-test-suite.com for licensing details and our professional services.
Discuss this article in our forums, IRC channel, or email the author. You can also follow our content via RSS and on social networks like Facebook, Identi.ca, and Twitter (@Phoronix and @MichaelLarabel). Subscribe to Phoronix Premium to view our content without advertisements, view entire articles on a single page, and experience other benefits.