1. Computers
  2. Display Drivers
  3. Graphics Cards
  4. Memory
  5. Motherboards
  6. Processors
  7. Software
  8. Storage
  9. Operating Systems


Facebook RSS Twitter Twitter Google Plus


Phoronix Test Suite

OpenBenchmarking.org

What Shall We Benchmark Next? Let Us Know!

Phoronix

Published on 18 March 2010 12:37 PM EDT
Written by Michael Larabel in Phoronix
104 Comments

With Phoromatic we make it easy to build a test farm for benchmarking and automated regression management and to prove it we began monitoring the Linux kernel performance on a daily basis where we track the performance of the latest Linux kernel code on a daily basis using multiple systems. This has been going on for months and then yesterday we announced that Phoromatic reached a 1.0 status and that we have launched Phoromatic Ubuntu Tracker, a way to monitor the performance of Ubuntu Linux as a whole on a daily basis by benchmarking the most recent development packages. A day has passed so now we are already thinking of what next to add to our test farm for continuous performance tracking.

Back in December we did launch a Fedora performance tracker, but that didn't go too far as tracking Rawhide wasn't the best since some package updates would leave the system in a broken state and would require manual intervention to resolve -- we like everything to be automated. One of the internal ideas have been to add another tracker that's tracking Ubuntu's performance, but with the xorg-edgers PPA to track specifically the latest Linux graphics performance. We'd love to have an upstream Mesa tracker following Git on a per-commit basis, but with there being the need at times to update the DRM / libdrm too, that makes matters a bit more complicated for automating in a reliable way, where as using the xorg-edgers PPA would be a bit more sane and easily reproducible by others. Right now the Ubuntu and Linux kernel trackers are doing everything on a daily basis, but Phoromatic is capable of monitoring the performance of a software component even more closely than that down to a per-commit basis or when triggered by other external factors, which would be great for tracking Mesa or other parts of the graphics stack. We've also thought about tracking the performance of LLVM (the Low-Level Virtual Machine), but haven't made any decisions yet and we are looking for comments from the community (and ideally any upstream projects) as to what you would like to see tracked for performance regressions/changes.

What Shall We Benchmark Next? Let Us Know!


There's the two systems for the kernel tracker (an ASRock NetTop ION 330 and a CompuLab Fit-PC2 NetTop) and then the new Ubuntu tracker systems (two MSI WindBox NetTops and an Apple Mac Mini) running within the Phoronix office. As you can see though, we have room for more systems (and plenty of hardware) as well as space on the network, so bring on the ideas for new Phoromatic Tracker setups. Granted, our only limiting factor for helping out more open-source projects with this is on the electrical side, but you can help us with that by subscribing to Phoronix Premium, using our shopping links when making online purchases (at like Amazon and NewEgg), making a tip/donation, and continuing to visit our sites and engage with our community via the forums whereby you are supporting the advertisements.

Share with us your ideas for what you would like to see tracked next. About the only requirements is the updating of the software must be able to be handled reliably in an automated way, there must be active interest within the community (we don't want a tracker that few people will benefit from), ideally interest from the upstream project itself, and it must be updated at least daily. Companies wishing to employ our automated regression tracking and remote test management system internally can contact PTS Commercial or try out the free public version of Phoromatic at Phoromatic.com.

About The Author
Michael Larabel is the principal author of Phoronix.com and founded the web-site in 2004 with a focus on enriching the Linux hardware experience and being the largest web-site devoted to Linux hardware reviews, particularly for products relevant to Linux gamers and enthusiasts but also commonly reviewing servers/workstations and embedded Linux devices. Michael has written more than 10,000 articles covering the state of Linux hardware support, Linux performance, graphics hardware drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org automated testing software. He can be followed via and or contacted via .
Latest Linux Hardware Reviews
  1. Acer B286HK: A 28-inch UHD LED 4K Monitor For As Low As $350
  2. Intel Xeon E5-1680 v3 & E5-2687W v3 Compared To The Core i7 5960X On Linux
  3. Intel 120GB 530 Series SSD Linux Performance
  4. Btrfs/EXT4/XFS/F2FS RAID 0/1/5/6/10 Linux Benchmarks On Four SSDs
Latest Linux Articles
  1. Mesa Git Yields Performance Improvements For Newer AMD GPUs
  2. Apple OS X 10.10 vs. Ubuntu 14.10 Performance
  3. Mesa 10.5-devel Brings Some Intel Haswell HD Graphics Changes Over Mesa 10.3
  4. NVIDIA vs. Nouveau Drivers With Linux 3.18 + Mesa 10.4-devel
Latest Linux News
  1. Wine 1.7.32 Updates Its Mono Engine
  2. Mesa 10.4 Release Candidate 3 Is Here For Weekend Testing
  3. GenodeOS 14.11 Now Supports Intel's Wireless Hardware
  4. Jolla Tablet Could Have Upgrades For MicroSDHC, Split Screen, 3.5G
  5. Intel Has Last Round Of DRM Changes For Linux 3.19, Starts Dropping DRI1/UMS
  6. Fedora 21 Release Candidate 1 Awaits Your Testing
  7. GCC 5 Adds Support For ARM's Cortex-A17
  8. KWayland Server Component Coming For KDE Plasma 5.2
  9. NVIDIA Posts Tegra Gallium3D Patch For K1+ Support
  10. Ubuntu 14.10 MacBook Air Tests With Linux 3.18, Mesa 10.5
Latest Forum Discussions
  1. Aliens vs predator for Linux
  2. Updated and Optimized Ubuntu Free Graphics Drivers
  3. Hurrican SDL Port
  4. Roadmap to Catalyst 14.10 ?
  5. how to configure module phoromatic ?
  6. PulseAudio 6.0 Is Coming & Other Linux Audio Plans For The Future
  7. Debian Developer Resigns From The Systemd Maintainership Team
  8. Cant get working Kaveri APU - A10-7850k