All benchmarking was handled in a fully automated and reproducible manner from test installation to execution and result analytics via the Phoronix Test Suite and OpenBenchmarking.org. The Phoronix Test Suite client is GPL software and has proven to be the leading choice for carrying out reliable and reproducible benchmarks in a fully automated manner on Linux, OS X, BSD, and Solaris operating systems.
Here's a full look at all of the system hardware and software:
As said in the earlier article, while the Phoronix Test Suite can measure the overall system power consumption plus generate performance-per-Watt results automatically for each benchmark result (and a variety of other system vitals; it's as easy as setting the MONITOR=all environment variable prior to running phoronix-test-suite and PERFORMANCE_PER_WATT=1) via a variety of means like ACPI, USB-based AC power monitors (WattsUp), IPMI, and other metrics, there is unfortunately no uniform way for measuring the power consumption in a fair manner across the spectrum of hardware being tested today. As such, the results being shown in this article are just the raw performance results. However, in future articles with a more slimmed and defined selection of hardware being compared (e.g. only an Ubuntu tablet comparison), performance-per-Watt data will be provided.