NVIDIA Jetson AGX Xavier Benchmarks - Incredible Performance On The Edge

So much power does the Jetson AGX Xavier Developer Kit draw under load?

When running a variety of benchmarks via the Phoronix Test Suite, it was monitoring the AC system power consumption using a WattsUp Pro power meter. The average power draw was just 20 Watts under load while the peak hit 47 Watts, which is about double the Jetson TX2, but for most workloads as shown the performance improvement is way more than doubled... Performance-per-watt metrics coming up next in this article.

While carrying out the same tests, the Phoronix Test Suite was also monitoring the SoC temperature. The Jetson AGX Xavier Developer Kit with its large heatsink did lead to much lower operational temperatures than the stock Jetson TX2. The temperature at idle was about 34 degrees with an average load temperature of 42 degrees and a peak of 50 degrees, compared to the TX2 having an average temperature of 50 degrees and a peak of 61.

While running AlexNet at INT8 with a batch size of 32, the AGX Xavier had an average power draw of 15 Watts compared to 9 Watts on the TX2.

But even with the increased power use, the Jetson AGX Xavier had a 5.8x improvement over the TX2 in this particular test.

The performance-per-Watt for GoogleNet at INT8 was 8x that of the Jetson TX2.

With FP16 precision for GoogleNet, the perf-per-Watt was still 2x over the TX2.