NVIDIA Jetson AGX Xavier Benchmarks - Incredible Performance On The Edge

With various CPU workloads, the performance-per-Watt with the eight Carmel cores still represented a big improvement over the previous-generation Jetson TX2.

If you have NVIDIA TensorRT support installed on your system(s)/board(s), you can compare your own benchmark results to our Xavier inference benchmarks by running phoronix-test-suite benchmark 1812240-SP-XAVIER80657. To compare the Carmel CPU performance benchmarks, with the Phoronix Test Suite run phoronix-test-suite benchmark 1812248-SYST-JETSONC02.

The NVIDIA Jetson AGX Xavier offers an exceptional level of performance for putting immense compute power for "edge" deployments at under 50 Watts peak power consumption. It will be very interesting to also revisit the Jetson AGX Xavier performance in a few months when subsequent software optimizations are made as well as expanded use of the DLAs, etc. The Jetson AGX Xavier is capable of offering more than a few times better performance in key designed workloads and even for general CPU performance and other benchmarks the Carmel cores are much faster than what we have seen out of other developer boards to date along with delivering leading performance-per-Watt. About the only downside to the Jetson AGX Xavier is the increased price that for retail of the developer kit is hitting $2500 USD (though NVIDIA Developer Program members are able to buy them at $1,299 USD) or just $1399 for the Xavier module (or $1,099 USD in quantities of 1000+ units). Given the massive generational performance difference from the Jetson TX2 to AGX Xavier, it would be interesting if NVIDIA were able to offer a "lite" version with say Volta 256-core GPU with four or six Carmel cores at a lower price and would still likely end up offering hefty performance gains over the TX2.

Stay tuned for more benchmarks of the Jetson AGX Xavier coming up on Phoronix and thanks to NVIDIA for sending over this board for benchmarking.