System76 Thelio Astra Reviewed: High-End ARM64 Developer Desktop

Written by Michael Larabel in Computers on 22 October 2024 at 11:00 AM EDT. Page 3 of 6. 21 Comments.
Timed LLVM Compilation benchmark with settings of Build System: Ninja. System76 Thelio Major TR 7980X was the fastest.
Timed Godot Game Engine Compilation benchmark with settings of Time To Compile. System76 Thelio Major TR 7980X was the fastest.

While the Threadripper 7980X workstation is 64-cores / 128-threads and the new Thelio Astra with Ampere Altra Max M128-30 is with 128 physical cores, for code compilation the Threadripper system was faster. Not too surprising since SMT works well for code compilation performance and the Threadripper 7980X boosting up to 5.1GHz compared to 3.0GHz with the Ampere Altra processor.

Timed Godot Game Engine Compilation benchmark with settings of Time To Compile. System76 Thelio Major TR 7980X was the fastest.

From a CPU power efficiency perspective though the Ampere Altra workstation is very competitive with it running at around a 100 Watt average and peak of 201 Watts during code compilation compared to the Threadripper 7980X at a 242 Watt average and a 353 Watt peak. The Ampere Altra workstation could achieve a Godot build with 20.9k Joules compared to the Threadripper at 24.5k Joules.

XNNPACK benchmark with settings of Model: FP32MobileNetV1. System76 Thelio Astra Altra M128-30 was the fastest.
XNNPACK benchmark with settings of Model: FP32MobileNetV2. System76 Thelio Astra Altra M128-30 was the fastest.
XNNPACK benchmark with settings of Model: FP16MobileNetV2. System76 Thelio Astra Altra M128-30 was the fastest.
XNNPACK benchmark with settings of Model: FP16MobileNetV3Large. System76 Thelio Astra Altra M128-30 was the fastest.
XNNPACK benchmark with settings of Model: FP16MobileNetV3Small. System76 Thelio Astra Altra M128-30 was the fastest.
XNNPACK benchmark with settings of Model: QS8MobileNetV2. System76 Thelio Astra Altra M128-30 was the fastest.

With XNNPACK as this Google library for high efficiency floating-point neural network inference operators, the System76 Thelio Astra was delivering good performance in relation to the System76 Thelio Major x86_64 based workstation.

Numpy Benchmark benchmark with settings of . System76 Thelio Major TR 7980X was the fastest.
oneDNN benchmark with settings of Harness: Convolution Batch Shapes Auto, Engine: CPU. System76 Thelio Major TR 7980X was the fastest.
oneDNN benchmark with settings of Harness: Deconvolution Batch shapes_3d, Engine: CPU. System76 Thelio Major TR 7980X was the fastest.
oneDNN benchmark with settings of Harness: Recurrent Neural Network Training, Engine: CPU. System76 Thelio Major TR 7980X was the fastest.
oneDNN benchmark with settings of Harness: Recurrent Neural Network Inference, Engine: CPU. System76 Thelio Major TR 7980X was the fastest.
Whisper.cpp benchmark with settings of Model: ggml-small.en, Input: 2016 State of the Union. System76 Thelio Major TR 7980X was the fastest.
Whisper.cpp benchmark with settings of Model: ggml-medium.en, Input: 2016 State of the Union. System76 Thelio Major TR 7980X was the fastest.
Whisper.cpp benchmark with settings of Model: ggml-medium.en, Input: 2016 State of the Union. System76 Thelio Major TR 7980X was the fastest.

But some software packages do remain better optimized for x86_64 than ARM64... But this also works in favor as a selling point for the System76 Thelio Astra in being able to make capable ARM64 developer desktops more accessible to developers to better test and utilize AArch64.

Related Articles