PyTorch 2.0 Now Shipping With Better CPU & GPU Performance

Written by Michael Larabel in Programming on 15 March 2023 at 06:28 PM EDT. 16 Comments
Following the PyTorch Foundation talking up PyTorch 2.0 since the end of last year, today marks the PyTorch 2.0 release officially shipping. PyTorch 2.0 has significant optimizations to "supercharge" it with better performance for both CPU and GPU modes of operation.

PyTorch 2.0 uses torch/compile as its main API, TorchInductor with NVIDIA and AMD GPUs now relies on OpenAI Triton for the deep learning compiler, a Metal Performance Shaders back-end provides GPU-accelerated PyTorch on macOS, faster inference performance on AWS Graviton CPUs, and a variety of other new prototype features and technologies. For faster CPU operation is also several "critical" optimizations to the GNN inference and training as well as faster CPU performance by making use of Intel oneDNN Graph.

PyTorch logo

Downloads and more details on PyTorch 2.0 via
Related News
About The Author
Michael Larabel

Michael Larabel is the principal author of and founded the site in 2004 with a focus on enriching the Linux hardware experience. Michael has written more than 20,000 articles covering the state of Linux hardware support, Linux performance, graphics drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and automated benchmarking software. He can be followed via Twitter, LinkedIn, or contacted via

Popular News This Week