Announcement
Collapse
No announcement yet.
NVIDIA Releases TensorRT 8.0 With Big Performance Improvements
Collapse
X
-
Actually, I stand corrected, the very latest GA release, while officially only supporting 11.3, now proceeds to install with CUDA 11.4 installed, so shame on me.
-
Originally posted by anarki2 View PostNo it does not work. The TensorRT deb package won't install as it depends on the CUDA 11.3 deb packages.
Leave a comment:
-
Originally posted by zeroepoch View Post
See https://docs.nvidia.com/deeplearning....html#fntarg_2. CUDA 11.4 is supported by the GA now if you have a 470.xx driver. Making future CUDA versions work more seamlessly is something being worked on by the CUDA and TensorRT teams.
The page you linked doesn't mention CUDA 11.4 either, so I'm not sure what you're talking about tbh.
If you mean it's your empirical experience that if you manually extract the TensorRT 8 tarball somewhere and forcefully blend it with CUDA 11.4 and it appears to work for your specific use case, that's a different story. It is called "luck", not "support".Last edited by anarki2; 21 July 2021, 09:22 AM.
Leave a comment:
-
Originally posted by anarki2 View PostCool. It's been available in EA for months. OTOH still no CUDA 11.4 compatibility, which has been officially available for 3 weeks, which makes this TensorRT release even more pointless.
Leave a comment:
-
NVIDIA Releases TensorRT 8.0 With Big Performance Improvements
Phoronix: NVIDIA Releases TensorRT 8.0 With Big Performance Improvements
NVIDIA today is making available a much faster version of TensorRT, its SDK for optimized deep learning inference on their GPUs...
Tags: None
Leave a comment: