NVIDIA RTX 2000 & RTX 4000 Ada Generation Linux Performance

[phoronix]

Phoronix: NVIDIA RTX 2000 & RTX 4000 Ada Generation Linux Performance

NVIDIA recently sent over their RTX 2000 Ada Generation and RTX 4000 Ada Generation graphics cards suited for designers, engineers, and creative professionals. In my testing the past several weeks these professional graphics cards have been working out with NVIDIA's Linux driver stack -- including their open-source kernel modules now the default with the R555 driver series and later. While there is that previous article looking at how their open-source kernel drivers are at parity to the former proprietary kernel modules, today's article is looking at how the NVIDIA RTX 2000/4000 Ada Generation performance stacks up against the AMD Radeon Pro competition.

https://www.phoronix.com/review/nvidia-rtx-2000-4000-ada

[aerospace]

How do they behave in AI workloads (pytorch, ollama, whisper, tesseract...) ?

[sophisticles]

The one thing benchmarks such as these don't measure is stability.

NVIDIA's cards and drivers are extremely stable when working with large projects that take hours to finish, unless there's a power failure, they are bullet proof, you will not see a crash that stops the execution or kills the OS.

I am not saying that AMD's Pro cards are probe to this, but I own a Fermi based Quadro and that thing is rock solid.

This is why NVIDIA stock is considered a millionaire maker and why I can't bring myself to jump on AMD stock, even though there is positive movement today.

[r1348]

The one thing benchmarks such as these don't measure is stability.

NVIDIA's cards and drivers are extremely stable when working with large projects that take hours to finish, unless there's a power failure, they are bullet proof, you will not see a crash that stops the execution or kills the OS.

I am not saying that AMD's Pro cards are probe to this, but I own a Fermi based Quadro and that thing is rock solid.

This is why NVIDIA stock is considered a millionaire maker and why I can't bring myself to jump on AMD stock, even though there is positive movement today.

So you own a Nvidia card and it works very well. You don't own any AMD card and cannot speak for their stability. So you buy Nvidia stock but not AMD one even if it grows.

...

what?

[Michael]

The one thing benchmarks such as these don't measure is stability.

NVIDIA's cards and drivers are extremely stable when working with large projects that take hours to finish, unless there's a power failure, they are bullet proof, you will not see a crash that stops the execution or kills the OS.

I am not saying that AMD's Pro cards are probe to this, but I own a Fermi based Quadro and that thing is rock solid.

This is why NVIDIA stock is considered a millionaire maker and why I can't bring myself to jump on AMD stock, even though there is positive movement today.

I didn't encounter any stability issues at all thus nothing to add there.

[Type44Q]

This is why NVIDIA stock is considered a millionaire maker and why I can't bring myself to jump on AMD stock, even though there is positive movement today.

That was painful to read: not only are your powers of reasoning nonexistent, you've demonstrated that you lack a basic understanding of how the stock market works.

[pWe00Iri3e7Z9lHOX2Qx]

Even going back several generations, the RTX 4000 has been quite impressive performance wise for a single slot card. Efficiency on the RTX 2000 series cards is also quite good. I bought a Lenovo P520 on eBay a year ago that had the older generation 12GB RTX A2000. I flipped the card for > $350 and ended up with a nice computer to slap a Radeon GPU in for < $200 .

[pWe00Iri3e7Z9lHOX2Qx]

Also, an interesting example of resale value for workstation GPUs. The old Turing RTX 4000 and one year newer RDNA1 Radeon Pro W5700 have similar specs and performance.

RTX 4000

Graphics Processor TU104
Cores 2304
TMUs 144
ROPs 64
Memory Size 8 GB
Memory Type GDDR6
Bus Width 256 bit

Radeon Pro W5700

Graphics Processor Navi 10
Cores 2304
TMUs 144
ROPs 64
Memory Size 8 GB
Memory Type GDDR6
Bus Width 256 bit

The RTX 4000 sells for >= $300 USD. The Radeon Pro W5700 sells for < $150. The RTX 4000 being a single slot 8 pin card vs the dual slot 8 + 6 pin W5700 certainly helps, but there's a lot of value in CUDA and its ubiquity.

[sdack]

That was painful to read: not only are your powers of reasoning nonexistent, you've demonstrated that you lack a basic understanding of how the stock market works.

I thought it was a funny read. It has a lot of simple-minded fans on the Phoronix forums. That someone concludes from owning a card to an entire brand being rock solid is already funny. To then talk of stocks and millionaires takes a religious mind leap. Stuff like this makes me want to read a paperback sci-fi novel. Nothing beats a wild string of fantastic tangents to boggle the mind.

[QwertyChouskie]

Bummer that AMD still struggles so much in the compute world.

I would be curious to see if there's much difference in the OpenCL benchmarks when using Mesa's rusticl OpenCL implementation vs ROCm's OpenCL implementation.