AMD ROCm 6.3.1 Released With Instinct MI325X Support, ROCm Runfile Installer

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts
  • phoronix
    Administrator
    • Jan 2007
    • 67395

    AMD ROCm 6.3.1 Released With Instinct MI325X Support, ROCm Runfile Installer

    Phoronix: AMD ROCm 6.3.1 Released With Instinct MI325X Support, ROCm Runfile Installer

    Building off the ROCm 6.3 release from earlier this month, there's been a Friday night drop of ROCm 6.3.1 with some rather exciting end-of-year improvements...

    Phoronix, Linux Hardware Reviews, Linux hardware benchmarks, Linux server benchmarks, Linux benchmarking, Desktop Linux, Linux performance, Open Source graphics, Linux How To, Ubuntu benchmarks, Ubuntu hardware, Phoronix Test Suite
  • NeoMorpheus
    Senior Member
    • Aug 2022
    • 605

    #2
    My google-fu is falling me, can someone link me to some kind of benchmarks results between the Mi300s and whatever ‘Ngreedia counterpart is?

    And hopefully, this time, the AMD haters dont spoil this one.

    Comment

    • justinkb
      Senior Member
      • Apr 2009
      • 151

      #3
      Does this include the bits that make it work through WSL on Windows? 6 1.3 did in beta, then and upgraded to official support with 6.2.3, but they never announced whether they would release all future versions with support for WSL use cases

      Comment

      • lonedd
        Junior Member
        • Jun 2024
        • 6

        #4
        Originally posted by NeoMorpheus View Post
        My google-fu is falling me, can someone link me to some kind of benchmarks results between the Mi300s and whatever ‘Ngreedia counterpart is?

        And hopefully, this time, the AMD haters dont spoil this one.
        Basically:

        image.png

        A little more detailed:

        There’s no denying Nvidia's historical dominance when it comes to AI training and inference. Nearly all production AI workloads run on their graphics cards. However, there’s been some optimism recently around AMD, seeing as the MI300X, their intended competitor to Nvidia's H100, is strictly better spec-wise. Yet even


        //edit: for some reason, phoronix adds some additional text to uri, added URL without linking.
        Last edited by lonedd; 23 December 2024, 06:36 AM.

        Comment

        • NeoMorpheus
          Senior Member
          • Aug 2022
          • 605

          #5
          Wow, thank you!

          So the ngreedia ai monopoly is simply because of cuda not the hardware?

          edit sorry, getting a 404 on that link.

          edit 2: found it.
          Last edited by NeoMorpheus; 23 December 2024, 06:34 AM.

          Comment

          • lonedd
            Junior Member
            • Jun 2024
            • 6

            #6
            Originally posted by NeoMorpheus View Post

            Wow, thank you!

            So the ngreedia ai monopoly is simply because of cuda not the hardware?
            I would happily pay the 15k for the MI300x instead of the 40K for the H100 and struggle a little with the software, expecting it to become better over time and saving 25K for each GPU.

            Struggling with the software is overstated, it has become very easy to use ROCm, especially with the pre-build docker images with pytorch and tensorflow working out of the box.

            Imho, AMD might pull an Intel against nGreedia, just needs some more time.

            Comment

            • NeoMorpheus
              Senior Member
              • Aug 2022
              • 605

              #7
              Originally posted by lonedd View Post

              I would happily pay the 15k for the MI300x instead of the 40K for the H100 and struggle a little with the software, expecting it to become better over time and saving 25K for each GPU.

              Struggling with the software is overstated, it has become very easy to use ROCm, especially with the pre-build docker images with pytorch and tensorflow working out of the box.

              Imho, AMD might pull an Intel against nGreedia, just needs some more time.
              If I were to believe everyone here and on X, you will think that ROCm is absolute trash.

              Then again, everyone also claims the same lie with AMD drivers

              Sadly, they need better PR or something, because their stocks and income is not reflecting your experience.

              Comment

              • lonedd
                Junior Member
                • Jun 2024
                • 6

                #8
                Originally posted by NeoMorpheus View Post

                If I were to believe everyone here and on X, you will think that ROCm is absolute trash.

                Then again, everyone also claims the same lie with AMD drivers

                Sadly, they need better PR or something, because their stocks and income is not reflecting your experience.
                I at least have achieved what I wanted to achieve, yes it was more than just double click, wait and use but as an experienced Linux User, especially with the Docker Containers ready to go, there really is not excuse tbh.

                Comment

                Working...
                X