Tiny Corp Nearing "Completely Sovereign" Compute Stack For AMD GPUs With Tinygrad

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts
  • phoronix
    Administrator
    • Jan 2007
    • 67385

    Tiny Corp Nearing "Completely Sovereign" Compute Stack For AMD GPUs With Tinygrad

    Phoronix: Tiny Corp Closing In On "Completely Sovereign" Compute Stack For AMD GPUs With Tinygrad

    George Hotz' Tiny Corp that develops the Tinygrad neural network framework and sells the Tinybox NVIDIA and AMD powered AI workstations is nearing a "completely sovereign" software stack for GPU compute on AMD...

    Phoronix, Linux Hardware Reviews, Linux hardware benchmarks, Linux server benchmarks, Linux benchmarking, Desktop Linux, Linux performance, Open Source graphics, Linux How To, Ubuntu benchmarks, Ubuntu hardware, Phoronix Test Suite
  • shmerl
    Senior Member
    • Dec 2009
    • 3512

    #2
    Is it open source? If not, I don't see a point for anyone else in it.

    Comment

    • blackshard
      Senior Member
      • Oct 2009
      • 603

      #3
      Sounds like a scam

      Comment

      • geohot
        Junior Member
        • Jan 2025
        • 9

        #4
        Code is in tinygrad master, all MIT license. https://github.com/tinygrad/tinygrad/

        Here's the kernel driver replacement: https://github.com/tinygrad/tinygrad...rt/am/amdev.py

        Comment

        • geohot
          Junior Member
          • Jan 2025
          • 9

          #5
          And if you are new to tiny corp, this isn't some one off thing, it's something we have been working towards for 2 years.

          Our founding blog post: https://geohot.github.io/blog/jekyll...raised-5M.html

          Comment

          • rhysperry111
            Phoronix Member
            • Jun 2022
            • 54

            #6
            Curious if this could mean anything for mesa or amdgpu, or if they're just doing their own thing entirely?

            Comment

            • ms178
              Senior Member
              • Sep 2018
              • 1711

              #7
              By the way, has AMD released the firmware that tinycorp wanted to be open sourced? It was never heard of again.

              Comment

              • geohot
                Junior Member
                • Jan 2025
                • 9

                #8
                Of course not. They released some very halfassed MES documentation that's mostly copy paste from the kernel driver. https://gpuopen.com/download/documen..._scheduler.pdf

                We documented the 7900XTX pretty well though. https://github.com/tinygrad/7900xtx

                And the firmware isn't a big deal anymore. We don't even use the MES, and the MEC is 90% bypassed by using PM4 packets instead of AQL.

                Comment

                • Kjell
                  Senior Member
                  • Apr 2019
                  • 691

                  #9
                  Originally posted by geohot View Post
                  Code is in tinygrad master, all MIT license. https://github.com/tinygrad/tinygrad/

                  Here's the kernel driver replacement: https://github.com/tinygrad/tinygrad...rt/am/amdev.py
                  Is the entire driver done in slow Python?

                  Comment

                  • geohot
                    Junior Member
                    • Jan 2025
                    • 9

                    #10
                    It is! But why do you think Python is slow?

                    It's a compute driver, not for graphics. ML workloads look like resubmitting the same ~100ms to run queue pointing to different buffers over and over. Benchmark it, it outperforms any other way of running compute on AMD, particularly with multiple GPUs driven by a single process.

                    Comment

                    Working...
                    X