HN

Need help?
<- Back
CUDA for AMD on Windows

CUDA for AMD on Windows

chiassedu80

Comments (73)

  • linuxhansl
    Off-topic and somewhat of a rant, but I'd far prefer us all focusing on open standards like HIP, SYCL, OpenCL, etc.It's unbearable that most LLM inference happens on closed H/W, closed drivers, and closed SDKs.
  • swerner
    AI will take down Nvidia’s moat. When it becomes trivial to translate CUDA/PTX to HIP, SYCL or Metal, CUDA is no longer the moat, it becomes the intermediate representation.
  • triwats
    Interesting option for CDNA architecture chips. I wonder if this moves to an open standard?AMD GPUs build for AI specs for reference: https://flopper.io/gpus?vendor=AMD&page=1
  • lulzx
    I made cuda-metal btw (for mac kek), https://github.com/lulzx/cuda-metal
  • KennyBlanken
    To save everyone a click: No cuDNN and based off an ancient version of ROCm for windows (7.1 has been out for ages, 7.2 is current.)
  • Nurysso
    man i can't say how much i used to like cuda when i had a nvidia gpu it made ml so much fun and on amd its a war especially on rdna 2 cards which i have. hopefully one day we will be able to properly translate cuda for its amd counter parts
  • system2
    I wish there were a way to use RDNA1 cards with CUDA for AMD. My 5700XTs are sitting in a drawer.
  • latchkey
    There are also interesting efforts like:https://github.com/Zaneham/Boothhttps://scale-lang.com/
  • chiassedu80
    CUDA for AMD on WindowsI’ve been working on a Windows setup that lets CUDA-targeted applications run on AMD GPUs using ZLUDA + ROCm/HIP.Repo: https://github.com/Speedstu/CUDA-for-AMD-WindowsSo far, it has only been tested on my RX 9060 XT (gfx1200), where I’ve used it with CUDA-enabled LibTorch workloads, including long ai training and use.I also added a GPU scanner / auto-detection system that detects:AMD GPU modelgfxXXXX architectureROCm/HIP installationdriver infowhether the GPU has already been validated by the projectExample:RX 9060 XT → gfx1200 → RDNA4 → HIP detected → validatedThe goal now is to test it on more hardware, especially RX 6000 / 7000 / 9000 cards.If you have an AMD GPU on Windows and want to try it, I’d really appreciate compatibility reports working or broken. There’s a dedicated GPU compatibility issue template in the repo.If this is useful to you, a star would also help the project get more testers.