HN

Need help?
<- Back
GPU-unlock: FP/BF16 instruction issue rate on Nvidia 3000's cards

GPU-unlock: FP/BF16 instruction issue rate on Nvidia 3000's cards

fragebogen

Comments (45)

  • RachelF
    A semi related: a patch for those with multiple cards. You can unlock around 20% increased card to card speed on consumer GPUs using this library:https://github.com/aikitoria/open-gpu-kernel-modulesThe hardware supports it, but then Nvidia disabled it if the driver detects cheaper cards. This bypasses the NVidia slowdown.
  • Zagitta
    Hey this is my work, although the exploits etc aren't my ideas by any means. This is just a way to wrap the whole thing up in a much less annoying package than having to patch the nvidia driver. I originally got inspired by the CMP90/50 windows unlocks that run as standalone UEFI modules that chainloads into the OS.Happy to answer questions!
  • jacquesm
    This one is real, but there are some caveats:- you will need to run your card hotter than you might be comfortable with- the real pay-off (on some cards, apparently, see downthread) requires increasing the maximum power to 450W- This is well above what the stock cooler was designed for so a bit more cooling would helpWhat's nice is that you can stack this mod on top of (or rather, below of, this one loads first) the p2p mod that has been out for a while, they don't seem to interfere with each other.
  • Tiberium
    I've tested myself and the results are legit, this is incredible, even if a little risky (it relies on exploiting firmware): https://github.com/Zagitta/gpu-unlock/blob/main/docs/How%20A...> Unfortunately for Nvidia the booter is vulnerable to a classic buffer overflow that writes straight into the stack which gives us the ability to execute code via Return Oriented Programming (ROP).Repo for RTX 4090 and 4070 Ti Super: https://github.com/JustAResearcher/gpu-unlock-ada
  • londons_explore
    The next version is sure to have signed firmware which sets these configurations to prevent this sort of thing.
  • Scene_Cast2
    Really interesting.On the other hand, this only applies to a limited set of workloads (training is often memory bandwidth bound for example).I also wonder how this affects power consumption.
  • gawacer
    cool
  • superkuh
    Uh, no. This headline is wrong. It's FP32 unlocked from being halved, not 16 bit ops. And to be clear, over the last week I've looked many places and I've not seen any reports of this unlock being applied to any 3xxx card except the 3090/3090ti series. Even if it might apply more generally in theory.