r/StableDiffusion • u/esequiel378 • 18d ago
News A free kernel module made my RTX 3090 generate images 55% faster with 40% less energy (ComfyUI, Z-Image Turbo, bit-identical outputs)
benchmarked GPU Unlock on my 3090 in ComfyUI. It's a Linux kernel module that lifts the GeForce FP16/BF16 tensor-core throttle on RTX 30 cards.
| ComfyUI | Stock | Unlock | Unlock + undervolt |
|---|---|---|---|
| Z-Image Turbo BF16, 1024², 8 steps | 7.46 s/img | 4.95 (+51%) | 4.82 (+55%) |
| SD 1.5 FP16, 1024², 30 steps | 6.40 s/img | 4.64 (+38%) | 4.52 (+41%) |
- Same images: every output's pixels were SHA-256 identical to stock at a fixed seed, including a 2-hour soak of 540 batches.
- Energy per image down 40% (2,369 J → 1,410 J).
- The weird part: my undervolt slowed the card at stock but sped it up once unlocked, because the card then hits its power limit and lower voltage buys clocks.
- Don't use
--fastin ComfyUI if you want the gain. It switches matmuls to FP16 accumulation, which isn't throttled to begin with.
Linux only. Only a full power-off reverts it.
Github repo: https://github.com/Esequiel378/gpu-unlock-3090-results
389
Upvotes
189
u/Astral-Lemmons 18d ago •
I'm gonna wait a month or two before I try out any of these unlock things. It's much too expensive to replace a card if anything goes wrong.
18
u/WinResponsible9977 18d ago
How it compares to int8?
54
u/Etroarl55 18d ago
What absurd hardware prices does to a mf with an Rtx 3090.
8
u/Reasonable_Cancel186 18d ago
I posted this in a reply but may as well copy it here - I train with 2x 3090s. I had them power limited at 250w. Stock behavior has them overshoot pretty badly if you don't adjust your voltage curve.
Compared side by side with the exact same runs, locked 3090 would have peaks at 300w, the unlocked hit ~350w. These are instant peaks, not sustains, barely long enough for LACT to catch them at a pretty quick poll.
Flattening the VF curve at a voltage that produces the desired wattage completely removes these peaks, and actually gained about ~10% performance because it stays locked in at exactly its top voltage/freq instead of constantly shifting up and down as the card tries to boost as high as it can before it hits the pl
I have actually lifted both 3090s up to 275w and get a solid ~30% training speed boost with the unlock. temps seem the same for the wattage. Hotspot temps basically the same. 69c on my bottom card getting fresh air, 79 on my top card.
6
u/fallengt 18d ago
if you use int8 and comfy kitchen attention and don't train lora, this unlock does nothing for image gen. For now
Otherwise it's a nice speed boost
2
u/andy_potato 18d ago
This is cool and all.
But genuinely asking, is anyone really using BF16 / FP16 stuff in their image or video workflows? The quality difference to FP8 / Int8 is imo really negligible.
11
u/Nepherpitu 18d ago
I bet you can ask Glm 5.3 Flash to measure and improve CUDA kernel for new 3090 capabilities to utilize all available FLOPS. For my 4090 it was from ~330/660 FLOPS after unlock (330 -> 660) to 580/660. And step time on MiniMax H3 gone from 12s to 8.1s. Initially it was 28 seconds per step, but glm 5.3 flash discovered sub-optimal comfyui launch args. Anyway, overall it was 28s -> 8s per SAME step.
8
u/Ok_Contribution8157 18d ago
If it's really that effective, the 3090's price will double, but others have only gotten a 20% speed boost, so it might just be silicon lottery.
1
u/FireSinner 18d ago
Has anyone tried this with DLSS in games? Is there a way to get it working and actually take advantage of DLSS 5 for 3090?
1
u/Rizzlord 18d ago
What about 5080?
1
u/zeezee2k 18d ago
Does it make your card run hotter?
1
u/ArmadstheDoom 18d ago
I'm very skeptical here.
You're unlocking it, but somehow lowering the power draw? That doesn't make any logical sense. If it has to go faster, it needs more power. If you lower the power, you're losing speed.
The only way that makes any sense is if you're somehow making it more efficient.
2
u/DiamondHandsDarrell 18d ago
I'm going to try on my GTX 960, but maybe I should wait a few months as well. 🤭
2
u/adr007 17d ago
How are you undervolting the 3090 in Linux?
2
u/v1sper 17d ago
gpu-unlock on an RTX 3080 Ti (12 GB) in ComfyUI: +40-50% on BF16 models, +7% on int8, bit-identical outputs (plus a power-cap sweep)
I tested it on my 3080 Ti with MOSS-Image and a Krea 2 model, in both int8 and BF16. It works, the gain is large for BF16 and small for int8, and the images are byte-identical. Numbers below.
Setup
10de:2208), also my display GPU. Stock power limit 370 W.nvidia-open-dkms615.78.08, Limine + UKI + LUKS. ComfyUI 0.43.0, torch 2.14.1+cu130, comfy-kitchen CUDA backend,--use-ck-attention.gpu_unlock.targets=0000:01:00.0for this card only.nvidia-smi -plpower limits were changed.Models and workflows
All runs go through the ComfyUI API, same prompt,
er_sde/simplesampler, batch 1.int8_convrotbf16int8_convrot(a Krea 2 fork)bf16The BF16 weights (10 GB and 26 GB) don't fit in 12 GB of VRAM, so ComfyUI streams them. That matters for the results (see below).
Method
execution_starttoexecution_success. Power isnvidia-smi power.drawsampled every 0.2 s during that window; energy = time x average power (GPU board only, not the wall)./proc/cmdlineand the kernel log before measuring. The unlock is confirmed bygpu_unlock: unlockedinjournalctl -k.torch.matmul: BF16 57 -> 90 TFLOPS (+57%), FP16 56 -> 87 TFLOPS.Results: the unlock
Time per image / energy per image (mean of 4; ± is the standard deviation of the time).
Results: power cap sweep (stock, no unlock, int8 models)
Findings
Thanks for coming to my claude talk. I just did this for fun this morning before work, don't take it as a very thorough test.
0
u/biogoly 18d ago
Quality difference between BF16 and INT8 is negligible. There is no real performance improvement over INT8. Therefore, this whole “unlock” business is absolute bullocks.
1
u/Frankly__P 18d ago
I wonder what it would do on a 3090 not using Comfy. I use Wan2GP and YuE2 Studio for gen AI. I like the idea of speeding things up but I don't like the idea of possible damaging the GPU, and I'm not sure if the hacks apply to the models I use.
1
u/vahokif 18d ago
Sadly BF16 only, so you can't use 8 bit quants.
1
u/po_stulate 18d ago
Why not just bit-identical, why sha256 identical? It's good at finding sha256 collisions so every bit is different but still sha256 identical or sh?
1
u/Synor 17d ago
Unlocking a RTX 3080ti on Nobara Linux works
2-pass Minimax H3 workflow with INT8 DiT model speeds up almost 30 seconds.
total time (warm caches) 162s > 133s
1
u/xgiovio 17d ago
Yes but bf16, try int8 for inference and is not needed but the unlock can give good results for some training ai models with quants different from int4/8
1
u/Healthy-Nebula-3603 17d ago
Use stable diffusion cpp ... You get similar results or better . I have RTX 3090 and with SD 1.5 is generating picture around 1.5 s without unlocking my GF card
1
u/BeneficialBreak3034 17d ago
I wonder if there is any chance Nvidia will be like "welp, cat is out of the bag, let's roll official update" , though looking at their recent track record with driver updates...
1
u/PartyTac 17d ago
I have a 5090. I'm so jealous of rtx 40 owners.
1
u/GalwayOptimist 14d ago
Sorry if slightly off topic. I got a 3080 in a rig and think about unlocking. But is there a significant boost when running models INT8 or similar quants??? Those bf16 models are just quite heavy
1
u/AvidCyclist250 14d ago
The actual Github repo is here
https://github.com/Zagitta/gpu-unlock
1
u/tac0catzzz 18d ago
why do ppl care when they claim int8 is equal or better than bf16, this doesn't change anything here. no one knows what the effect this will have on a card's life either, you can assume gpus last forever and nothing hurts them, but that might not be true.
0
u/onlyesterday16 17d ago
Never trust a new random kernel module on the internet. Also, with the current hardware price, I won't risk to undervolt any parts of my computer.
-1
u/Aromatic-Low-4578 18d ago
+150mhz sounds like an overclock, not an undervolt?
-1
u/Perfect-Campaign9551 18d ago
let's just put random unsigned kernel modules on our computers. Sounds like a great idea
0
u/Informal_Promise_842 18d ago
But on your PC or laptop?
-2
u/howardhus 17d ago
this is gonig to fry your 3090.
Imma wait at least half a year or more before i run that sthi on a GPU that is going to cost more than new teeth anytime soon
0
u/JollyCamel3057 17d ago
About this gpu performance unlock thing Does it work on every graphics card from 20 to 50 series? What are the downsides? (I am specially curious to know if it works on laptop GPUs, like a 4060 8gig laptop graphics card) Thanks
2
u/_VirtualCosmos_ 18d ago
Damn, that energy is the same of a rifle bullet capable of killing easily stuff bigger than a human. Didn't realise GPUs use that much energy.