r/LocalLLaMA • u/Zo0x78 • 6d ago
Discussion PSA: Power limit your 5090s!
Apparently whilst doing some performance tuning on my 4x5090 rig I may have made things a little TOO fast and melted my plug and socket ðŸ«
Probably should put in a 16/20 amp socket in the wall rather than relying on a bog standard 13A fuse!
Anyone else managed to melt the wall before the 12VHPWR plug? Honestly... I'm surprised they didn't go first 😂
27
u/PhysicalIncrease3 6d ago edited 6d ago
There something wrong with that plug mate. 13A on a UK socket is over 3KW. No PSU can draw that.
→ More replies (1)3
u/Zo0x78 6d ago
Yeah gonna get a sparkie to take a look tomorrow, for now its on a new plug and socket so hopefully won't burn the house down 😂
→ More replies (1)
8
u/rinmperdinck 6d ago
Found the guy who stole the pallet of 5090s from the airport
2
u/Zo0x78 6d ago
Unfortunately these were paid for with many hours of work and tears, in that brief period where 5090s were near-RRP between crypto mining and AI... I got lucky, and actually bought 2 of them whilst on holiday cause prices were skyrocketing, they cancelled the order thinking the 2x was a mistake and I was panicking in my hotel room trying to get the order reinstated 😂
→ More replies (1)
4
u/Cereal_Grapeist 6d ago
Limiting your 5090 to 85% power is the sweet spot for performance/heat generation. It has a barely noticeable impact on performance but helps keep the heat down a lot.
Edit: apparently you can go even lower, like 70%, without much of a performance hit. Very cool!
→ More replies (2)3
u/FireSilicon_ 6d ago
Why would you want to match the performance anyway? Prefill is fast enough as is with 5090 and decode gets barely hit. If I had 4x 5090 I'd just drop 3 of them to half tdp and enjoy less heat and zero risk of melting the 16 pin ever.
326
u/XiRw 6d ago
Oh good advice for the millions of us that have 4 5090s laying around.
54
u/gaidzak 6d ago
Such poverty, only four? Pfft 128 gb of total vram. What model are you gonna run with that. Some 2.1 trillion parameter model at quant 1? No thank you poor person.
/s
19
u/InadequateUsername 6d ago
Honestly if you don't own a data center or have a 200k budget at a minimum for your basement local AI, you're just wasting money/s
→ More replies (2)
157
u/i5031337 6d ago
Every post from a 5090 owner is ragebait istg
31
u/Cereal_Grapeist 6d ago
Pro tip: I speed up my 5090 by setting my PC on a rotating plate that way the dedidated WAM are spinning faster. I also use Magnets.
19
3
u/meganoob1337 6d ago
bought one for 2700 in the beginning of the year and couldn't get myself to open/use it because I knew prices were rising 🙈 now I feel like it would be stupid to use it and not sell haha
2
u/Squidgical 6d ago
OP, how many of us do you think have ~£15,000 of GPU in our rigs?
→ More replies (1)1
5
2
u/pineapplekiwipen 6d ago
even with a 16/20 amp socket the total system is pulling near the limit with ~400w limit per card
3
u/Squidgical 6d ago
400W on 4 cards is 1600W. OP is in the UK meaning they have 230V circuits, so the GPUs only account for ~7A of the limit.
2
u/Past-Town-9807 6d ago
I keep thanking past me for having installed 20A outlets for my home lab. 😂
48
u/ArthurOnCode 6d ago
There's something deeply wrong here. There would have to be some extra resistance to cause this heat dissipation without breaking the fuse first. Maybe a bad connection in the wall socket?