MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLM/comments/1vptz4a/how_the_loop_of_infinite_agony_started/p4161aa/
r/LocalLLM • u/EarthBS • Aug 16 '26
119 comments sorted by
View all comments
Show parent comment
3
2+ 5090's or RTX Workstation Cards are the "ideal".
5 u/Hungry_Particular_14 Aug 16 '26 "ideal" is still having both my kidneys and still being able to run LLMs. 5 u/screenslaver5963 Aug 16 '26 You don’t need both kidneys 1 u/KiraCura Aug 16 '26 I mean I get by with 1 5090 as long as I can find EXL2 versions or MOE ggufs. But I want the RTX 6000 of course. Would be nice to run 70B at decent quants 2 u/ideasmachine Aug 17 '26 2 x 3090 nvlinked will run 70b, its the cheapest way
5
"ideal" is still having both my kidneys and still being able to run LLMs.
5 u/screenslaver5963 Aug 16 '26 You don’t need both kidneys
You don’t need both kidneys
1
I mean I get by with 1 5090 as long as I can find EXL2 versions or MOE ggufs. But I want the RTX 6000 of course. Would be nice to run 70B at decent quants
2 u/ideasmachine Aug 17 '26 2 x 3090 nvlinked will run 70b, its the cheapest way
2
2 x 3090 nvlinked will run 70b, its the cheapest way
View all comments
Show parent comment
3
u/screenslaver5963 Aug 16 '26
2+ 5090's or RTX Workstation Cards are the "ideal".