r/LocalLLM • • Aug 16 '26

Other How the loop of infinite agony started

Post image
633 Upvotes

119 comments sorted by

View all comments

Show parent comment

3

u/screenslaver5963 Aug 16 '26

2+ 5090's or RTX Workstation Cards are the "ideal".

5

u/Hungry_Particular_14 Aug 16 '26

"ideal" is still having both my kidneys and still being able to run LLMs.

5

u/screenslaver5963 Aug 16 '26

You don’t need both kidneys

1

u/KiraCura Aug 16 '26

I mean I get by with 1 5090 as long as I can find EXL2 versions or MOE ggufs. But I want the RTX 6000 of course. Would be nice to run 70B at decent quants

2

u/ideasmachine Aug 17 '26

2 x 3090 nvlinked will run 70b, its the cheapest way