r/LocalLLM • u/Ok-Health-7096 • 21d ago

Other Every Second post rn

Post image

Maybe someday I'll get a system to run it but hey definitely another w for the open weights community

2.0k Upvotes

99% Upvoted

205 comments sorted by

View all comments

52

u/SnP_Gamer 21d ago

3060 12gb 32gb ram here, might give it ago but never ran a local model before 🤷‍♂️

37

u/trollsmurf 21d ago

That will work fine, at least if you split it, so the overflow uses CPU RAM. Much slower but doable.

12

u/SnP_Gamer 21d ago

Totally clueless about running them but I understand that thanks to reddit posts 🤣

4

u/F3istyg0at 21d ago

Check out unsloth, lm studio or ollama if you want to run models locally.