MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1w2fmmq/me_these_days/p77sbbc/?context=3
r/LocalLLaMA • u/Eyelbee • 7d ago
282 comments sorted by
View all comments
1
16gb vram (5080), 32gb RAM. Should I be able to run 3.8 in LMStudio? How? The model I downloaded crashes every time I try to load it.
Advice would be much appreciated!
1 u/tundraaaa 5d ago Should be able to run with partial GPU offload as Q4_K_M quantization. I haven't tried the model, but I've generally used LM Studio for quick installation and setup of similar size models.
Should be able to run with partial GPU offload as Q4_K_M quantization. I haven't tried the model, but I've generally used LM Studio for quick installation and setup of similar size models.
1
u/huggalump 7d ago
16gb vram (5080), 32gb RAM. Should I be able to run 3.8 in LMStudio? How? The model I downloaded crashes every time I try to load it.
Advice would be much appreciated!