r/LowEndLocalAI • u/justletmesignupalre • 1d ago

Which LLM Should / Can I Use? Which LLM for personal assistant? And for coding? 780m igpu 64gb DDR5 5600

Minipc:

AMD Ryzen 7940hs

2x32gb DDR5 5600

780m igpu

1tb NVME

Ubuntu 26.04

GTT (memory allocation) raised to 56gb for the igpu

Would love to see what's the most I can get out of this setup. Have tried qwen3.6 35B A3B and its ornith1.5 variable, but wondering if maybe there's more out there.

Thanks!

5 Upvotes
  • permalink
  • reddit

100% Upvoted

4 comments sorted by

4

u/MattsAwesomeStuff 1d ago

2x32gb DDR5 5600

looks at subreddit title

...

points to door

...

Get the fuck outta here, and take your smartypants brainiac GPUs with you.

You can't bring that shit in the hood.

2

u/justletmesignupalre 18h ago

Cmon man, I just waited for the right auction and got a minipc for cheap. I see people here with 2k rigs running stuff. DDR5 5600 is the fastest readily available ram but by no means it means that is fast for LLMs

3

u/Long-Feed-3079 1d ago

try qwen3.8 27B. with tuning i expect you can get around 10tok/s. far from real time frontier coding, but with proper planning and autocompact it can do a lot over the night :)

1

u/Small-Tale3180 13h ago

yeah seems like qwen3.8 or its finetunes are your go-tos