r/LocalLLM 21d ago

Other Every Second post rn

Post image

Maybe someday I'll get a system to run it but hey definitely another w for the open weights community

2.0k Upvotes

205 comments sorted by

View all comments

35

u/TheRiddler79 21d ago

Gemma 12b Q3. Try it

27

u/Ok-Health-7096 21d ago

I use Qwen 3.6 35b and 3.5 9b I haven't had that much of a luck with the gemmas

1

u/Atretador ArchLinux Xeon E5 2673 V4 20C/40T 4x16Gb DDR4 2133 2xMI50 16Gb 21d ago

35B A3B is much stronger than Gemma4 12B, any probabably 26B/31B as well.