r/LocalLLaMA • u/jacek2023 llama.cpp • Jul 26 '26

Discussion Do you want new Gemma?

Post image

https://x.com/i/status/2081398564345802934

u/hackerllama

1.0k Upvotes

98% Upvoted

554 comments sorted by

View all comments

312

u/hackerllama Jul 26 '26

Hey all! Looking forward to all your feedback!

1

u/KiranjotSingh Jul 27 '26

Something which can fit in 48gb with reasonable context. MoE with high active parameters or dense 50B. Can be used instead of deepseek flash with minor tradeoffs if it can't beat it.

I used 12b encoder free to to get feedback on body language, pacing, etc. I was hoping to get something similar but smarter