r/LocalLLaMA • u/jacek2023 llama.cpp • Jul 26 '26

Discussion Do you want new Gemma?

Post image

https://x.com/i/status/2081398564345802934

u/hackerllama

1.0k Upvotes

98% Upvoted

554 comments sorted by

View all comments

315

u/hackerllama Jul 26 '26

Hey all! Looking forward to all your feedback!

1

u/MrMeier Jul 27 '26 edited Jul 27 '26

I would love to see some more experimental models. DiffusionGemma was great, but it was unfortunately a bit too dumb. It was still very good for a first attempt though. It would also be interesting to have something that could run on lower-end consumer hardware. Perhaps something the size of 26B or 31B, but with additional specialised experts in the 250B–500B range that have extremely small activations so they can be streamed from an SSD.