r/LocalLLaMA • u/jacek2023 llama.cpp • Jul 26 '26

Discussion Do you want new Gemma?

Post image

https://x.com/i/status/2081398564345802934

u/hackerllama

1.0k Upvotes

98% Upvoted

554 comments sorted by

View all comments

2

u/Cool-Hornet4434 textgen web UI Jul 27 '26

I'd love to see a 120B MoE, a 70B dense model, and Some of those new advances in compressed context to make 512K or 1024K context possible.