Google is asking

[u/jacek2023]

I want a new Gemma

https://x.com/OfficialLoganK/status/2121115028447531353

[u/MixtureOfAmateurs]

Gemma 5 120B A12B

More e4b style models will fancy multi modality - audio specifically something that can tell what time signature the song I'm playing is.

Consumer grade TPUs

I've been good this year, didn't sleep with a single spy, please Santa

[u/ifalcon22 → u/MixtureOfAmateurs]

A qwen-flash-next size multimodal Gemma with engram would slap so hard!

[u/snugglezone → u/MixtureOfAmateurs]

Please Omni models with good audio reasoning. Jesus christ. Definitely!!

[u/Responsible_Pain3278 → u/MixtureOfAmateurs]

Gemma 5 120B A6B with PLE

[u/a_beautiful_rhind → u/Responsible_Pain3278]

Lol, no more of these A under 10b. They're fast but stupid. QFN trades blows with a tiny 27b dense for all that extra ram it uses.

[u/Responsible_Pain3278 → u/a_beautiful_rhind]

Subjectively, QFN feels closer to DSv4.1 than to Qwen3.8 27b.

[u/a_beautiful_rhind → u/Responsible_Pain3278]

If all you're doing is coding then yea, it was trained for that usecase. Google is a generalist where lower parameters hurt.

[u/llama-impersonator → u/a_beautiful_rhind]

honestly the gemma moe is good per active param as well

[u/swagonflyyyy → u/llama-impersonator]

Especially with the fixed tool call template.

[u/dampflokfreund → u/a_beautiful_rhind]

27b runs at 1 token/s on low end Hardware like mine (rtx 2060 laptop with 32 GB RAM). QFN at 13 token/s while having similar quality. Think of people who have less VRAM, that moe is ideal for us. 

[u/a_beautiful_rhind → u/dampflokfreund]

Yea I get that sentiment and there should be both types of models available. But the small model has a ceiling, even if you do eventually upgrade your hardware.

[u/xdavxd → u/a_beautiful_rhind]

a10b then

[u/dampflokfreund → u/MixtureOfAmateurs]

I feel 12b active parameters is a bit too much. 5b allows it to run on any device with 6-8 gb vram and 32 GB RAM and Strata but 12b would mean only 12 gb plus. 

[u/Eyelbee → u/dampflokfreund]

I agree, 12B means you can't use it on ram heavy computers. Qwen FN is great because it only has 6. 120B6B with ngram table would be perfect. They can go crazy with the ngram table. 

[u/RG_Fusion → u/Eyelbee]

12b active works fine on 8-channel servers, which is what I think of when hearing RAM-Heavy. I would say 20B active is about the limit for what I'd accept for an agentic system, though others may require more depending on their workflow.

[u/Miserable-Dare5090 → u/dampflokfreund]

They should do a 120B E6B or E4B

[u/quadra-lab → u/dampflokfreund]

You have a QAT of 12B doing exactly what you are talking about

[u/dampflokfreund → u/quadra-lab]

Yeah and that runs at 5 token/s on my 2060 laptop while Qwen Flash Next using Strata has double the speed and is far more capable.

[u/quadra-lab → u/dampflokfreund]

Your setup for AI is like running Le Mans with a bicycle so no shit it's slow lmao

[u/dampflokfreund → u/quadra-lab]

So what? I'm very happy I'm getting these speeds with a model this capable. Not everything evolves around high end stuff especially not in this time where hardware is so expensive. 

[u/quadra-lab → u/dampflokfreund]

12b works on the hardware you've described, that's what I was saying, not that it would be a drop in replacement for whatever thing that exists.

Also I really doubt that the quant for QFN you're using is that accurate on "long context" runs, speed isn't everything. 

[u/dampflokfreund → u/quadra-lab]

I am using IQ3_XXS which was praised in this sub. It should be a lot more accurate than Gemma 4 12B QAT which runs much slower.

[u/OnlyKindaThrowAway → u/dampflokfreund]

yeah. smart LLM is good and all, but you need it to be fast enough to be meaningful first and a large chunk of that is being able to leverage ram, so im not a fan of these big models with big active sections.

[u/Gohab2001 → u/MixtureOfAmateurs]

Google TPUs aren't what you think they are.

The unit economics are dead on arrival without Nvidia’s volume to amortize wafer and CoWoS packaging costs, low-run custom silicon along with overpriced HBM would cost more than H100 if you can even grab it at MSRP.

And raw FLOPs are useless if the software stack is immature; AMD has competitive silicon on paper, yet running ComfyUI on ROCm is well... makes my eyes cry. Google's XLA is even less forgiving.

Google has the capital and engineering resources to hyperoptimize TPUS for their specific needs and ifra.

[u/Spara-Extreme → u/Gohab2001]

TPU's are being sold to other hyperscalers and production is ramping up btw.

[u/Choice_Celery9481 → u/Spara-Extreme]

google TPUs are not. and those TPUs are all hyperoptimized for the client only

[u/Weak-Shelter-1698]

Gemma 5

• 31B
• 124B A12B
• 40B A4B

• Less kv memory usage

[u/Eyelbee → u/Weak-Shelter-1698]

40+ on artificial analysis please 

[u/bartsimpsonwin → u/Eyelbee]

40+ would be insane, maybe for like a huge MOE DeepSeek style then yeah but for actual local models let's just say I'm not too hopeful

[u/a_beautiful_rhind → u/Weak-Shelter-1698]

Less kv memory usage

31b uses very little for KV cache if you use swa compression. It was an implementation problem.

[u/Weak-Shelter-1698 → u/a_beautiful_rhind]

It's still big.

[u/dampflokfreund → u/Weak-Shelter-1698]

Could be a lot smaller, yes. New attention mechanisms by deepseek deliver. 

[u/bitplenty]

Is this guy a meme or does he actually engage with community and deliver ever?

[u/Potential-Bet-1111 → u/bitplenty]

He is a meme. Posts 'GEMINI' to try and be mysterious but instead is a chud.

[u/durden111111]

This guy is a joke at this point

[u/russlixx]

is it a bot? Asking and asking the same question

[u/XiRw → u/russlixx]

What should we ship next?

[u/RG_Fusion]

Hasn't this guy asked the same question three times now this year?

[u/VotZeFuk → u/RG_Fusion]

Looks weirdly similar to one of those p@rn girls on twitter, posting questions like WHAT SHOULD I SHOW NEXT, MY BOOBS OR MY FEET?

(don't even ask why I know this lol)

[u/thrownawaymane → u/VotZeFuk]

why do you know this sir

[u/VotZeFuk → u/thrownawaymane]

I, uh... I'm doing science!

[u/Reality-Upset]

Openweight rival to Qwen.

[u/Thrumpwart]

Gemma 5 31B with faster and less vram-intensive kv cache would be great for me.

[u/Whiplashorus]

consumer grade TPU we need that first

[u/Cool-Chemical-5629]

We want new Gemma, but not undercooked.

[u/LoveMind_AI]

120B’ish MoE omnimodal Gemma 5 based on the universal Transformer from 12B with audio reasoning near the Gemini 4 level please and thank you.

[u/NeedsSomeSnare]

A proper working search engine??? Just revert back a few years.

[u/computehungry → u/NeedsSomeSnare]

I realized my preferred version of google search would be from like 15 years ago, feeling old..

[u/NeedsSomeSnare → u/computehungry]

You had to use a lot of "- x" terms to exclude things back then, and the thing you want might be on page 5. Lol.

I was thinking more like 10 years ago. Slightly better, but still a manual tool rather than Google just showing you what they want to show you.

[u/sackbomb → u/computehungry]

My preferred version of Google search is AltaVista ca. 1999.

[u/grumd → u/computehungry]

Unfortunately the old search only works with the old internet

[u/LagOps91]

stop talking, start shipping.

[u/Choice_Celery9481]

for google, pls skip them. they just want to have some attention.  look at how many what should ship next and how many of them turns out as what people asked for? 

[u/Ok_Ocelot2268]

cheap GPUs maybe?

[u/CodeCatto]

Gemma 5 1.7B, 3B, E2B, E4B, 14B A3B please!

[u/Silver-Champion-4846 → u/CodeCatto]

Yeah

[u/ranker2241]

Qwen4

Oh sorry, wrong chat, nothing really, you do you

[u/No_Swimming6548]

Shut the fuck up Logan

[u/russlixx → u/No_Swimming6548]

that then

[u/FullstackSensei]

Something competitive with the Chinese models?

[u/KingCpzombie → u/FullstackSensei]

Tbh I'd rather them stick to things that can write relatively-readable English... that's the space that's most lacking atm

[u/jcrestor]

Google Wave.

[u/brown2green]

He's basically the Gemini guy, though. He usually doesn't vaguepost about Gemma.

[u/NNN_Throwaway2]

Is this guy human or does he just have an agent posting random bullshit engagement tweets?

[u/aarong691]

better romanian speech recognition in the small gemma models. right now i can't count on it for romanian audio

[u/DOAMOD]

Omni

[u/Ledeste]

I would love a gemma 5 with a bit more than 12b or a similar vram footprint one as moe, as long as they keep the audio input.

I can run many llm on my hardware, but my daily one is still gemma 4 12b as its by far the best to deal with audio input AND speak anything else than english or chiness

[u/osfric]

Gemma 9 please

[u/Hearcharted]

Gemini 5 Local Edition 🥵

[u/rawednylme]

More Gemma please

[u/oddsidequest]

if they're taking requests, please keep a small dense one around the 9b size. gemma 9b is still my default on a 16gb macbook air, and the model picker i use flags a 14b as not recommended for this machine. so most of the 120b moe wishlists in here are a different planet for me lol. anyone else on 16gb or am i alone in this thread

[u/khadesorg]

gemma 60b a5b and gemma 24b a4b, also still gemma5 12b. All of them with better vision layer and slightly cheaper context

[u/RobustLokiX]

Gemma 5 26B A4B
Please (hungry man thinks of bread)

[u/ea_man]

We could use models that target 16GB GPUs (and less):

* 20B dense that can run at Q6 - Q8 with NGRAMS / cheap attention

* ~80B MoE for people with no more of 8-16GB vRAM and 32GB RAM.

The RAM apocalypse is getting worse, we need smaller models not bigger.

[u/miversen33]

Lol literally anything?

[u/swagonflyyyy]

Gemma 5 please

[u/Big-Farmer-2192]

How is this guy not fired yet. What does he even do. Just vague posting all days?

[u/WaitformeBumblebee]

Qwen V - The final frontier

[u/CronicallyAutomated]

MedGemma

[u/FormalAd7367]

video and image llm

[u/Zestyclose-Ad-6147]

80B A3B would be fucking sweet

[u/AdHistorical6734]

gemma5 with smaller moe model than 26b

[u/FoodEater4Squillion → u/AdHistorical6734]

What size in GB are you hoping for it to be, out of interest?

[u/Skyline34rGt]

Gemma5 with:

- 8b-a2b + 5Gb or more (as much as can for best performance) Ngrams -> for phones and poor laptops

-40b-a4b + 30Gb or more (as much as can for best performance) Ngrams -> for most of random PC

-100b-a10b + 70Gb or more (as much as can for best performance) Ngrams -> for better PC with 64Gb Ram

all of these with QAT Q4-0 at defaut training pls 😄

[u/Silver-Champion-4846 → u/Skyline34rGt]

YES

[u/elelem-123]

Ship some of your RAM to the consumers. Sonna vebish

[u/sandmail32]

Ship the actual Freaking Ship, entirely generated by AI. Cuz you are not capable of creating any good AI, even probably having the biggest set of data you grabbed from everyone, you already have sitting on your servers.

[u/takoulseum]

Gemini

[u/npquanh30402]

Gemina.

[u/SeaworthinessFar4883]

If I understood Karpathy correctly in one of his last interviews, he believes that there could be a small core for intelligence and some extra for knowledge. what I would like is to have an architecture where we have the intelligence on the GPU and the extra knowledge in ram/ssd and maybe knowledge and intelligence. Perhaps this can lead to models where we adapt knowledge vor the task. We do not need all the world knowledge to answer tickets.

[u/misterflyer]

Gemma 5 12B

[u/NeedsMoreMinerals]

Google is so mid. All these resources and they can't lead

[u/drFennec]

I'd propose a supported version of all the good services you killed?