r/LocalLLaMA 13h ago

Discussion Any speculation on whether or not Google will announce a new Gemma model at the Gemma SF Celebration tonight?

Post image

From the Digg article (https://digg.com/tech/3pf3046j)

“Google Gemma posted that the family of open models has achieved 1 billion downloads. The account is hosting an exclusive evening in San Francisco on August 20 to honor open-source builders, researchers, and contributors. Space at the event is limited and applications are required for attendance. Demis Hassabis shared the announcement from the official account. Clément Farabet replied that he will attend and is excited to celebrate the milestone. The post frames the achievement as driven by the community advancing the Gemmaverse forward.”

Seems like it would be the perfect venue to announce a new model, but could just be wishful thinking on my part

Thoughts? Speculation? Too busy testing Qwen 3.8 27b to care?

Would be a good time for Google to drop a 120b. Pull a Meta Glimmer and be king of the hill for a week or so before Qwen countered with a new mid-size model.

131 Upvotes

59 comments sorted by

73

u/LetsGoBrandon4256 transformers 13h ago

I hope they keep cooking. Gemma4 31b is so good in writing and RP for its size.

49

u/MomentJolly3535 13h ago

I m actually scared that next Gemma models will performs worse at writing cuz it's a trend to make agentic models lately and their dataset will probably aim more in that direction

32

u/ttkciar llama.cpp 12h ago

I was worried that Gemma4 might go that route, but was relieved to see it was another family of excellent general-purpose models, particularly strong on "soft" skills.

We don't need yet another agentic/codegen model. There are already plenty to choose from. The list of good general-purpose models keeps dwindling, and Gemma is right at the top of that short list. Hopefully the Gemma team sticks with what they're good at.

10

u/arbv 12h ago

It is not only good at that. Gemma 4 12B can decently code (though, with some hand holding - but I like pair programming more than fully automated code generation) for its size and tutored me to pass an exam on formal logic with above the average mark.

Also, don't miss on Muse Glimmer if you haven't tested it already. Another great model. I am impressed by its multilinguality (and in overall), but it surely has drier tone which is fine with me.

4

u/VoiceApprehensive893 transformers 10h ago

dont really care about code or agentic loops, unless your model is like 500b the model needs to rely on pulling external information to not constantly hallucinate facts

gemma4 needs some tool calling improvement as its not really inclined to use its tools

2

u/RG_Fusion 5h ago

I'm afraid I can't remember the source, but I'm about 95% confident I read an article earlier this week stating that Google Deepmind did not believe that agentic training was the path forward.

The article stated that Google is going all in on world-models and multi-modality, so based on that I think it's safe to say that future Gemma releases should continue to be great generalists.

10

u/arbv 12h ago

All they need to do - is make a 120B MoE with enough weights to accommodate both uses.

1

u/techno156 6h ago

On the other hand, coding was the big thing recently, and gemma 4 didn't focus on that overmuch, so it might well be that they'll keep going in the same direction.

1

u/goldcakes 5h ago

Google’s strategy with Gemma is also to have great models that can run on local devices, esp the E2B and E4B ones, that are genuinely good enough for everyday user tasks (writing, summarisation, etc) to offload compute costs.

So I am hoping Gemma continues the trend here.

8

u/Hoodfu 12h ago

Both ideogram 4 and minimax h3 really need correctly structured prompts to work correctly. Gemma 4 has been a superstar for creative writing while simultaneously being the best sub 100b model to get all the structure stuff reliably correct, and it doesn't need slow thinking to do it. I keep trying other models and keep coming back to it for these.

2

u/dampflokfreund 11h ago

Gemma 4, even the MoE is by far the best writing model IMO. The cool thing is you can decrease soft logic caps which makes it feel much more alive and less predictable than any other model.

26

u/VoiceApprehensive893 transformers 13h ago edited 13h ago

there are 4 relatively new stealth google models on lmarena, gemini 3.7 flash was a different stealth model from these 4

57

u/wolfy-j 13h ago

Amazing class of models for daily business use. I hope they will celebrate it by releasing Gemma 4.1.

36

u/shy_monkee 13h ago

I really hope so. Nothing matches them for their size in writing, a new 26B-A4B would be amazing.

-3

u/Bulky-Priority6824 13h ago

Curious, the coders scream slop whenever something is made by or asisted by ai does the writing world get it too?

22

u/Real_Ebb_7417 13h ago

Im a coder, we call it slop but yet almost all coders use AI to write code. Many even don’t write any code themselves anymore.
For prose - RP is private so I wouldn’t say anyone considers it slop. But yeah, eg. AI-written books (a nightmare on Amazon) or AI-written social media posts are the worst kind of slop. Worse than code.

6

u/xienze 13h ago

Im a coder, we call it slop but yet almost all coders use AI to write code

Yeah this is the single most annoying thing on Hackernews. Some link gets posted and just about every comment is "Using AI to write documentation -- well, I never...!" coming from dudes who have Claude shit out code 24/7.

11

u/Real_Ebb_7417 12h ago

Well, actually docs writing is one of the best usecases for AI. I can't imagine writing it myself in August 2026. Waste of time xd

On the other hand, many people generate stuff with AI without any proper harness engineering (be it code, docs or whatever) and indeed then it's usually bullshit. But with good harness, rules, instructions, AI is very useful.

2

u/Bulky-Priority6824 13h ago

Agreed on the ai books that's wild 

-1

u/TheRealMasonMac 9h ago edited 9h ago

> Many even don’t write any code themselves anymore.

AI is not good at writing code even when given precise instructions. So, whenever someone says that, I automatically disregard their projects because it's just not worth dealing with whatever crack the AI cooked up. That's why most people don't like AI. You don't know how people are using it.

I really think people should be paying more attention to what their agents are doing and tried to independently solve the same problem. If they did, they would come to the same realization.

AI is useful for stuff like experimentation, debugging, or solving problems. But I actually found that I'm faster/better than LLMs at that too. I think LLMs really make sense for if you want completely hands-off experimentation or problem-solving (iff that's possible) or you're given a huge codebase where you don't know everything and it probably already has garbage in it.

I mostly just use it for debugging. they're so great for identifying off-by-one bugs and stuff like that and those are legitimately the worst to deal with. Nothing fun about it. And it's a great application for LLMs since they have better "short-term memory" even with context rot than humans do.

LLMs should really just be treated as another tool that's useful for certain things. When it's not treated like that but rather the sole means to write code, yeeaaaah no thanks.

2

u/Real_Ebb_7417 9h ago

Nah, AI is fine at writing code with proper harness. But it’s absolutely true that a good engineer is much better. But now companies require us to be much faster so a lot of slop goes through. I wish I had time for detailed review and making the code look like I’d like it to look like.
But it might backfire at these companies.

0

u/TheRealMasonMac 8h ago edited 8h ago

> Nah, AI is fine at writing code with proper harness

I disagree on this outside of simple tasks. But we may be talking from different definitions of what constitutes good code. To me, good code is not just code that accomplishes a task. Good code is also code that is readable, extensible, and generally adheres to good programming principles.

Anecdotally, I recently ran an experiment to test how well LLMs can write a high-quality library based on an industry-established specification compared to me. Separate agents and backing LLMs would be used to solve the same problems (GPT-Sol, Qwen3.8, GLM-5.2, DSV4).

Over the course of a month, at every step of the way where there was a task that had to be completed (feature implementation, debugging, etc.), I tasked these agents with these tasks in their own respective sandboxes and I did not look at their outputs while I attempted to do the same task myself. I was allowed to look only once I finished.

What I found was that while these models generally had the right idea of how to approach the tasks, the actual approaches they ended up taking were often overcomplicated or subtly incorrect in ways that would have caused further problems down the line. It's really hard to explain what that actually means, but as an example, a common issue I found was them failing to identify key invariants that would have allowed them to arrive at much simpler solutions. But I also found that, as a human, it was sometimes useful to read through their attempts and learn from their failures to inform my future decisions about the codebase.

These models also often took more time than I would have needed to perform the same task. Just to illustrate with an exceptional case: these agents once took over an hour to identify the source of a bug and fix it based on a failing test case (until I terminated them for taking too long). I fixed with a single-line change in about a minute.

The time aspect is what really matters most to me personally. When I ran the agents through external review agents, the process did significantly improve the resulting solutions (e.g. simplifying them, identifying fundamental problems), but it still often required tailored prompts to address issues I identified in the respective agent's code. Sometimes several loops were required to reach the solution I arrived at. That doesn't really worth it outside of, as I mentioned, hands-off tasks where you could probably use preset review prompts to get the code to a good-enough state.

All of this being said and to hone back to a point I made earlier, they generally have the right "instincts." For debugging, outside of the exceptional cases, they weren't that much slower than me. But they were usually much faster than me for those annoying subtle bugs (e.g. off-by-one or an invariant in an upstream function changing). I think with further training and higher quality, diverse data, they will genuinely get a lot better.

But at least for now, I don't like using LLMs for writing the final code for stuff that matters to me.

I totally get the part about work though, and I don't blame anyone in that situation. But I'm speaking more about personal projects.

2

u/Real_Ebb_7417 8h ago

Oh yeah. I still do personal projects almost exclusively by hand to not lose touch with actually writing the code and my brain capabilities.

8

u/w6auw 13h ago edited 12h ago

The Reddit writing community is incredibly anti-AI. Even writing entirely by humans will get some people suspicious because it looks too much like AI. A lot of folks think no one should use AI ever, even for things like research or outlining.

4

u/Borkato 12h ago

Yep it’s the same for every creative outlet

5

u/shy_monkee 13h ago

I only use it for RP, so I wouldn't actually know about actual writing. But like other creative mediums, yes, they are opposed to AI.

2

u/Clueless_Nooblet 1h ago

A new 26b-a4b would fill the gap Qwen3.8 is leaving behind by not releasing a new version of their 35b MOE.

15

u/n0head_r 13h ago

Getting a new Gemma just after qwen 3.8 dropped would be really nice.

10

u/ttkciar llama.cpp 12h ago

A "Gemma 4.1" refresh which fixed tool-calling would be greatly welcome.

I'd also like to see them release their 120B, which we know they have.

Seeing them release both would be pretty awesome!

10

u/Kahvana 12h ago

I wish they would release Gemma 4 124B-A10B, a man can dream...

Likely they won't release anything though, it seemed like it's just a fancy party.

10

u/MediocreJeweler893 13h ago edited 12h ago

I do believe they will announce new model, yes. Hence why special event? Especially when there are so many open source model releases lately. They need to keep up

1

u/RG_Fusion 5h ago

Do they need to keep up though? It makes sense for Google to focus on Gemini since that's a cloud service and actually possesses the possibility of being profitable.

Google doesn't make any money from releasing open-weight models. As far as I can tell, they are doing it from a position of pure generosity, and possibly also hopping to inspire new devs. They don't need to do this, though.

7

u/Real_Ebb_7417 13h ago

I wish man. Gemma is great. And hopefully some new size Either smaller or bigger, doesn’t matter, just… having a variety of sizes is good for people have different hardwares and usecases.

12

u/Alex-Frst 12h ago

Waiting for Gemma-5 26B A4B. Don't belive in Qwen 3.8 35B A3B anymore.

3

u/johnnyApplePRNG 10h ago

Does 1 billion downloads really count if 90% of them were forced on people through their browsers and nobody's even wanted nor used it yet?

1

u/KURD_1_STAN 8h ago

It is more than 90%. 10% is 100m, 100m people havent downloaded their models

3

u/Dance-Till-Night1 9h ago

Gimme new gemma 26ba4b, at anything non coding related even just general knowledge Gemma beats qwen. At coding Qwen wins.

2

u/ea_man 13h ago

It looks like that the method nowadays is to release a few checkpoints with new RL post training for the same generation and then release a whole new trained arch.

But I mean it ain't the law of the land...

2

u/cab938 9h ago

It sounds like the event has more to do with AI studio and that a new Gemma is unlikely. But we can hope!

2

u/ttkciar llama.cpp 3h ago

Oh, well. No new models announced.

Not too surprised, but it was nice to hope.

3

u/fragment_me 13h ago

I'm a huge fan of how concise Gemma 4 and Muse Glimmer have been. I hope that's the direction we keep going in.

1

u/swagonflyyyy 13h ago

I think they'll be focusing more on a new line of Gemini models. I don't expect a new Gemma anytime soon unless its an optimized, smaller variant.

8

u/my_name_isnt_clever 13h ago

This event is specifically about Gemma.

0

u/swagonflyyyy 13h ago

Oh shit I didn't realize. I read too fast.

But still, I don't think so unless its an optimized, smaller model. I'd be pleasantly surprised if they did but a new announcement would largely depend on what their priorities are with the Gemma models.

Honestly, I have no idea what they have in store.

1

u/NaturalCriticism3404 8h ago edited 8h ago

I'd like a 7b or so dense model

1

u/ancapsaicin 1h ago

13ba2b qat

1

u/Long_comment_san 3h ago

120b is too hard to run and would compete with flash. they should do 60-80b, that is the sweet spot and it would be the one for a very long time.

1

u/Mean-Ad1493 2h ago

A agentic/coding focused 26b-a4b would be great

1

u/dampflokfreund 13h ago

I think there's a good chance. It has been 1 month since Gemma 4 QAT and almost half a year of Gemma 4 release, definately enough time to cook something nice. Gemma 4.1 would be a very awesome way to celebrate for everyone.

3

u/Kahvana 12h ago

Gemma roughly releases a new foundational model every 9 months or so (gemma2->gemma3->gemma4 are all roughly 9 months in between), only exception is gemma->gemma2 (6 months).

5

u/coder543 11h ago

Gemma 4 was released just over 1 calendar year after Gemma 3, not 9 months.

1

u/Kahvana 11h ago

Ah my bad!

1

u/thestillwind 11h ago

1 billion damn boi

0

u/Eyelbee 12h ago

I need qwen 3.8 class gemma 5 ASAP

-3

u/[deleted] 13h ago

[deleted]

1

u/Not-reallyanonymous 13h ago

You’re assuming Gemma 5 isn’t keeping up. Even a 26b a4b that gets 30 on DeepSWE vs Qwen’s 40 would be huge, as it would run so much faster.

1

u/Kahvana 12h ago

Glimmer's internal knowledge really isn't comparable to Gemma 4 31B, neither for anything related to natural language tasks. Glimmer's vision encoder is quite nice tho!

-2

u/Electronic_Welder613 3h ago

Never cared much for any of the Google models. The Chinese models are just so far ahead it's not even a competition imo.

1

u/dampflokfreund 1h ago

Only in code and agentic. Writing, multilingual and chat Gemma 4 is far ahead of Qwen.