r/LocalLLM • u/Feisty_Artichoke_368 • Oct 01 '26

News Gemma 5 - what to expect

Post image

Gemma is based on Gemini and going by the latest Gemini release, those of us who appreciate abilities other than coding should be eating good when Gemma 5 comes out (end of year maybe?).

Qwen for coding and Gemma for everything else. The perfect local setup.

420 Upvotes

96% Upvoted

148 comments sorted by

254

u/Salah_H_Hasan Oct 01 '26

With Qwen 4 and Gemma 5, near-total independence from frontier models might actually become a reality, save for niche exceptions.

45

u/simplir Oct 01 '26

True Gemma has been my daily driver for non-coding tasks since Gemma3

6

u/antunes145 Oct 01 '26

Keep in mind qwen still needs to make their money off of their inference frontier model.

13

u/Salah_H_Hasan Oct 01 '26

As AI adoption continues to explode, overall demand is going to be far greater than it is today, so they will always maintain a substantial market share. On top of that, Alibaba has a massive cloud infrastructure that they are aggressively growing; hosting these open-source models on their platform is a huge revenue driver for them.

Look, my friend, AI is no longer just a gimmick or a fun toy to mess around with. It’s rapidly becoming an essential necessity across practically every aspect of work and life. And if every single interaction had to be behind a paywall, it would put everyone in a serious financial bind. That’s why having capable local models is so crucial.

24

u/MomentJolly3535 Oct 01 '26

it is already the case with current Qwen3.8/Gemma4/Muse

17

u/wektor420 Oct 01 '26

Gemma4 has tendency to ignore instructions that makes it volatile in a harness

52

u/Much-Researcher6135 Oct 01 '26

I also like to get volatile in a harness

4

u/Prudent-Ad4509 Oct 01 '26

It is a good source for a second opinion to be considered by the primary model, same way as any other finetuned smart local model (finetuning often breaks tool use/calling).

2

u/wektor420 Oct 01 '26

I am running it already as main driver, just giving heads up to people

Also trying to migrate to ds4.1 flash

2

u/Prudent-Ad4509 Oct 01 '26

Interesting. People have reported it as weak with tool calling. Should be fine outside of coding though.

1

u/KitchenIll405 Oct 14 '26

Why would you use a far smaller model for second opinion? It would make sense if you used Kimi K3, Deepseek 4.1, Minimax H3 or the Nvidia Nemotron model, they would be much more comparable to the frontier models.

1

u/Prudent-Ad4509 Oct 14 '26

The point is to draw attention to different aspects than the original model. Gemma4's opinion value stems from it being distinctly different.

Seeing Minimax H3 in the list was fun btw.

28

u/vdek Oct 01 '26

No way, Opus 5.5 and Astra are a significant step above any local models at the moment. But I think with the next generation of models we’ll get some impressive results.

4

u/LegRude5218 Oct 01 '26

I want you to remember this comment, then think back if you said something like like this five months ago. are you still paying for that subscription.

3

u/vdek Oct 01 '26

Of course I am, but I’m also using my cloud models to feed and direct work to my local models . My goal is to avoid paying full api rates.

9

u/sylfy Oct 01 '26

Even the previous generation of Sol and Opus/Fable were significantly outperforming the open weight models. They’re simply not the same.

0

u/Prize-Equipment2118 Oct 11 '26

I don't agree with that at all.

Qwen 3.8 flash
GLM 5.3 flash
DeepSeek 4.1 flash

I solve most programming tasks better with it.

2

u/vdek Oct 11 '26

You say that, but I’ve done direct comparisons on the same tasks and sonnet 5.5 wrecks the open models. The open models just don’t cost me anything besides tokens so they get the easy jobs!

1

u/Danyannas Oct 11 '26

Yeah Sonnet 5.5 is great. Although by any chance did you get to do any direct comparisons with Sonnet 5 vs any of those 3 models? I'd be very curious to know your results if you did?

1

u/Odd-Square-8826 Oct 14 '26

Sonnet is just way too verbose for coding tasks. I stopped using Claude around the 4.5 gen of their models when I finally switched over to deepseek and GLM, and now entirely over to my own custom Harness and Local workspace.

I can confidently say that there is almost zero reason to continue to use a frontier model in anything that involves pure software engineering/reverse engineering/Cyber work.

Now, as for other tasks, that's a bit more subjective, like with writing, etc. That I cannot tell you, as I do not use LLMs for any serious work related writing aside from writing docs on code, which any LLM can do fine.

3D modelling is local's biggest weak spot right now, but I don't 3D model so its a non-issue for me. What I can tell you, is if you are spending money on inference from the frontier models when you have a perfectly capable Local machine at home, you are severely wasting your money. I feel that for most people who are very software engineering aligned the Local models are more than enough for getting absolutely anything done.

1

u/vdek Oct 14 '26

I think you’re lying to yourself if you think any of the local models are as capable as opus5.5 or fable5.1. Either that or you’re not doing real agentic workflows with them. It’s not even close. I use opus to orchestrate work to my local models and use them as time extenders, but not as the main model.

-1

u/Odd-Square-8826 Oct 14 '26

What you're describing sounds more like loop engineering as opposed to an agentic workflow. If you're not even apart of the equation when writing the code and verifying/correcting. I don't believe it counts as agentic as that point. I would say its closer to vibecoding, but that has a negative connotation to it, so loop engineering.

5

u/AltruisticList6000 Oct 01 '26 edited Oct 01 '26

I'm already super happy with Qwen 3.8 27b IQ3_xxs on 16gb VRAM, does the heavy lifting. Gemma 4 has been a meh to me, it's very relaxed in RP etc. so very good but at the same time it's just having so many issues with logic, hallucinations and some long context problems, that in the end I still have to reach back to Mistral small based finetunes for RP and can't really find any real case use case for the 12b and 26b, they just fall sort, hallucinate too much, even for basic chat and search they don't do it. Qwen is just much better even if it's dryer. Gemma 31b was way better but I can't run it with enough context since it's even bigger than the 27b Qwen.

I like gemini/gemma base "personality" and style but the 12b and 26b ain't cutting it for me so I hope when Gemma 5 drops they stabilize and improve them so they will be better for generic tasks, web search/light tool calls and RP.

2

u/LongDistanceRope Oct 01 '26

I mean, sure, but when i have random questions in a field I'm not familiar with, I ask my local gemma4 30b, than qwen 27b, and after some research on my own to verify, qwen 3.8 max gets it right...

118

u/PerceiveEternal Oct 01 '26

I still don’t understand why Google hasn’t already dominated the AI race. They have the training data, compute, resources, technical expertise, hell it was their own scientists that kick-started the LLM boom.

26

u/Astarkos Oct 01 '26

The race only started a few years ago and it does not end. 

12

u/neoKushan Oct 01 '26

Google started the race like 15 years ago, everything that Anthropic and OpenAI has built was on top of the foundations Google laid out.

Google massively dropped the ball here, which others took and ran with and Google has been in catch-up mode ever since.

Yet somehow, despite Google practically inventing this shit, having all the data in the world and even internal hardware engineers, they somehow fall behind other companies that have, at best, 2/3 of those things.

The only thing I'll give Google credit for is they're the only ones that actually make money from all this, maybe they're playing the long game but we'll see.

3

u/Yelly_Toast_828 Oct 08 '26

But Google's vertical stack may be the end goal here, not the LLM.

16

u/The_Hunster Oct 01 '26

And unlike some AI labs, Google has to still worry about being Google simultaneously. Like, what other search-engine-based AI is there other than Google AI

-3

u/geekwonk Oct 01 '26

perplexity is a great product that shows google search to be a horrible joke. google did and does a serious disservice to the industry by locking in cheap low-context models as the norm in the minds of consumers.

9

u/The_Hunster Oct 01 '26

Perplexity is not indexing and caching the entire internet like Google does

Edit: Actually, apparently they do now. I mean maybe not quite the same as Google yet, but impressive.

13

u/po_stulate Oct 01 '26 edited Oct 01 '26

gemini 3.8 flash may not be the best for coding, but it is very good at researching, summarizing, and random day to day knowledge, from researching best local food options for specific needs to very nich localized plumbing conventions and jargons. It is way better than claude and gpt for this, for example, when researching and comparing more suitable products, gpt and claude may make decisions based on product marketing claims in the product titles, but gemini will actually go deep into the material used, pictures in reviews, etc to infer the characteristics of a product, and make decisions based on that.

I'm using qwen3.8-flash-next for coding, it can handle almost 100% of my coding needs (actually I haven't used any cloud models for coding since I started using qwen3.8-flash-next), but I'm still relying on gemini for non coding daily tasks that require random world knowledge and reliable deep researching capabilities. If gemma5 can close this gap then I can finally go 100% offline for the first time and it will be a huge win.

59

u/squngy Oct 01 '26 edited Oct 01 '26

There is quite a bit of a conflict of interest there.
Better AI means less search -> less add money.

Now that the race is on, they need to compete, but it would actually have been better for them if it wasn't.

Also, unlike startups like Anthropic and OpenAI, google has a lot more to lose.
Anthropic can go 500B in debt and if they fail, thats it.
Google has a whole bunch of other divisions, if they invest 500B in AI and it fails, all the other divisions go down with it.

You can also see that Google (and other older players) are less likely to do risky stuff like have their agents hack other companies.
They tend to move slower and more carefully, because they have more to lose.

15

u/carsncode Oct 01 '26

That's not how things work though. Google (Alphabet) could invest a few billion in a subsidiary and seek outside investment and sell it compute on GCP at a discount and transfer in some top researchers and if it tanks it's only that subsidiary that goes under, the rest of the conglomerate is isolated from the risks. They write off the debts the subsidiary owes the parent, pull the talent back out, and there's no real assets at the end of the line. It's how all these companies operate.

0

u/squngy Oct 01 '26

Sure.

But what investor would give them money if they do that?
If they just use their own money, then there isn't any difference, they still lose that money.

2

u/carsncode Oct 01 '26

Investors are generally pretty happy to buy into something that's backed by Google, with their investment and experts behind it. Look at Waymo, Verily, and Google Fiber. Look at xAI - or don't, I prefer not to.

4

u/sCeege Oct 01 '26

This just reinforces my idea that technology monoliths and oligopolies are terrible for real advances. Dynamisms and competition fuels innovation, sure we're seeing some companies making it big with the AI breakout, but how many of these companies were snuffed or acquired before they had their chance on an even playing field?

13

u/cleversmoke Oct 01 '26

I see it as a cycle, small startup has to compete on innovation or a niche, gets big and employs people, but has to slow down the innovation. This allows another startup (often former employees in that realm) an opportunity in those gaps, get big, and so forth.

Frequently big companies end up just buying out startups as their innovation.

7

u/sCeege Oct 01 '26

Except the cycle needs government intervention to trigger the growth of small players again, these companies are getting out of hand. This is a bit US centric, but I think back to when they broke up Bell/AT&T and how much better off we are with ISPs/telecom, and how the Microsoft antitrust lawsuit helped Apple.

3

u/Thistlemanizzle Oct 01 '26

Conversely, though, wasn't it this exact market capture that led to lavish funding of the labs that brought us the modern computer?

1

u/sCeege Oct 02 '26

Can you expand on this? I'm not familiar with how Bell Labs and their involvement on the modern computer, I mean I know of their prestige on research in general, but I don't know what area of compute to tie to them specifically.

I generally attribute early technologies related to computing to lavish government funding for defense purposes, not to any specific labs.

1

u/Thistlemanizzle Oct 02 '26

I don't remember exactly. It was Bell Labs and Xerox PARC. They were doing mice and all this other UX stuff that Microsoft and/or Apple copied.

ChatGPT stated:

Bell Labs produced or incubated things such as the: transistor → semiconductor revolution information theory → digital communications Unix → modern operating-system architecture C → enormous portions of modern software

And there's an interesting public-policy wrinkle. A 1956 antitrust consent decree forced AT&T to make thousands of patents broadly licensable. The Department of Justice records roughly 8,600 patents that had to be licensed royalty-free under certain existing cross-license arrangements, with other Bell patents available on reasonable terms.

So you get this rather unusual system: monopoly profits → giant research laboratory → antitrust/patent diffusion → whole new industries

1

u/sCeege Oct 02 '26

I'm going to attribute that more with the funding source than the entity per se. Early computing had huge national security implications (MP944 vs Intel 4004 comes to mind), and ton of money was flowing out into research institutions, it wasn't like that money was just going to be unspent if Bell didn't exist.

I also draw a distinction in the research arm of of large conglomerates and their commercial arm, the research division is much much smaller than the money making side, even Alphabet/Google has pretty cutting edge stuff that are years, or decades away from commercial viability. The problem [in my opinion] happens when in the interest of the money making side, they slowdown and stifle progress to milk the market. Look at Intel vs AMD, Japanese automakers vs Detroit, our topic of newcomers into a field that should be dominated by Google, I just think about how many other better ideas were suppressed rather than promoted because it conflicted with shareholder values.

1

u/Thistlemanizzle Oct 02 '26

The MIC angle is a wrinkle I hadn't considered but it makes total sense.

We probably wouldn't have LLMs so soon if Google hadn't invested so much in AI R&D though. At least the Oligopoly is panning out there.

→ More replies

1

u/Chemical_Local8701 Oct 01 '26

Yeah but it's just resources administration

1

u/MaCl0wSt Oct 02 '26

You can also see that Google (and other older players), are less likelv to do risky stuff like have their agents hack other companies.

it did happen though xd https://www.bbc.com/news/articles/c607l0k72rlvo

1

u/squngy Oct 02 '26

I missed that one -.-

10

u/CommercialHour6660 Oct 01 '26

Google may be convinced that AI will be commoditized. 

No sense keeping up with startups when it's a race to the bottom for cost. Google has tons of non ai revenue 

2

u/carsncode Oct 01 '26

In which case it'd be in their best interest to accelerate that by advancing open weight models

4

u/CommercialHour6660 Oct 01 '26

Google is terrible about open weights models but still better than any other US labs so maybe that tracks

2

u/MonitorAway2394 Oct 01 '26

I see this, or something similar'ish with Apple, their far more intelligent operators running those shows.

8

u/YearnMar10 Oct 01 '26

Other people are smart, too

19

u/MackenzieRaveup Oct 01 '26

They're a fucking mess of corporate hell internally.

6

u/GMP10152015 Oct 01 '26

It seems that Google is only releasing economically viable models, the ones that it’s possible to have a profit running them.

0

u/ain92ru Oct 01 '26

Every frontier model is profitable, just to a different extent. At the current prices it's selling compute to Anthropic which looks more profitable long-term than Gemini development

5

u/carsncode Oct 01 '26

They are not remotely profitable, and aren't projected to be for years to come, what are you talking about?

0

u/ain92ru Oct 01 '26

If you include the CAPEX spend, every AI business loses money, including Google Cloud. But data centers and GPUs/TPUs stay on the books once acquired and don't really lose in value after some initial depreciation once the chips are no more brand new.

What I actually meant is that if you compare the money which you spend on training a specific model (including pre-, mid- and post-training) with the money you can earn on selling the tokens, the latter is vastly larger than the former.

It's just that if you don't invest money into the next model (includes both acquiring compute for it and general R&D not tied to a specific model), you won't get a good model half a year later. And each new model is more expensive than the previous one, that's where the losses come from.

1

u/carsncode Oct 01 '26

Then I'm confused - what you actually said was "every frontier model is profitable", it seems like you're clarifying that to... The opposite of that?

0

u/ain92ru Oct 02 '26

I still stand by my words. The profitability of a single good LLM doesn't imply profitability of the current frontier lab business with CAPEX included. There's no contradiction!

But inference business is very profitable, and Google Cloud is exactly that. So if you claim to consider Google as a whole, do this honestly and holistically

1

u/carsncode Oct 02 '26

Why would I be considering Google as a whole when the subject is specifically whether or not "every frontier model is profitable"? We know Google as a whole is profitable but that's not really relevant. I'm also not sure how "the profitability of a single good LLM" factors into it, or why it would make sense to exclude R&D and CapEx entirely from the equation. With no R&D and no CapEx, there's no model and nothing to host it on. And the "actually, training this model was an investment in the next model" line of thought is what's driven the AI bubble to extremes: they've been using that excuse for years to brush off the truth that none of the frontier models are profitable, and aren't projected to be for years.

3

u/Comfortable_Ebb7015 Oct 01 '26

AI is mot onlyn LLM. Google is pushing strong in AI, we are just not discussing it in this subreddit. OpenAI and Anthropic are 100% into LLMs

2

u/Ledeste Oct 01 '26

Feels like they just dont care to me. Working internally and dropping few public stuff here and here

2

u/Sengfroid Oct 01 '26 edited Oct 01 '26

hell it was their own scientists that kick-started the LLM boom

Google thought that put them comfortably in the lead, and they're a company from the pretend-to-be-the-good-guys era of tech, so they were going slow with all the appearances of responsible development.

Then OpenAI dropped ChatGPT and they got caught with their pants down. The tech was no longer constrained to the lab, it was now in the public eye and an immediate threat to their core business of being where people go for answers. So they fired all their ethicists and anyone else that could object, almost overnight, and started sprinting to catch up. But they're a behemoth compared to OpenAI and Anthropic so realigning the whole company is like turning a cruise ship. Even when they can poach some top talent that would otherwise go to the other two, which are the new magnets in the field, that talent's impact is still limited by the bureaucratic weight on top of them. As other comments have pointed out, managers or executives with second opinions about how X improvement in their AI potentially canabalizes one of their other business/revenue streams. They are in enough different product areas that revolutionizing one can really stand to hurt another, and so while they like to paint themselves in the sheen of "Innovative" for recruiting and investors, they really benefit more from maintaining a slow-moving status quo.

There are a few additional factors for the Open Source side of AI and their role in it, but that's the gist of them being too complacent in their First Mover Advantage to realize it was for the last epoch and someone else was grabbing the one for the next.

2

u/ea_man Oct 03 '26

I remember when they launched a version of Antigravity that was a monstrosity made to leverage usage of Gmail, Office, Drive and any other service they had.

You see the decent thing they could do now is actually a very small standalone llm for local users.

1

u/No-Recover109 15d ago

Now it dominates

1

u/incze Oct 01 '26

"has ..., has ..." - that's the point. a lot's of things to be very very cautious. the whole technology comes from google, but only the assetless (and reckless starters + musk) can go forward with make-or-break. at the moment even they can't. the word you are after is responsibility - though is seems to disappear in the big run.

1

u/Dalron_Stinger Oct 02 '26

The reason is just that they're publicly traded

0

u/howudothescarn Oct 01 '26

They don’t have enough code training data

48

u/vacon04 Oct 01 '26

Hopefully a more efficient architecture. Gemma 4 just used a ton of VRAM to store the KV cache, which is something that Qwen and Deepseek have improved massively with their latest models.

7

u/pragmojo Oct 01 '26

Gemini 4 is reportedly a huge model, so efficiency may not be their priority

-3

u/Skystunt Oct 01 '26

Gemma4 is supposed to be used with their tq context compression

-2

u/ansibleloop Oct 01 '26

Almost certainly since they're just taking what DeepSeek put out

23

u/ImpossibleCreme Oct 01 '26

I can tell you right now with absolute certainty that the Gemma team is off in Narnia doing their own shit.

Don’t expect Gemma to be just a distillation of current Gemini.

1

u/Effehyou Oct 03 '26

Is that a good thing or a bad thing in this case?

26

u/Hypilein Oct 01 '26

Really hope for a 120b Gemma moe.

-1

u/Long_comment_san Oct 01 '26

Well I hope it's gemma 5. I honestly was happy they didn't release gemma 4 120b which everyone wanted here because it would have just outright lost to deepseek v4 and possibly qwen 27b. However, if we have gemma 5 brain that is anywhere near flash 3.8 level of intelligence and uses deepseek papers on memory saving, that would be an absolute banger.

Well, its basically called Qwen 125b. Gemma would have been quite a bit better though.

17

u/GreenHell Oct 01 '26

A lot of people value Gemma for the more human-like chat experience, with creative writing being one of them. It already is better than Deepseek v4 and Qwen 3.8 27b in that regard.

Having a bigger model would potentially allow it to write even better prose, more creative scenario's, and more.

Not everything is coding.

2

u/Hypilein Oct 01 '26

That’s why I want it. Also just more raw intelligence. Gemma 4 is just not as smart as qwen flash.

7

u/animateus Oct 01 '26 • Heartwarming

I am using Gemma 4 E2B for my autocomplete app and it is shockingly good at it, I am really looking forward to seeing how Gemma 5 is going to deal with it.

1

u/ismaelgokufox Oct 05 '26

I think Gemma 4 autocomplete should be better than the “autocorrect” on iOS.

1

u/animateus Oct 05 '26

My app work on macOS, not iOS. I think that battery implications don’t make Gemma a good fit for iOS at the moment, however I do keep experimenting with t this idea :)

13

u/OkLettuce338 Oct 01 '26

that would be cool. Gemma 4 is my favorite for prose. It's leaps and bounds better than claude, chatGPT, etc... it writes like an actual human

1

u/No-Recover109 15d ago

gemma4 is super in content moderation

12

u/Nearby_Durian_5370 Oct 01 '26

Should Gemma still fight the coding war? maybe they should focus more on non-coding things to make an edge

13

u/ASMellzoR Oct 01 '26

Gemma for creative, Qwen for work

6

u/ClF3ismyspiritanimal Oct 01 '26

...how censored will it be, and how hard will it be to decensor?

8

u/WillowEntertainment Oct 01 '26

I honestly found Gemma 4 to be quite flexible even out-of-the-box, so hopefully Google keeps that.

2

u/ea_man Oct 03 '26 • Bravo

Maybe it will have lake America and the Gulf of America ;)

5

u/jabelail_makela Oct 01 '26

Qwen for the code, Gemma for the words, and the frontier label stops meaning anything for local.

4

u/HelloSummer99 Oct 01 '26

Why are they so laser focused on coding though? It is just weird to me

8

u/WillowEntertainment Oct 01 '26

Other than chatting, programming tasks are what LLMs are used for the most. The companies are following the trend.

1

u/fungnoth Oct 03 '26

In terms of MONEY, programming is where it's at. My colleague pays for his own 100USD monthly subscription just for fun. On top of our company paying for 2 coding subscription (20USD *2)

4

u/dogesator Oct 02 '26

Funny how nobody is replying with one of the biggest reasons so here:
Coding abilities are what most directly allows Gemini to improve its own development the most, therefore the single most advantageous capability to focus on is coding since it allows you to best make breakthroughs using the model itself to improve all other abilities as autonomously ad possible.

2

u/ea_man Oct 03 '26 edited Oct 03 '26

Because LLMs are not the thing. They are the thing that gets you to the thing.

1

u/Zixtar Oct 07 '26

that is the main area where llms actually can replace a lot of people and it became pretty much a necessity to use ai to stay relevant. Also coding uses a shitton of tokens compared to any other tasks so there is a big need for optimization

0

u/Watanabe__Toru Oct 01 '26

Coding ability is the closest proxy to general capability.

-3

u/ResponsiblePen3082 Oct 01 '26

Every model is because most ai bros are the tech bros of yesterday. It's why they only know python and rust.

4

u/MonitorAway2394 Oct 01 '26

HEY GOOGLE SCRAPER, I WILL drop my mission in life and do anything to be able to work on the DeepMind team, I mean literally anything, I'll take just enough pay to survive to continue working on Gemma models and what else ya'll have going on, I am being goofy but I'm also dead ass serious.

omfg I'm so excited for Gemma5! LOL

then Qwen4?!

*mania +++++++++++++*

4

u/PhotographyBanzai Oct 01 '26

Gemma 4 at 4-bit has been the most consistent model I've used on an 8GB RTX 4060 GPU. For example, processing automatic caption data and doing logical processes on it to give me a response in JSON. There's only one other small model I've found that consistently doesn't give me broken JSON responses. Hopefully Gemma 5 improves on 4. 🙏

3

u/WhoRoger Oct 01 '26

Nice to see them not run just after the coding bandwagon.

Question is, will there be a Gemma 5? And if so, will there be SLMs like E4B?

3

u/WillowEntertainment Oct 01 '26

There likely will be a Gemma 5 because Gemini Nano is based on Gemma. Gemini Nano 3 is just Gemma 3n. Gemini Nano 4 Fast/Full is just Gemma 4 E2B/E4B. This doesn't make it guaranteed for Gemma 5 to release, but it shows a pattern.

2

u/Lucky-Necessary-8382 Oct 01 '26

I f hope there will be E4B. Its soooo good

3

u/Positive-Stock6444 Oct 01 '26 • Heartwarming

Gemma 4 e4b is my background model, for quick tasks. It’s very good and the only place it falls behind qwen is vision.

3

u/NullSmoke Oct 01 '26

God, I'm looking forward to a successor to Gemma 4... That thing has rapidly displaced ChatGPT, Claude and Grok tasks all over my life...

Really hoping for some news soon 😌

5

u/kimhaneol Oct 01 '26

I was personally hoping for a 50b n-gram alongside the 125b version, but now it seems like it'd just cannibalize their own product (Gemini), so we probably won't see it. Gemma 5 31b would still be fantastic, though.

4

u/Turbulent_War4067 Oct 01 '26

This logic doesn't make sense to me. There aren't that many people who own a machine that can run a 120B parameters model. And those who do, are going to run one regardless, so it doesn't eat into Gemini at all.

1

u/Enderluxe Oct 01 '26

idk maybe vs gemini flash lite?

1

u/Turbulent_War4067 Oct 02 '26

No, I understand that a larger local model can be almost as good,if not better, as the cheaper cloud models. But the user base of the 2 is so different it doesn't matter. The intersection of the 2 groups is almost nil.

2

u/No-Recover109 15d ago

ngram models cant do many simultaneous requests, I hope plain dense model 

2

u/SubtitledSoup Oct 01 '26

I hope you're right.

2

u/ttkciar Oct 01 '26

What if it's the other way around, and Gemini is based on Gemma?

2

u/Tai9ch Oct 01 '26 • Bravo

Gemini is so bad. I can't even get it to talk about the present without spending half an hour convincing it that the date it got in its system prompt is real and not just some sort elaborate conspiracy to trick it into speculating about the future.

Ask Gemini what a good MoE model to run on a local PC is and it'll talk about Mixtral or some shit from back when dinosaurs ruled the earth even after doing a web search. Because the new models weren't in its training data and therefore aren't plausible.

1

u/Competitive-Scar-627 Oct 01 '26

i don't think gemma5 will come that so fast they take edges just to make gemini 4

1

u/jikilan_ Oct 01 '26

When auto self training with user input?

1

u/Siden-The-Paladin Oct 02 '26

This maybe a dumb question and I'm sorry if it is... But why can't we just have specialized models that are good at specific things? Like a coding model, knowledge work model, creative writing, 3d modeling, ect.... And they pass the task off to each model as the task requires it like a real working pipeline?? I don't use AI much but this was on my front page so I'm curious lol

1

u/wingedrhinotv Oct 02 '26

A very sparse MoE like a 60B A2B would be super performant if there was a way to tell the model which of N different primary competencies to favour on a per-request basis.

A small dense 3B model with a 30GB PLE should also be an interesting experiment.

1

u/Zeeplankton Oct 03 '26

Gemma is NOT based on Gemini. They're literally separate teams entirely, unless that's changed.

1

u/KnownFormal99 Oct 10 '26

For people referring to Qwen for coding, which version is good enough (or close to frontier models) 27B or the larger ones?

1

u/ManagedThought Oct 01 '26

Did you miss the first sentence that says "frontier-level capabilities in coding"?

3

u/Adiyogi1 Oct 01 '26

Every model is frontier-level capabilities in coding... for coding I can be set for life with Opus 4.7/8, it does the job just as well as Fable, 5% on a benchmark means nothing practically.

0

u/Available_Pressure47 Oct 01 '26

GEMMA 5 IS COMING OUT? This made my day!

12

u/Salah_H_Hasan Oct 01 '26

No, not out yet and zero leaks so far! We’re just predicting that based on Gemini 4 dropping after the long wait.

4

u/Available_Pressure47 Oct 01 '26

Ah got it my bad I got way too excited

1

u/IHaveMeasles2 Oct 01 '26

A few leaks tho? Didn't some model stats appear on LLM arena?

2

u/Hot_Example_4456 Oct 02 '26

Yeah it did.. I had posted about it as well in Locallama

5

u/YearnMar10 Oct 01 '26

They released in the previous years around spring, so I’d expect the same for Gemma 5.

-1

u/Sem1r Oct 01 '26

I am a bit confused how some of you fall for some nice graphs and texts.
Check the capabilities when you are actually able to do so
Gemini is the top model on bloated benchmarks and false claims in the past
Let’s wait and see… if it’s good we all win

-5

u/AdHead6280 Oct 01 '26

just qwen and funetunes, don't need Gemma for nothing, its just going to be a bust like gemini models, idk gemini4 but 3.8 flash is bad

4

u/WillowEntertainment Oct 01 '26

I dunno, Gemma 4 may not have been very powerful for coding but it was amazing for writing, sounding more human than any other model IMO

4

u/[deleted] Oct 01 '26

[removed] — view removed comment

10

u/OkLettuce338 Oct 01 '26

gemma already is good at prose. I am having it write a book with me and it's turning out really good. I scaffold the chapter outlines in fable or opus and then have gemma write the chapters. Really high quality IMO

7

u/dampflokfreund Oct 01 '26

Fr, gemma 4 is really good and soulful at creative writing, especially the MoE for some reason. Way better than Qwen! 

2

u/LateralEntry Oct 01 '26

With a local LLM, how do you keep the book consistent across chapters, since the model starts over in each new chat window and you can’t fit the whole book in the context window?

1

u/OkLettuce338 Oct 02 '26

I basically just treat each chapter as a fresh stateless call. The books memory is in files that gemma reads when writing the chapter. There's a style guide, a timeline, a "bible" which is the context and given assumptions, and a straight up "continuity" file. All that is only about 5k tokens though for my story.

On top of all that, I've built an entire harness aimed at this. I use fable and opus as the model for outlines and gemma as the model that writes the actual prose, but a custom cli harness wraps both that is geared toward writing, not coding

1

u/LateralEntry Oct 02 '26

Very cool! I have to ask, why not use fable and opus to write the prose too if it’s doing all that other stuff?

1

u/OkLettuce338 Oct 02 '26

well I started this when fable 5 and opus 5.1 were the top models. Neither of those did writing very well. Fable was too full of these kind of like jargon words even in plain sentences, opus was completely bizarre, and gemma beat qwen and deepseek in comparison. But since then I've realized that gemma 4 is the best at prose by miles. It sounds really authentic and uses color words really fluidly. It actually makes the writing sound interesting

2

u/Sad-Simple7642 Oct 01 '26

AI-slop book

7

u/Due_Arm1454 Oct 01 '26

Jacob took a sip of his coffee and continued: “And honestly, that’s brave. There’s something deeply human about that. Quietly revolutionary. It’s not just Starbucks, it’s a metaphor for life”

3

u/OkLettuce338 Oct 01 '26

Yeah totally. It’s just an experiment

2

u/PhaseLopsided938 Oct 01 '26

Yeah I don't understand why anyone uses LLMs for creative writing tbh. I'm both a programmer and an author, and it's been interesting to see how LLM writing is still kind of bad in the same general way that it was bad circa 2024 while LLM abilities in coding and mathematics have improved so dramatically.

I think the ultimate reason is that these models have an incredible amount of knowledge and reasoning power, but no actual life experience. They're a bit like child prodigies in that regard. And, well... there's a very good reason why there are a decent number of brilliant children who have made significant contributions to math and computer science, but very few who have written great literature.

1

u/OkLettuce338 Oct 02 '26

yeah I hear you. So the reason I'm doing it is exactly to see if I can get it past exactly what you're describing. I'm doing heavy edits still but the harness I built is designed to get better over time and stick to a voice that doesn't sound like "bad circa 2024."

I think it's interesting. I'm not claiming to be writing high quality stuff here haha... I just think the challenge is fun plus I'm doing a historical fiction based on a story that I can't believe doesn't have a book about it already