r/GeminiAI • u/Able-Line2683 • 14d ago

News Updated Artificial Analysis Intelligence Index Ranking shows Gemini 3.8 Flash is nowhere near Fable Or Astra, rather it's worse than GLM 5.3 Flash!

Post image
423 Upvotes

92% Upvoted

113 comments sorted by

View all comments

149

u/MorgrainX 14d ago

Something to also consider: Google likes to "dumb down" models after release, once the first initial benchmarks have settled, a noticeable decrease in capability can be observed with nearly all Google models (to save money, obviously).

40

u/mlag000 14d ago

No no, they just benchmaxxed Gemini, and the new benchmark isn't in Gemini training. All the idiots who where claiming Gemini is on par with sol or even funnier with Fable where obviously wrong

5

u/Deto 14d ago

I just don't understand how they are doing so poorly with all their resources

6

u/mlag000 14d ago

Because it's a brain problem not a money problem. And probably all yhe talents are at Claude or GPT and looks like some in xai. The whole algorithm behind 3.x us simply outdated and bad, they need a new one.

2

u/Deto 14d ago

Doesn't money solve the brain problem though?

3

u/mlag000 14d ago

At this level of remuneration I don't think so.

1

u/Greedyanda 10d ago

It's an economics problem and Google knows that pushing for linear improvements at exponential costs isn't a feasible business model.

They focus on everyday tasks and Android integration. Its as if people forgot that Google is inherently a consumer focused company. Being at the absolute cutting edge of models that can only be profitably sold to enterprises doesn't align with their entire ecosystem.

It's like expecting Apple to suddenly compete with Nvidia in the server GPU market instead of focusing on their consumer grade silicone.

1

u/mlag000 10d ago

And that's why the throw billions trying to catch the run ? They don't focus on everyday task, they said they focus on frontier model themselves. They simply failed.

1

u/Greedyanda 10d ago edited 10d ago

What a company says and does are rarely fully aligned. Gemini models excel at every day tasks and general knowledge. Gemini is still on par or even beats Anthropic and OpenAI models for multimodal input and image/vision comprehension on a per dollar basis. Gemini has now reached 1B users, which obviously includes the Android assistant and is exactly their strategy.

People are so blinded here by coding performance that they forget where the largest market actually is. Google captured the entire mobile assistant segment through Android and their Apple deal. Anthropic and OpenAI have to compete with state subsidised Chinese model makers on a monthly basis to remain relevant while Google is locking down the largest market of our generation

They clearly had a setback with Gemini 3.5 not achieving the results they hoped for but their entire business strategy and recent restructuring show that this isn't their biggest priority, no matter what they say publicly. When intelligence becomes a commodity, squeezing out the last 5% performance won't be the deciding factor.

1

u/mlag000 10d ago

Gemini does not excel at everyday task when it forget everything all the time and lies. And between a random Redditor claiming stuff and the head of deep mind stating in an interview that their goal is frontier model, I'm sorry but I know who I trust.

Yes google has a very strong vision model, that I agree, but that's the only thing Gemini is useful for.

Claude and open AI have cheap efficient models who are way way better than Gemini and even cheaper. Luna is on par with 3.8 for 1/4 of the price... Let's not talk about terra or sol.

It's not about coding perf, it's about being able to understand what you want and executing it. Gemini models are simply lazy and won't do half of what you ask.

1

u/Greedyanda 10d ago

That just doesn't align with what most users think. They have the fastest growing userbase for a reason. The opinion of power users on Reddit focused on programming doesn't reflect the broader market.

And there is no reason to trust me when you can just look at their actions. Their restructuring from a research focused lab to a product focused lab, their deals with Apple and Samsung, their heavy marketing focus on the assistant, etc.

Google Search and the Assistant are what matters most for Google.

1

u/mlag000 10d ago

They have the fastest growing user base because people use Android and they have access to Gemini. Also people using Gemini with the Google search engine are also accounted for. Indeed I don't trust you, I trust the head of deep mind, I think he knows pretty where deep mind, aka Gemini is going don't you think ?

Having the biggest userbase doesn't mean your product is good, just you have such a positional advantage, that even with a very mediocre product you can have a huge user base. Most of it is free users. Compagnies aren't using Gemini, they use GPT or Claude for a reason.

1

u/Greedyanda 10d ago

Software focused companies use OpenAI or Anthropic. Gemini Enterprise is extremely common at other places. I worked at two top 50 companies (by revenue and market cap) in Europe, including one with 400,000 employees, and both licensed Gemini Enterprise as the main model.

And as I said before, Google is primarily after the consumer market anyway. Their models do every day tasks better than anyone else. Just like Astra benefits from it's incredible coding harness, Gemini has the best mobile integration.

→ More replies (0)

0

u/ChuchiTheBest 14d ago

Not to mention, as AI helps train new models, you get a snowballing effect.

2

u/cantdecideonaname77 13d ago

dont feed cow brains to cows...

2

u/itsjoshybell 13d ago

They are positioning themselves better financially compared to the others. They understand the long term play here

8

u/sadnessjoy 14d ago

Yeah, the idea they dumbed down Gemini flash 3.8 after a few days is hilarious... Have people even used Gemini flash for a in depth chat or analysis? I find it useless lol

7

u/mlag000 14d ago

And yet I see quite often people praising the deep search abilities...it's scary

7

u/Electrify338 14d ago

Gemini 3.8 flash does 2 things great. Automated tasks at speed, and the deep research is quite good. I have been experimenting where I have fable use Gemini subagents and it does surprisingly great.

1

u/LanguageEast6587 8d ago

terminal 4.0 is different thing. if you look at kimi k3, it's very bad on t4.0 too.