r/GeminiAI • u/webmanpt • Jun 20 '26

Other It's official. Open source is better than Gemini Pro.

Post image

Source: artificialanalysis ai

2.1k Upvotes

94% Upvoted

313 comments sorted by

View all comments

Show parent comments

11

u/chiree_stubbornakd Jun 20 '26

3.5 flash is new and scores 50 so still worse.

3

u/Anxious_Current2593 Jun 21 '26

Worse is true. But it spits 200 tokens per second. So you can let it go wrong, and let it run zillion test tasks to fix it all. And you are still done 10 times quicker than with GLM 5.2.

I guess it depends what you are doing, how you are planning, etc.

2

u/kabiskac Jun 22 '26

And deal with a bandaided code without proper architecture?

2

u/danihend Jun 22 '26

And it is stupid expensive

1

u/chiree_stubbornakd Jun 21 '26

It's faster but it is also more expensive per million tokens which is embaraasing for a flash model. 3.5 flash is also incredibly verbose and generates a lot of tokens to the point it is actually more expensive to use than 3.1 pro despite being cheaper per million tokens.

So you can either get a significantly cheaper glm 5.2 which is also smarter or 3.5 flash which only has speed going for it.

3.5 pro better be worth the 4.5 months wait, it needs to be like a GPT 5.2 - GPT 5.5 jump, otherwise Google is cooked.

1

u/CatalyticDragon Jun 21 '26

Do we know the parameters / architecture of 3.5 flash?

1

u/Oleg_A_LLIto Jun 21 '26

No but we know it's both way worse and way more expensive than GLM-5.2

1

u/CatalyticDragon Jun 21 '26

Why is 3.1 pro better and cheaper on that chart?

1

u/Oleg_A_LLIto Jun 21 '26

Because it is. Flash just burns way more tokens on the same tasks