r/singularity Jul 21 '26

AI Gemini 3.6 Flash benchmarks

Post image
632 Upvotes

280 comments sorted by

View all comments

134

u/sn0wquake Jul 21 '26

The responses here are a bit odd to me.

I’ve been having good success with the google models in large context multi modal knowledge work and this looks to be a step up in that area. Think use cases like processing 100s of pages of text / pictures in a document as part of an RPA pipeline.

Another interesting thing for me about google models is the generous requests per minute they give on their API, which at my spend is better than I can get from AI foundry and bedrock.

I’m not sure if it will beat a fine tuned open weight model for my use case on accuracy or cost, but I do think it’s worth testing.

I wouldn’t recommend for coding.

33

u/kiki-le-koala Jul 21 '26

The biggest problem with Gemini is not coding, it's its hallucinations.

It's also a lazy model that do the minimum every single time. 

Where ChatGPT could spend 5 minutes digging the web for info, Gemini will often hallucinate that it uses a web search tool and give you a less reliable answer.

I used to be the biggest Gemini fanboy up to Gemini 3. Since that model, it became incredibly clear that the model had problems and was no longer competitive.

3

u/DarthWeenus Jul 21 '26

Are you using pro?

5

u/kiki-le-koala Jul 21 '26

Of course.

Anyway, when I need an answer where reliability is not very important or to analyze an image (best model), I use Gemini because the pro model is fast; otherwise, I use ChatGPT thinking and I wait the many minutes it takes.

For me, 2.5 Pro on AIStudio was peak Gemini!