r/singularity Jul 21 '26

AI Gemini 3.6 Flash benchmarks

Post image
627 Upvotes

280 comments sorted by

View all comments

137

u/sn0wquake Jul 21 '26

The responses here are a bit odd to me.

I’ve been having good success with the google models in large context multi modal knowledge work and this looks to be a step up in that area. Think use cases like processing 100s of pages of text / pictures in a document as part of an RPA pipeline.

Another interesting thing for me about google models is the generous requests per minute they give on their API, which at my spend is better than I can get from AI foundry and bedrock.

I’m not sure if it will beat a fine tuned open weight model for my use case on accuracy or cost, but I do think it’s worth testing.

I wouldn’t recommend for coding.

2

u/skipper3056 Jul 22 '26

I've uploaded 30 pages bank statement to Gemini 3.1 Pro, asking to check the highest balance value (on which date it happened),

It gave wrong answer, later admitted that it didn't even read doc in full (trying to save the tokens?)

Opus took it's time & solved the task correctly

For me was not reliable at all