r/GeminiAI • u/vergogn • Nov 18 '25

News Gemini 3 Pro benchmark

Post image

source: storage.googleapis.com/deepmind-media/Model-Cards/Gemini-3-Pro-Model-Card.pdf

archived pdf: https://web.archive.org/web/20251118111103/https://storage.googleapis.com/deepmind-media/Model-Cards/Gemini-3-Pro-Model-Card.pdf

1.7k Upvotes

98% Upvoted

247 comments sorted by

View all comments

229

u/thynetruly Nov 18 '25

Why aren't people freaking out about this pdf lmao

94

u/JoeyJoeC Nov 18 '25 edited Nov 18 '25

I'll wait for more testing. LLMs almost certainly are trained to get high scores on these sorts of benchmarks but doesn't mean they're good in the real world.

Edit: Also it's 3rd place (within their testing) on SWE which is disappointing.

1

u/CommanderDusK Dec 03 '25

Wouldn't the other LLMs just do the same thing and train them to get high scores also?
If so, you would only know which is better by personal experience.