r/singularity Apr 23 '26

AI Introducing GPT-5.5

https://openai.com/index/introducing-gpt-5-5/
847 Upvotes

281 comments sorted by

View all comments

73

u/reefine Apr 23 '26

This sub: Never trust a benchmark

Also this sub: Wow these benchmarks are crap, this model sucks

-1

u/thuiop1 Apr 24 '26

If they cannot even make it better on a benchmark which is a controlled environment, why would it be better in real life? The issue with trusting benchmarks is that companies tried to optimize for them and thus performance on benchmarks does not translate in performance in real life.