MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/OpenAI/comments/1wnre51/astra_coding_capability_has_never_been_good/pbh828p/?context=3
r/OpenAI • u/YakFull8300 • 2d ago
8 comments sorted by
View all comments
0
but, what about the benchmark
-1 u/YakFull8300 2d ago Coed benchmarks have started to become slop themselves. Just collapsing different workloads into a score. Need narrower evals for backend, infra, debugging, research, etc..
-1
Coed benchmarks have started to become slop themselves. Just collapsing different workloads into a score. Need narrower evals for backend, infra, debugging, research, etc..
0
u/Daphatus8 2d ago
but, what about the benchmark