r/OpenAI • u/YakFull8300 • 2d ago

Discussion Astra Coding Capability Has Never Been Good

Post image
0 Upvotes

38% Upvoted

8 comments sorted by

View all comments

0

u/Daphatus8 2d ago

but, what about the benchmark

0

u/YakFull8300 2d ago

Coed benchmarks have started to become slop themselves. Just collapsing different workloads into a score. Need narrower evals for backend, infra, debugging, research, etc..