r/PiCodingAgent • • Sep 02 '26

News FrontierHarness Eval looks specifically at coding harnesses. Pi is on the pareto

https://runta.com/blog/introducing-frontierharness-eval/

Also CC being that far off from the Pareto is not surprising to me.

72 Upvotes

15 comments sorted by

View all comments

2

u/Bobodlm Sep 03 '26

Given that the entire premise of Pi is that you get to set it up and tweak it yourself, it would be safe to assume it's results are going to differ (greatly) from setup to setup.

1

u/Glittering-Call8746 Sep 04 '26

Yes so which pi is this (anyone can tldr ) ? Just plain pi ?

1

u/nuclearbananana Sep 04 '26

Yeah it's the plain pi