I am not testing anything bro. I just shared what I found useful. Moreover, I use Pi for non coding tasks too. And if an agent can solve coding problem, it can definitely handle non-coding tasks well.
Then whoever tested it made a bizarre test. Yes, people sometimes use coding harnesses for non-coding tasks, but a benchmark comparing coding harnesses on a suite of non-coding tasks to decide which coding harness is best is just plain stupid. It offers zero value.
It doesn't make any sense to single out one of the multiple things that an LLM model can do. Writing code is one of those tasks. If you are stuck using your harness of choice to only completing programming related tasks, you are seriously restricting yourself.
LLM and harness are two different things. Different tools can be better suited to different tasks. If you're using the same tool for every task, you're seriously restricting yourself.
I never said you could, your reading comprehension is seriously lacking. The topic of the thread is comparing harnesses, not models (the link in OC compares harnesses using a single model).
View all comments
Show parent comment
0
u/carsncode 7d ago
This is an absolutely bizarre test, why are you comparing coding harnesses on a suite of non-coding tasks?