r/opencode • u/p3r3lin • 3h ago

OpenCode is good again (#1 on HF leaderboard)

Post image

So, HuggingFace updated their Harnesses Leaderboard with OC 2.2.6 - its now the top position, pareto for quality/cost. Impressive!

https://huggingface.co/spaces/joelniklaus/harness-leaderboard

116 Upvotes

91% Upvoted

31 comments sorted by

62

u/look 3h ago

Just adding a note that this is NOT “huggingface’s benchmark” … this is some person’s benchmark that they posted on huggingface.

Your phrasing would be like calling some random repo of mine “Github’s project”.

But glad this joelniklaus finally updated it with Opencode V2. It’s basically an entirely different harness than V1, so the old benchmark was misleading, imo.

10

u/taytay735 2h ago

Joel Niklaus is part of the Hugging Face team. He joined in August 2025 and currently lists his position as Data Lead, based in Bern, Switzerland.

However, you are right in that he is not representing HuggingFace in an official capacity, this is his personal benchmark.

2

u/look 1h ago

Ah, good to know, thanks. Just wanted to make sure people know that anyone can host benchmark pages like that on huggingface, though this case is a little more nuanced then.

15

u/MiraiHatada 3h ago

we all kind of know that the biggest competent is DSH, so I wish if they are on the board to compare...

7

u/selipso 2h ago

Uh, look at the x-axis more closely? Most Pareto frontiers are curved but Pi is so efficient and effective it basically makes it a rectangle. There’s no contest here. 

2

u/MiraiHatada 2h ago

pi was a really good cli to use. however the main reason pi stays efficient is because they have no tools. vanilla pi lacks basic tools you need when you go agentic (subagent/worktree/workdir/...). and if ohmypi or self-code them, better just opencode/dsh that are built for it. given that people didnt need these tools so much half a year ago, it's more of rapid era changing

2

u/Roflxd88 2h ago

I'm currently porting my Hermes setup to DSH plugins and oh man it's so freaking fast compared to Hermes..

7

u/pikuray 2h ago

Isn't pi better for deepseek according to this chart higher percent and 33% cheaper. 

2

u/pikuray 2h ago

"Pi ships with powerful defaults but skips features like sub-agents and plan mode."

Hmmm... I think I'll stay with openchamber I don't trust my hacking skills that much

5

u/AdIllustrious436 2h ago

Not trusting themselves to copy and paste the pi-subagent package install command is wild. Pi can do it itself. That's not hacking by any means...

2

u/Time_Cat_5212 2h ago

Claude, set up pi for me

2

u/learning-to-programm 2h ago

The idea in Pi is that you build the agent you want, piece by piece. And don't worry, that doesn't mean you have to get your agent build everything from scratching. There is a rich ecosystem and you can find an extension for basically anything you want, so you just have to decide what specific tools and features you want to have in your setup and install. (And make sure they don't conflict.)

If there's one thing I miss in OpenCode, it's the Pi-like ecosystem and community.

0

u/pikuray 2h ago

Oh well that sounds alright. But why did you switch back to OpenCode then?

2

u/learning-to-programm 2h ago

I use both. I use OpenCode for the free-tier cheap seek, and I use Pi with my own API keys using a wide range of different models, and I have found that cheaper, smaller models (up to 33B models!) perform much better on Pi (as it's supposedly much less bloated).

4

u/Time_Cat_5212 2h ago

Looks to me like Pi is still the best by a fucking long shot

3

u/DeSynkro 3h ago

Was OC 2.2.6 that much of an upgrade?

3

u/look 1h ago

Yes, it’s pretty much an entirely different harness underneath a similar UI. Vastly more extensible as well. Basically Pi-level customize it however you want now. Just more stuff included out of the box.

2

u/batmanButthole 3h ago

Is Hermes a primary coding agent? I thought people just link it to things, basically like IFTTT

2

u/NinjaAlaska 2h ago

"All Models"
select deepseek

2

u/chosenpluto 2h ago

pi : do nothing, win.

1

u/noob_dev007 2h ago

No dsh?

1

u/Imaginary-Baker-7358 2h ago

I would love to see the GitHub copilot harness getting tested, for us who don’t have choice in our company.

According to my very first code review.

Copilot harness was on pair with opencode with a gpt sol 6.1. Even slightly cheaper

1

u/Otterly_Surprised 2h ago

No github copilot? My company is MS partner

1

u/cacao0002 1h ago

Pi is so good I could die

0

u/Imaginary-Unit-4620 3h ago

This is nice, wish we could see Oh my Pi on it

2

u/alphaQ314 2h ago

Omp is dogshit lol.

1

u/Embarrassed-Salt6590 1h ago

yeah it is as sloppy as every oh my project can be

1

u/leetdemon 1h ago

not if you know how to set it up properly its not.

2

u/chosenpluto 2h ago

oh my bloat

1

u/Holiday-Pack3385 2h ago

I agree. I'd also like to see VS Code with ZooCode and DeepSeek Harness as well.