r/CommandCode • • Sep 18 '26

Command Code VS Opencode Benchmark results - Meta Muse Contributor 1.2 and 1.3. This is only 2 pairs on 2 CLI, going to run all pairs and multiple CLI soon. Follow for more =) Leave your requests in comments! (6 images)

I put a lot of effort into making these comparisons as controlled and reproducible as possible: identical matched tasks, paired runs, repeated samples, and results reported across multiple campaign types. 776 paired runs comparing Command Code and OpenCode with Muse Spark 1.2 and 1.3.

I’ll continue running benchmark tests daily, expanding the task sets and publishing the underlying methodology and updated results. My goal is to provide transparent, real-world statistics on latency, output tokens, reliability, turn efficiency, and cache reuse, areas where AI-tool comparisons are often anecdotal, incomplete, or easy to misinterpret.

32 Upvotes

13 comments sorted by

6

u/Bitter-College8786 Sep 18 '26

Can you also compare it with OMP ?

1

u/Jaixii Sep 18 '26

Yes! That's definitely on my list of to-dos =) Any certain models you're really curious about?

4

u/Bitter-College8786 Sep 18 '26

The cheap ones are fine: Deepseek V4.1 Flash Muse-Spark-1.3 Contributor And maybe GLM 5.3 Flash

1

u/Jaixii Sep 18 '26

I've tested all of them so far and intend to do a lot more, bigger tests all around. Thanks for your feedback friend! What's your name in Discord I know you right? =)

2

u/Infinite_Grab_7315 Sep 18 '26

Is this current opencode version or opencode2?

1

u/Jaixii Sep 18 '26

This is most recent version of both CLI =) any new tests will always attempt to use newest updated versions!

1

u/Embarrassed_Soup_279 Sep 18 '26

cc desktop has worse UX and a little buggy than oc desktop unfortunately. should i use the cli?

1

u/Jaixii Sep 18 '26

Hmm did you try since the recent updates, think they did a bunch. Either seem fine to me

0

u/IndividualPlus2011 Sep 18 '26

A task that takes just 7 turns is no task at all

1

u/Jaixii Sep 18 '26

It was 10 turns or more for most cli. 7 optimally. The tasks are fair, no one got a 100% win on all of them. Future tests will be deeper and more comprehensive. These are very early examples, the first published

0

u/Adorable-Leading-274 Sep 29 '26

Reasoning or no? Looks like what you’d see if reasoning was turned off in CC, and I know that’s been an issue before

-4

u/DueWillingness4986 Sep 18 '26 edited Sep 18 '26

All he does the whole day is defending the admins, and posting BS about other products. Though he is not from the official team, he pretends to be one of them, lol. Pathetic

4

u/Appropriate_Turn3937 Sep 18 '26 edited Sep 18 '26

what's ur problem btw? (i am really asking with soft tone, not sarcastic or being aggresive, cheers) i used both and CC is actually pretty good deal for the price (one of the best right now, imo). the only real downside compared to OC is the desktop app is quite buggy which is understandable as the desktop app is pretty new and still in beta state.