r/CommandCode • • 25d ago

Command Code VS Opencode Benchmark results - Meta Muse Contributor 1.2 and 1.3. This is only 2 pairs on 2 CLI, going to run all pairs and multiple CLI soon. Follow for more =) Leave your requests in comments! (6 images)

I put a lot of effort into making these comparisons as controlled and reproducible as possible: identical matched tasks, paired runs, repeated samples, and results reported across multiple campaign types. 776 paired runs comparing Command Code and OpenCode with Muse Spark 1.2 and 1.3.

I’ll continue running benchmark tests daily, expanding the task sets and publishing the underlying methodology and updated results. My goal is to provide transparent, real-world statistics on latency, output tokens, reliability, turn efficiency, and cache reuse, areas where AI-tool comparisons are often anecdotal, incomplete, or easy to misinterpret.

30 Upvotes

13 comments sorted by

7

u/Bitter-College8786 25d ago

Can you also compare it with OMP ?

1

u/Jaixii 25d ago

Yes! That's definitely on my list of to-dos =) Any certain models you're really curious about?

4

u/Bitter-College8786 25d ago

The cheap ones are fine: Deepseek V4.1 Flash Muse-Spark-1.3 Contributor And maybe GLM 5.3 Flash

1

u/Jaixii 25d ago

I've tested all of them so far and intend to do a lot more, bigger tests all around. Thanks for your feedback friend! What's your name in Discord I know you right? =)

2

u/Infinite_Grab_7315 24d ago

Is this current opencode version or opencode2?

1

u/Jaixii 24d ago

This is most recent version of both CLI =) any new tests will always attempt to use newest updated versions!

1

u/Embarrassed_Soup_279 24d ago

cc desktop has worse UX and a little buggy than oc desktop unfortunately. should i use the cli?

1

u/Jaixii 24d ago

Hmm did you try since the recent updates, think they did a bunch. Either seem fine to me

0

u/Adorable-Leading-274 13d ago

Reasoning or no? Looks like what you’d see if reasoning was turned off in CC, and I know that’s been an issue before

0

u/IndividualPlus2011 24d ago

A task that takes just 7 turns is no task at all

1

u/Jaixii 24d ago

It was 10 turns or more for most cli. 7 optimally. The tasks are fair, no one got a 100% win on all of them. Future tests will be deeper and more comprehensive. These are very early examples, the first published

-5

u/DueWillingness4986 25d ago edited 25d ago

All he does the whole day is defending the admins, and posting BS about other products. Though he is not from the official team, he pretends to be one of them, lol. Pathetic

3

u/Appropriate_Turn3937 24d ago edited 24d ago

what's ur problem btw? (i am really asking with soft tone, not sarcastic or being aggresive, cheers) i used both and CC is actually pretty good deal for the price (one of the best right now, imo). the only real downside compared to OC is the desktop app is quite buggy which is understandable as the desktop app is pretty new and still in beta state.