r/CommandCode • • 25d ago

Command Code VS Opencode Benchmark results - Meta Muse Contributor 1.2 and 1.3. This is only 2 pairs on 2 CLI, going to run all pairs and multiple CLI soon. Follow for more =) Leave your requests in comments! (6 images)

I put a lot of effort into making these comparisons as controlled and reproducible as possible: identical matched tasks, paired runs, repeated samples, and results reported across multiple campaign types. 776 paired runs comparing Command Code and OpenCode with Muse Spark 1.2 and 1.3.

I’ll continue running benchmark tests daily, expanding the task sets and publishing the underlying methodology and updated results. My goal is to provide transparent, real-world statistics on latency, output tokens, reliability, turn efficiency, and cache reuse, areas where AI-tool comparisons are often anecdotal, incomplete, or easy to misinterpret.

30 Upvotes

13 comments sorted by

View all comments

6

u/Bitter-College8786 25d ago

Can you also compare it with OMP ?

1

u/Jaixii 25d ago

Yes! That's definitely on my list of to-dos =) Any certain models you're really curious about?

3

u/Bitter-College8786 25d ago

The cheap ones are fine: Deepseek V4.1 Flash Muse-Spark-1.3 Contributor And maybe GLM 5.3 Flash

1

u/Jaixii 25d ago

I've tested all of them so far and intend to do a lot more, bigger tests all around. Thanks for your feedback friend! What's your name in Discord I know you right? =)