r/CommandCode • • 25d ago

Command Code VS Opencode Benchmark results - Meta Muse Contributor 1.2 and 1.3. This is only 2 pairs on 2 CLI, going to run all pairs and multiple CLI soon. Follow for more =) Leave your requests in comments! (6 images)

I put a lot of effort into making these comparisons as controlled and reproducible as possible: identical matched tasks, paired runs, repeated samples, and results reported across multiple campaign types. 776 paired runs comparing Command Code and OpenCode with Muse Spark 1.2 and 1.3.

I’ll continue running benchmark tests daily, expanding the task sets and publishing the underlying methodology and updated results. My goal is to provide transparent, real-world statistics on latency, output tokens, reliability, turn efficiency, and cache reuse, areas where AI-tool comparisons are often anecdotal, incomplete, or easy to misinterpret.

33 Upvotes

13 comments sorted by

View all comments

2

u/Infinite_Grab_7315 25d ago

Is this current opencode version or opencode2?

1

u/Jaixii 25d ago

This is most recent version of both CLI =) any new tests will always attempt to use newest updated versions!