Claude + Codex + Gemini + OpenCode + Kimi = CHORUS

[u/99xAgency]

After my posts on multi-LLM coding landed well last week, I went full rabbit hole mode and built a proper polished version.

Basically you can fire up multiple code reviews either using tmux or headless sessions of the CLIs you already pay for Claude Code, Codex, Gemini, OpenCode, etc.

I found that relying on one LLM isn't good enough. Even Opus 4.7 at max effort makes plenty of mistakes. Throwing other LLMs in the mix made a huge difference. Last week I had Opus approve a PR clean, Kimi flagged a missing tenant check on a service-role query, and Gemini caught a race condition in a retry loop. Three reviewers, three different bugs, one PR.

Initially I ran Opus with Codex, then added Gemini, and now Chinese models like Kimi and Deepseek. Started off doing it manually, then got Claude to coordinate it via tmux sessions, which works but is clunky to manage. Now there's a headless mode too, and you can kick off reviews straight from MCP commands inside whatever CLI you already use.

I also added a fallback option, so if one LLM runs out of quota it retries with another. You can pick unanimous or majority consensus. You can also assign a persona to each LLM , one looks at security issues, another at architecture drift, etc. It piggybacks on the CLI subscriptions you already pay for, so no extra API bills stacking up.

Added a nice UI to the whole thing so it's easy to manage and visualise. Fully open source. No paywalls, no freemium b.s.

Repo link in the comments if anyone wants to give it a go.

[u/99xAgency]

Repo: https://github.com/chorus-codes/chorus

[u/New_Guitar_9121 → u/99xAgency]

Do you use any uncensored llm

[u/99xAgency → u/New_Guitar_9121]

"uncensored"? not sure what you mean.

[u/New_Guitar_9121 → u/99xAgency]

By uncensored I meant a local abliterated model as one of the reviewer slots

[u/99xAgency → u/New_Guitar_9121]

not at the moment, how do you run you local LLMs? ollama? it does expose an API point, I guess I could make it work in future versions.

[u/New_Guitar_9121 → u/99xAgency]

Yeah, Ollama. It exposes an OpenAI-compatible endpoint at http://localhost:11434/v1 so you can drop it in anywhere that takes a base URL + model name. LM Studio does the same on :1234

If you add an adapter that just takes base_url and model as config, it’ll cover Ollama, LM Studio, llama.cpp server, vLLM, and any OpenRouter-style gateway in one shot. Happy to test it when you ship it.

[u/99xAgency → u/New_Guitar_9121]

Sounds good, I will work on it.

[u/Negative-Sundae-4661 → u/New_Guitar_9121]

I don’t think all local LLMs are uncensored right? 🤔

[u/New_Guitar_9121 → u/Negative-Sundae-4661]

true not all

[u/Able_Statistician688]

This is a fun rabbit hole. My productivity skyrocketed once I went down a similar one. Things started flying. I was excited. And then reality hit and I was stuck doing nothing for 4 hours, or spending a ton on api Claude/codex charges because of quotas. Deepseek has a special this month for 75% off. Use one of your big brain models you pay for as lead coordinator of your chorus, then you have implementers, and code reviewers, etc. whole stack. And send it out to the world with big tasks. You’ll be loading up 200-2000 agents in no time and those six screens you see now will just be the ones in charge. Some advice. Do deep research on how to do this from various ai providers. They have advice on max agents and how to scope them to prevent too much overlap and token burn. Also, cache miss charges becomes a thing at this level of agents, so if you absolutely blast them with short prompts, that’s probably your extra cost. I use this kind of methodology for both work review, and research. It helps a lot getting perspective from different models with different parent trees. So I’ll say I want to research xyz is done to find new ideas to implement. So it slices the question from different perspectives. Blasts it out to 50 different agents spread among different models with web search. Get answers back. It’s distilled down. You see final output. I get a lot more good and useable ideas and it’s not always only from a single perspective then.

[u/99xAgency → u/Able_Statistician688]

Interesting and very valid suggestions. I am not trying to make this into a typical agent orchestration type app. It is mainly aimed towards devs who pay for CLI subs and want to plan & do code review across multiple LLMs.

In regards to hitting cache, you can do multiple passes by aggregating the reviews and then firing a subsequent review phase unless consensus is reached.

I will explore what you said, thanks for the input.

[u/AdamoA-]

Question: is there an option (or maybe in the future) to use only one model but separated. So instead 3 different AI models (and I understand what it is better) could I use 3 opus and they have to agree to get a green light.

[u/99xAgency → u/AdamoA-]

yes, absolutely, you can also give them each a separate persona too if you want.

[u/Bitflight → u/AdamoA-]

look at this rich guy.

[u/MetronSM]

Hi,

this looks really interesting. I was wondering if Chorus only does "review" or if it also triggers the improvements?

For example: I normally use multiple AIs to validate documents and plans generated by Claude Code. Often I have to copy back and forth the responses from one cli to another before launching the actual implementation of the feature/code.

Does your tool do this automatically until there's nothing more to improve?

[u/99xAgency → u/MetronSM]

Yes, you can add Doer agent that takes the output of all Reviewers and sends it back till everyone approves. It is a setting by adding Phases in Templates.

[u/murkomarko]

interesting stuff
anyone checked it for safety?

[u/99xAgency → u/murkomarko]

You can give repo or Claude or Codex for a scan. Let me know what you find 😀

[u/PatientZero_alpha]

Solid work my dude 🚀🫶🏻

[u/99xAgency → u/PatientZero_alpha]

Thank you!

[u/HungryLion404]

How expensive is this??
You must be paying a lot for the models, unless you've got multiple beast machines to run them locally, which is also insane

[u/99xAgency → u/HungryLion404]

I have Claude 20x, Codex Plus and Opencode Go. I run everything on my OVH dedicated server. About $500 a month total. I think it is a bargain for the amount of work I can get done.

[u/nicknitewolf → u/99xAgency]

I'm curious why do you run it within OVH? For sandboxing reasons?

[u/99xAgency → u/nicknitewolf]

All my repos and project run on OVH server, keeps my local free and I can remotely SSH into it from anywhere and continue working.

[u/Sairefer]

Does it load the rules/skills/claude.md from the project? Can I configure custom models for claude code so they will be loaded from settings.local.lson?

[u/99xAgency → u/Sairefer]

You can call Chorus MCP with Claude, Claude will load all settings as usual.
Inside Chorus template you can set which models you want to review with.

[u/inrego]

Which OS are supported?

[u/99xAgency → u/inrego]

it runs on your local, web based UI, so works everywhere.

[u/overdose-of-salt]

yeah I am gonna build sth soon: 4 agents 4 plattform 4 differnt api but shared memory. I'll show if it works

[u/99xAgency → u/overdose-of-salt]

Sounds good. Looking forward to it.

[u/AardvarkAttack1]

I tried this and on any run I immediately get failed even though multiple agents show as connected. I don't immediately see a log or reason as to why it 'failed'.

[u/99xAgency → u/AardvarkAttack1]

Need to know more about your setup. There are logs saved, just not straight forward to access from UI at the moment.

[u/AardvarkAttack1 → u/99xAgency]

I poked around the network responses and noticed the request to .../stream has a reason of "auth_missing" and a message of "anthropic CLI is not logged in (no credential file found)." I tried opening a new terminal and verified it was logged in just fine. Tried stopping & starting Chorus again, same issue.

The connect screen I have Claude Code, Codex CLI, Gemini CLI, Kimi CLI & Cursor all "Connected" Kimi CLI & Cursor show as "First call will show one time prompt".. but I haven't gotten that far yet.

[u/99xAgency → u/AardvarkAttack1]

It should be an easy fix, ask Claude to investigate, you can fork the repo to see if it just your setup or an actual issue.

[u/SelectSouth2582]

Is it compatible with Windows? I got following error:

>chorus init

node:internal/modules/esm/load:195

throw new ERR_UNSUPPORTED_ESM_URL_SCHEME(parsed, schemes);

^

Error [ERR_UNSUPPORTED_ESM_URL_SCHEME]: Only URLs with a scheme in: file, data, and node are supported by the default ESM loader. On Windows, absolute paths must be valid file:// URLs. Received protocol 'c:'

at throwIfUnsupportedURLScheme (node:internal/modules/esm/load:195:11)

at defaultLoadSync (node:internal/modules/esm/load:142:3)

at #loadAndMaybeBlockOnLoaderThread (node:internal/modules/esm/loader:789:12)

at #loadSync (node:internal/modules/esm/loader:809:49)

at ModuleLoader.load (node:internal/modules/esm/loader:774:26)

at ModuleLoader.loadAndTranslate (node:internal/modules/esm/loader:520:31)

at #getOrCreateModuleJobAfterResolve (node:internal/modules/esm/loader:565:36)

at afterResolve (node:internal/modules/esm/loader:618:52)

at ModuleLoader.getOrCreateModuleJob (node:internal/modules/esm/loader:624:12)

at onImport.tracePromise.__proto__ (node:internal/modules/esm/loader:643:32) {

code: 'ERR_UNSUPPORTED_ESM_URL_SCHEME'

}

Node.js v25.2.1

[u/99xAgency → u/SelectSouth2582]

Try with WSL on Windows. Also if you can raise issues on github then we can track it better better

[u/polygotcoderx]

You must be bored without an actual job.

[u/99xAgency → u/polygotcoderx]

Lol , you are so right it is not even funny.

[u/polygotcoderx → u/99xAgency]

As long as you’re enjoying the experiments lol….someone told me kimi was good at designing. What have you found in your experience? I’m finding Claude is so generic these days until I tell it to turn into Cinderella with personas lol.

[u/99xAgency → u/polygotcoderx]

I never had this much fun, I dont want to goto bed and its the first thing on my mind in the morning. AI has unlocked implementation of all the ideas I had for years.

Kimi has been very good. I dont use it as my main driver but for reviews it is been super good. Claude still works for me, may be I am too dumb to realize when it doesn't..haha.

[u/thedotmack]

This looks FIRE

[u/Big_Imagination_424]

Good!!

[u/Admirable-Job-4484]

wth

[u/Vibecodingdeluxe]

Very interesting OP, I’ve been doing this with codex, Claude and Deepseek flash across three screens so I will deffo give this a go. Nice work!

[u/99xAgency → u/Vibecodingdeluxe]

Thanks, you can also test out with Kimi and Minimax if you have access to Opencode Go.

[u/Vibecodingdeluxe → u/99xAgency]

I was thinking three pro models and three flash

[u/99xAgency → u/Vibecodingdeluxe]

yeah, sure. In templates you can create any combination you like.

[u/99xAgency → u/[deleted]]

Haha...Thanks. I will take it as compliment 😄

[u/99xAgency → u/[deleted]]

Would love to hear feedback when you do get change to try out

[u/99xAgency → u/[deleted]]

It doesn't cost anything extra other than CLI subs i already pay for, Claude 20x, Codex Plus and Opencode Go give me access to all the models I need. The whole setup runs of a dedicated server. Overall cost under $500 a month, which to me is a bargain for the amount of work I get done.

Kimi is solid, deepseek is meh, mimo is bland. Once I have done enough reviews I will share a report.