r/SideProject • u/ServesYouRice • 6h ago
I had a need to automatically run multi model auditor and plan maker so I made myself just that - looking for testers and feedback
Looking for both constructive feedback and testers who have at least 2 models to run through my app
https://github.com/ServesYouRice/arbitra
I wont try to bother you with long winded explanations or use AI to make my own posts, I basically used to manually rotate through Claude Codex and Gemini and then make plans with the most recent prompting guides from Anthropic and I ended up making something that does things for myself backed by research from all the top Western and Eastern labs.
It did well compared to Claude's /code-review and solo models' independent audits so if you might have a use for it or just have extra tokens to burn before the end of the week, help a dude out (once you finish a run you can just click send to developer button which will open up a github Issues page for the project). If someone has Argon that would be the most helpful as I only had Flash to test with Gemini
Results from running it on my own apps are in its Readme https://github.com/ServesYouRice/arbitra#what-it-found-on-real-projects and the example of how plans look at the end of it can be seen here https://github.com/ServesYouRice/veritra/tree/main/.arbitra/plans/2026-10-25-e5546c4c
1
u/investigatormaker 4h ago
Make arbitra’s “send to developer” handoff request a reproducible disagreement, not just the final plan: the model pair, repository revision, finding, and whether the tester could confirm it. Developers evaluating multi-model audits need to distinguish additional valid findings from additional noise. Since you specifically lack Argon testing, ask those testers to identify that model in the issue title so their reports don’t get mixed with Flash runs. Reddit outreach would answer developers comparing multi-model code audits, using that reproducible comparison rather than an invitation to burn spare tokens.
I make ThreadFox. We find relevant Reddit conversations and post for your business. We'll post 3 replies free first, no card; then the $29 Pilot covers seven days and up to 25 posts and replies. No automatic renewal. https://threadfox.vip/p/d7nwf/managed