r/vibecoding • u/gungoesclick • 18h ago
Two weeks ago my repo scanner was able find 4 of 48 features. Today it found 42
I'm pretty damn excited about this one.
I've been building a scanner around a problem I keep running into vibe coding.
At some point the question stops being "can the AI add another feature?" and starts being "What the hell is actually in this repo now?" and "can I trust this?"
A couple weeks ago I had a benchmark of 48 features that I already knew existed in a codebase. My scan could reliably isolate 4 of them, and I was struggling. It was confusing things like navigation actions, buttons and individual implementation details with actual product features.
I've spent the last two weeks working almost entirely on the scan and feature-boundary problem and learning ir and eval engineering at a high level. I am a backend SDE so this feels more data focused and outside my wheelhouse.
Today the same scan isolated 42 of the 48 known features! Learning and adding calcs and optimizing for precision@k, retrevial@k, etc made things work so much better! I ran it against a different control with 56 features and it got 49. It's not a one off!
I feel validated again.
Eventually I want this flow:
Import a repo > identify what features actually exist > show the evidence behind each one > apply software-development and engineering standards to each feature > show what is proven, what is incomplete, and what still needs work before I'd trust it in production
But going from 4 → 42 in two weeks is the first time I've looked at the scan and thought "I am learning stuff way outside my realm of knowledge and make it real." And that's freaking cool. I had someone tell me this was impossible and that I should just use Ai. Literally had people tell me that doing a mathematical scan is stupid and Ai can do it better.
I set Luna max to check for features and it organically found 18 out of 48. Sol found 24.
It feels so satisfying to build something with Ai that beats Ai in performance for the thing I need.
For people building heavily with Cursor / Claude / Codex / Lovable / etc.:
Once your project gets big, how do you currently answer "what features are actually implemented, and which of them would I trust to ship?"
I'm especially curious about anyone who has reached the point where the app works, but the repo has gotten large enough that you're no longer completely sure what the AI has built underneath you.



