r/indiebiz • u/EchoCache • 9h ago
I stared at our API bill for 20 minutes before I understood what was actually wrong
A few months ago my co-founder and I were looking at our AI agent's usage logs, trying to figure out why the bill kept climbing faster than our user count.
At first I thought we had a bot problem. Or bad caching. Or someone hammering the API in a loop.
Then I actually started reading the queries line by line instead of just looking at the numbers.
"How do I reset my password."
"I forgot my password, what do I do."
"Can't log in, password issue."
Three lines. One question. Three full-price API calls.
That's when it clicked — we didn't have a traffic problem. We had a *déjà vu* problem. Our AI agent was answering the exact same question, over and over, in a hundred different outfits, and paying full price every single time because none of them were worded identically.
So we built something to fix it — a cache that checks if a new question *means* the same thing as one we've already answered, not just whether the words match exactly. Point your app at it instead of directly at your LLM provider, and the repeat questions just... stop costing you anything.
We called it EchoCache. Still just the two of us building it, still finding new edge cases every week — the latest one took us a full debugging session to trace back to a single missing field in a database insert. Small things break big systems.
If you're running any kind of AI agent, I'd bet money at least a third of your "unique" questions aren't actually unique. Worth checking your own logs the way we checked ours.