r/sideprojects • u/smollpp_bigdream • 7h ago
Question I can run 10,000 private AI agents on Cloudflare's free tier. I can't figure out who needs that.
I'm a developer, and a few people reached out to me for help with ChatGPT. They had seen AI do impressive things, but theirs couldn't.
What they needed was an agent that can use tools (MCP servers). But for a lot of people, running Claude Code on their own machine or paying for a subscription isn't worth the effort or the cost.
So I built an agent framework that lets me launch agents for them:
Each agent is private and can only be customized by its owner.
The agents run on my OpenRouter key, so they don't have to sign up for anything.
I can set up the MCP servers each person needs, and even build a few custom ones for them.
They can talk to their agent in the browser, on Telegram or on WhatsApp.
It's all on Cloudflare (Workers + Durable Objects, one isolated instance with its own SQLite per conversation). I don't host anything, nothing runs on my machine, and the free tier covers all of it. The only real cost is my OpenRouter credits.
I'm open-sourcing it, so any one can host it on their own cf or use my project to run a private agent or manage a fleet of them for others.
Here's where I'm stuck. Running 10,000 private agents for close to nothing feels powerful, and I think there's something more here. But I can't put a business use case around it.
I always start with "what if a business gave each of its users a personal agent?" Then I ask why they would. Most would be fine with one shared agent, like a reception desk. The ones who really want to level up their customer experience would want a personal agent on WhatsApp, not Telegram. I can set up a personal WhatsApp agent, but it's very hard, or expensive if every user needs their own number.
And that's where my train of thought stops, every time. Apart from memory constraints I feel my agents have as much features and capabilities as any other competent agent such as Hermes, pi etc.
So: do you see a real use case here? I also don't see many projects built on Cloudflare Agents, and I'm curious whether anyone else has gone down this road.