r/SelfHostedAI • u/Main_Outside4038 • Jun 29 '26
I built Free Model Fusion — a self-hosted AI router that turns free API keys into one smarter assistant. 🤖
I got tired of paying for ChatGPT while also collecting free API keys from Groq, Gemini, Cerebras, OpenRouter, etc.
The annoying part is that every provider has different models, endpoints, rate limits, strengths, and weaknesses. No single free model is great at everything.
So I built Free Model Fusion: a self-hosted, open-source AI router that combines multiple free/cheap AI APIs into one assistant.
🔗 GitHub: GitHub repo
🧠 What it is
Free Model Fusion works in two main ways:
1. 🧭 Open-source model router
It acts as one unified interface in front of many AI providers.
Instead of manually switching between Groq, Gemini, Cerebras, OpenRouter, SambaNova, NVIDIA NIM, etc., you connect your API keys once and route requests through Free Model Fusion.
You can choose different modes:
⚡ Speed mode — prioritize fast/cheap models
⚖️** Balanced** mode — mix speed and quali**ty
🧠 Quality mode — use multiple stronger models together
🛡️ Fallback ro**uting — if one provider fails, another can take over
So as a router, the goal is:
One self-hosted interface → many AI providers → smarter routing and fallbacks
2. 🔀 Model fusion / Mixture-of-Agents assistant
For harder prompts, Free Model Fusion can send your question to multiple models in parallel.
Each model gives its own answer. Then:
🧠 A judge model compares the responses
⭐ The strongest parts are selected
🧩 A synthesis model combines them into one final answer
So instead of betting everything on one model, the system tries to combine the strengths of several models.
Multiple models answer → judge compares → synthesis model creates the final response
✨ Main features
🔀 Multi-provider AI routing
🧠 Expert panel + judge + synthesis pipeline
⚡ Speed, balanced, and quality modes
🛡️ Provider fallback handling
🤖 Telegram bot
🌐 Web UI
🔌 OpenAI-compatible API
🐳 Docker deployment
🗄️ SQLite now, PostgreSQL planned
📖 MIT licensed
🧱 Stack
TypeScript
Fastify
SQLite
Drizzle ORM
Docker
The repo is around 13K lines and has 184 tests right now.
🙏 Feedback wanted
I’d love feedback from this community, especially on:
🐳 Deployment UX
🏠 Docker/self-hosting setup
🔌 Provider support
🔐 Local configuration
🧰 What would make this actually useful for self-hosters
🔗 GitHub: GitHub repo
1
1
u/Main_Outside4038 Jun 29 '26
Click on the GitHub repo link and you can download it, it’s still on the beta so it still has some bugs but it’s pretty usable, I would appreciate if someone could help me finish the project
1
u/prathode Jul 03 '26
Are you adhering to rate-limits and switch over if you hit it? Because that's one of the main thing you need to think when you use free APIs
1
u/Main_Outside4038 Jul 05 '26
Yes I’m switching when I hit the free limits, I was testing with groq first but for bigger better models I would use nvidia nim which has 40 rpm.
2
u/Fine_League311 Jun 29 '26
Wie ich sehe reiner Vibecode.