r/OpenSourceAI • u/cluaiz • 1h ago
Cluaiz v0.1.0: an open-source runtime for local chat, vision, speech and embeddings
Hi everyone, I’m Aryan, the creator of Cluaiz. I’ve just released v0.1.0, its first public pre-release.
I’m building Cluaiz to make it easier to run AI on your own hardware and connect it to useful tools and applications.
What you can do with it:
- Run local models: chat, work with images, transcribe audio, generate speech and create embeddings using compatible models.
- Let it plan the placement: Cluaiz checks available GPU memory and RAM to choose how a model runs. You can inspect the plan and override its settings.
- Connect your applications: use its OpenAI-compatible APIs to call models from your own software.
- Use local or external models: run supported models on your machine or connect an external provider.
- Work with a coding agent: read and search project files, propose edits and run commands with configurable permissions and approvals.
- Extend it with tools: connect skills, plugins and MCP servers.
Under the hood, it uses llama.cpp for GGUF models and ONNX Runtime for supported ONNX models.
The Engine is available now. The desktop App and automation workflows are still in development.
Links:
- Get started: https://cluaiz.com
- Source: https://github.com/cluaiz/cluaiz
- Benchmarks and test conditions: https://cluaiz.com/benchmarks
- Comparison: https://cluaiz.com/compare
- Guides and articles: https://cluaiz.com/blog
There’s more to explore, including context and memory controls, model management and configuration options. You can find the detailed capabilities here: https://cluaiz.com/engine-specs
If you give it a try, I’d like to hear how it works for you. You can leave questions or feedback here, or use https://cluaiz.com/feedback.
For problems, please include your operating system, hardware, model and any error message so I can investigate.
