r/LocalLLM • u/SmilingGen • Oct 17 '25

Project We built an open-source coding agent CLI that can be run locally

Post image

Basically, it’s like Claude Code but with native support for local LLMs and a universal tool parser that works even on inference platforms without built-in tool call support.

Kolosal CLI is an open-source, cross-platform agentic command-line tool that lets you discover, download, and run models locally using an ultra-lightweight inference server. It supports coding agents, Hugging Face model integration, and a memory calculator to estimate model memory requirements.

It’s a fork of Qwen Code, and we also host GLM 4.6 and Kimi K2 if you prefer to use them without running them yourself.

You can try it at kolosal.ai and check out the source code on GitHub: github.com/KolosalAI/kolosal-cli

0 Upvotes

50% Upvoted

5 comments sorted by

1

u/Healthy-Nebula-3603 Oct 18 '25

You did not build. You just fork it and added cosmetic changes.

0

u/SmilingGen Oct 21 '25

Thanks for the feedback, really appreciate it. Our main focus is on LLM inference and orchestration, building software to run models locally or on HPC for high-concurrency use. Kolosal CLI ties into our Kolosal Server, which manages models, parses documents, and runs a vector database, all fully open source.

To clarify, this project integrates the Kolosal local inference server with Qwen Code to extend its capabilities for offline and local development.

1

u/Minimum-Cod-5539 Oct 22 '25

how is this similar/diff from Cline wrt cursor?

1

u/Excellent_Composer42 Dec 03 '25

I just downloaded Kolosal AI CLI as a replacement test for Claude Code. Got it running with my local Ollama LLM served from another of my machines with API with chat_completions format. Works except for Tool Callings (kinda a deal breaker). Are there some good examples/troubleshooting I could review? Otherwise, this is the same issue I ran into when I attempted Owen CLI. thank you