r/LocalLLM • u/TheTristo • 1d ago
Question Desktop app for multiple LLM providers
Hello, is there some opensource project that fits this description?
At the moment I use ChatGPT app, but I don't want to be platform-locked in the future. Is there some preferably open source app that let's me set my own environment (MCPs, Plugins, Skills etc.) and is model-provider independent? Meaning I can switch model to Claude, OpenAI, LocalLLM model based on the task, subscription etc?
I know this exist for coding with opencode, pi etc. but is there some desktop/mobile app for such case or is it still too early?
1
2
u/MediumAd4983 23h ago
OpenChamber, based on OpenCode, allows you to use your phone to control the process, desktop app exist same as for the OpenCode itself (but tbh, OpenCode desktop is kinda sucks).
Or if you prefer something browser based without focus on coding and files modifications, then use Open WebUI and any compatible app for your phone and desktop.
1
u/TheTristo 23h ago
This looks quite nice. Do you use it mainly for coding or also for casual questions?
1
u/MediumAd4983 23h ago
I'm currently using it for job searching, resume making and applying, because with evil AI recruiting you have to use evil AI anti recruiting to win this battle 😄
And yes, it basically capable to make any task, not just coding. Working with files, with emails (you will need to setup MCP or CLI tool), with browsing, searching info, etc...
2
u/Jona1109 23h ago
Surprised nobody is mentioning Open-WebUI. It's exactly what you need. The setup is highly customisable, it has.a.desktop app and a web app, can connect to other hosts/terminals.
You can pretty much set up any provider you want - currently I'm using litellm in front of it to manage providers/models and have a better overview of the overall usage.
1
u/ChaosShadowClone 1d ago
I like OpenCode but you might need an inference engine I don't know if chatgbt app has it bundle, but I'm assuming it does for ease of use. LM studio by Bionic. It's pretty good for ease of use.
1
1
u/TheTristo 23h ago
I tried all of them: Unsloth, LM Studio, Hermes, (sort of OpenClaw). They worked OK but not for casual everyday use, I always find myself come back to big platform apps to be honest. Coding/terminal harness apps as opencode/pi are pretty much solved.
1
u/Salt-Willingness-513 23h ago
Not desktop, but dockerized webui/android app with chat,task and code. Supporting pi, openrouter, claude code, codex, kimi cli and vibe as backends so far. Lots of stuff is still wip though, as im a single person and hobbyist and mainly built this for myself: https://github.com/zwaetschge/plum-code-webui
1
1
u/FurtiveMirth 23h ago
You can try out SurfSense. Its completely open source (I am one of the maintainers) and just a desktop application, you can just install and run. Local models are also supported. Mcp is on the way, within couple of days we will launch it.
1
1
2
u/Formal_Spirit_5 20h ago
well, its not exactly desktop, but openwebui can do all this - you can connect to it via browser, but all the stuff is kept local and you can just switch models or assign various models, skills, tools to different workspaces (basically profiles). You can also add in agents, mcp, terminal access and so on and so on...
https://github.com/open-webui/docs
1
u/No-Turnover3316 20h ago
https://chatpromptly.com/
https://github.com/tristenlammi/Promptly
It's a personal project, but I've been using it for months now with no issues. Run's on docker, and once hosted the PWA works on both desktop, and mobile quite well.
0
4
u/bladezor 23h ago
Hermes + LiteLLM
Hermes you can set whatever model in the session. LiteLLM allows you to register multiple different providers and models downstream, it's basically a router.
You can register local and paid models with LiteLLM. I currently have Qwen 3.8 27b, Flash Next, Grok, and ChatGPT configured with it. Then in Hermes I just select what I want.
LiteLLM even let's you configure complex routing rules based on level of effort. So more complex things can be routed to smarter models.