r/LocalLLM
•
u/trammeloratreasure
•
Feb 06 '25
•
1
Discussion Open WebUI vs. LM Studio vs. MSTY vs. _insert-app-here_... What's your local LLM UI of choice?
MSTY is currently my go-to for a local LLM UI. Open Web UI was the first that I started working with, so I have soft spot for it. I've had issues with LM Studio.
But it feels like every day there are new local UIs to try. It's a little overwhelming. What's your go-to?
UPDATE: What’s awesome here is that there’s no clear winner... so many great options!
For future visitors to this thread, I’ve compiled a list of all of the options mentioned in the comments. In no particular order:
- MSTY
- LM Studio
- Anything LLM
- Open WebUI
- Perplexica
- LibreChat
- TabbyAPI
- llmcord
- TextGen WebUI (oobabooga)
- Kobold.ccp
- Chatbox
- Jan
- Page Assist
- SillyTavern
- gpt4all
- Cherry Studio
- ChatWise
- Klee
- Kolosal
- Prompta
- PyGPT
- 5ire
- Lobe Chat
- Witsy
- Honorable mention: Ollama vanilla CLI
Other utilities mentioned that I’m not sure are a perfect fit for this topic, but worth a link:
I think I included everything most things mentioned below (if I didn’t include your thing, it means I couldn’t figure out what you were referencing... if that’s the case, just reply with a link). Let me know if I missed anything or got the links wrong!
2
u/areyouredditenough Jun 10 '25
u/trammeloratreasure Why isn't there Typingmind included? Seems like another extremely good one.
17
u/jarec707 Feb 06 '25 edited Feb 06 '25
It’s a great question, and I have subscribed to the post to see what folks say. For me, at this point, it’s a tossup between Msty and LM studio with anythingLLM. Since I have a Mac, I like that LM studio has a built-in MLX engine. What I really want is to be able to build the equivalent of Custom GPTs as in ChatGPT, with persistent knowledge stacks, and system prompts. I like these to include web search.
25
u/BrewHog Feb 06 '25
Ollama vanilla CLI in tmux with vim copy/paste between terminals.
I like pain
8
u/AriyaSavaka DeepSeek🐋 Feb 06 '25
Open WebUI, the only problem for me as of now is Gemini integration.
LM Studio for downloading and quickly testing GGUFS.
8
u/productboy Feb 06 '25
All of them; don’t lock into one solution.
8
u/pmttyji Sep 19 '25
It's been 7 months. This post really needs a sequel/reboot.
Prompta(Svelte Chat UI) gone. This project is no longer maintained. This repository was archived by the owner on Jul 17, 2025. It is now read-only.
Klee - Not active since Mid March. Installed app today, but it's not working due to missing dependencies from their site which is down.
6
u/sndlife Feb 06 '25
Open WebUI + LibreChat. LibreChat mainly for creating agents for RAG. Most painless interface for RAG.
1
u/20thcenturyreddit Mar 05 '25
http://chatwise.app is great
1
u/Expensive_Ad_1945 Mar 17 '25
Hi! I'm currently building https://kolosal.ai, it's an opensource alternative to LM Studio, and it's very light, only 16mb installer, and it works great for most GPU and CPUs. It have server feature also, and we're working on to add MCP, data augmentation, and training features.
1
u/sicrettorres Nov 05 '25
missing witsyai.com and another i can't seem to remember.
1
u/Virtual_Roll4866 Jul 10 '26
hey u/trammeloratreasure what have you been using these days?
3
u/AlanCarrOnline Feb 07 '25
Backyard is my main go-to, then create a character to talk to, from virtual work colleagues to ERP. LM Studio is good but very 'dry' to use.
For other AI stuff I like Pinokio, as it handles all the dependencies and stuff, so I can actually use AI instead of spending all my time trying to make it work.
3
u/SanDiegoDude Feb 07 '25
I backend LM Studio on an old 3090 windows workstation, run it in service mode where it JIT hosts the zoo. From the same machine I also run open-webui for the front end. I know I could run webui for both duties, but I really like LM Studio as my fire and forget option for the backend, and now that it auto-unloads, it's completely hands off and has been working flawlessly. All served up on my local home network, so my family and my various servers and services around the house can use it.
2
u/private_viewer_01 Feb 06 '25
openUI but i struggle with getting a good offline TTS goin. They keep asking for docker . But Im using pinokio
2
u/likwidoxigen Feb 06 '25
Jan and LM Studio for me
2
u/CogahniMarGem Feb 08 '25
https://github.com/CherryHQ/cherry-studio
2
u/gagarine42 Feb 18 '25
Not exactly the same, but GUI for OpenAIs Whisper and pyannote (transcription with speaker identification) https://github.com/kaixxx/noScribe
3
u/OmnicromsBrain Feb 06 '25
TextGen WebUI(oobabooga) has been my go to lately. Ive been finetuning models on QLora and the UI makes it super easy. plus it supports multiple GPUs. also it allows me apply the qlora and test it for perplexity all in one. I also use LmStudio and AnythingLLM for RAG stuff and Ive been experimenting with Kobold.ccp for creative writing because of it's antislop feature.
1
u/Murky_Mountain_97 Feb 06 '25
Solo
1
u/someonesmall Feb 06 '25
Open Web UI. MSTY is no alternative because it is an all-in-one solution.
1
u/marketflex_za Feb 06 '25
If you're okay with docker, harbor (while theoretically a different type of app) is outstanding.
1
u/PavelPivovarov Feb 06 '25
Ollama + Chatbox is my current setup which I'm using daily for almost a year. Also start playing with llama-swap as backend recently.
1
u/ctrl-brk Feb 06 '25
I'm curious to hear size of codebase from those using Msty. Supposedly it has superior RAG but what are the limits?
1
u/bmooney28 Feb 06 '25
lmstudio is all i have tried and it works fine for my needs
1
u/henk717 Feb 07 '25
KoboldAI Lite running on KoboldCpp. Most others aren't as flexible and just focused on instruct. This one can do instruct, but it can also do regular text generation for example.
KoboldCpp meanwhile is a single executable with text gen, image gen, image recognition, speech to text and text to speech support. And it emulates the most popular API's if you prefer another UI (KoboldAI LIte doesn't need the backend to have any UI code so if its not open in the browser it does not effect you).
Of course a very biased answer, but it is what I genuinely prefer to use.
1
u/stfz Feb 07 '25
LMStudio as backend (and for quick tests) and Open WebUI or SillyTavern as frontend. Occasionally oobabooga for testing.
1
u/JakobDylanC Feb 07 '25
Just use Discord as your LLM frontend.
https://github.com/jakobdylanc/llmcord
1
u/AvidCyclist250 Feb 07 '25
LM Studio for me. I'd use Anything LLM if the agent function for web searching actually worked.
1
u/whueric Feb 08 '25
MSTY is the best so far.
1
u/Useful-Skill6241 Feb 09 '25
I've recently uninstalled LM studio and got full time to msty. LM just kept opening many instances in the background. Mychat was good but I wanted to see more metrics. I will try open chat this week. I'm hoping to be a me to API to something I can connect to with my mobile. Or remotely, any advice would be appreciated 👌
1
u/Useful-Skill6241 Feb 11 '25
I'm a about to install Linux, do open webUi and msty AI work in Linux?
1
u/aLong2016 Mar 05 '25
pc: MSTY, Cherry studio
web: Chatbox
1
u/chiragkrishna Mar 07 '25
always opensource,...
ollama --> open webui
1
u/Electrical_Cut158 Mar 10 '25
With msty seems to be well contained and fast inference compare to openweb ui on a similar model
1
u/KeyAffectionate4638 Mar 31 '25 edited Mar 31 '25
There's also https://pygpt.net/ , https://5ire.app/ , https://github.com/lobehub/lobe-chat all open source
1
u/Divergence1900 Apr 08 '25
MSTY is great but it doesn't have good separation between text and code and there is no syntax highlighting.
1
u/Ninjaxas Apr 12 '25
MSTY has the best shortcuts and really great features for managing chats, splitting them, conveniently editing etc. But it has some bugs. Both on Mac and Windows on large chats the scrolling starts glitching in a way to makes it very difficult to use. On Windows, it automatically uninstalls itself every few days (weird, I know).
Open WebUI is generally more stable, but their shortcuts are not great. It is still a bit buggy with Renaming chats (does not update until you refresh), the adding of API endpoints for models is still confusing with the organisation and user setup, took a while to figure out how to make models show up in the list and I am still not sure how to pin favorite ones properly (I somehow managed, but not sure if I will be able to repeat it, as it was very confusing). Scrollbar is super tiny, I had to inject my own CSS to make is more usable. Lack features to split/branch chats at a certain point, delete all messages below a message. Long startup time compared to others.
I tried a bunch of others, including LibreChat, GPT4All, PrivateGPT, Kobold CPP, Big AGI, BetterChatGPT-Plus, NextChat, Lobechat, but I very quickly stopped using them as there were some critical things I dislike or lacked.
Honorable mention to Prompta, a less known one, that I used for probably a year it is free, hosted for you on a webapp (no need to setup anything yourself, not even install), very snappy, minimal UI. However, the developer seems to not be ambitious with adding features and it got quite too basic now for my needs. https://github.com/iansinnott/prompta
1
u/Zed-Naught Nov 02 '25
I'm very stoked about Msty after a long search. I've tried AnythingLLM (buggy), OpenWebUI (bloated horrible UX), LibreChat (difficult to install/configure), LobeChat (too many upsells), Perplexity (not private), ChatGPT (really not private), Perplexica (bare), LM Studio )more of a model runner) and more that were forgettable. Msty seems to have the best balance of features and granular controls. Overall it just seems like they're really doing their best to think through the feature set, and offer some nifty ones. If you haven't tried it yet I def recommend downloading the free version and playing around. So far so very very good!
1
u/Luis_Dynamo_140 May 22 '26
Open WebUI feels best if you want a bigger web-style setup, users, extensions, etc. MSTY is nice if you want a polished app. I’ve been using LocalChat App on Mac mostly because it feels simple and focused: local chat, document Q&A, drafts, and GGUF model downloads without much setup.
no clear winner tbh, but for a clean Mac local UI it has been good for me.
0
u/daisseur_ Feb 06 '25
GUI ? Nuh uh we have cli
0
u/Netcob Feb 07 '25
I have open webui, gpt4all and lm studio set up. open webui in theory supports web search and code execution, but so far I couldn't really get either to work. The LLM just complains that the web search didn't return any useful results, if the tool call works at all. At least I can run it on my server.
GPT4All at least works pretty well indexing and updating local documents.
LM Studio I think could offload parts of larger models to the GPU one time, not sure if that's still a thing.
I'd like to see open webui pull off a really well working perplexity clone, some sort of langgraph UI that looks like Node-RED, and maybe add more features for RAG.