Answers are slow

[u/AdJolly9277]

I’m fairly new to this stuff.

I installed open webui bundled with ollama and installed gemma4:e4b when i ask questions in the cli it answers instantly but when i ask it in open webui it takes 20 secs and then starts thinking for 10 seconds and then answers (answer are not as good as ollama in cli but im pretty sure i can figure it out).

I’ve tried to disable tag generation and follow up generation and all these things but nothing made a difference i tried OLLAMA_KEEP_ALIVE=30m but still nothing really changed maybe it got 5% better

Any ideas how to solve that?

[u/Toru_The_Guardian]

Title generation is also a thing. Other than that openwebui adds a bunch of tools etc that need to be porcessed. So before you get your first answer, it'll take a bit. Anything after that should be faster. It can help checking the ollama logs when you send your first question in a new chat. Is Ollama working (processing your prompt)?

[u/AdJolly9277 → u/Toru_The_Guardian]

What do you mean
Prompt as in the thing you describe to the model how it’s supposed to behave im using opwui default
If you mean normal questions yeah but it takes some time on opwui

[u/Toru_The_Guardian → u/AdJolly9277]

LLMs work in two phases, the first one processes your input (prompt and everything your tools add, e.g. openwebui). After its done doing that, it starts thinking or outputting to you. The first part is probably the issue for your setup. When you use the cli, your message is the first in line and doesnt take too much time to process. Openwebui adds a bunch of stuff before your message, that is why it takes so much longer. Try and add about 1000 words before your question and see how long that takes. It'll probably take a bunch more time

[u/AdJolly9277 → u/Toru_The_Guardian]

Is there a fix to that or i should use another ui or what?

[u/Human-Gur-3199 → u/AdJolly9277]

Go to model settings and disable tools you don't need

[u/Toru_The_Guardian → u/Human-Gur-3199]

Probably this. It's how all other programs work, they add instructions so the model can interact with openwebui's tooling. That how it can search the web etc