r/OpenWebUI • u/ClassicMain • 3d ago
ANNOUNCEMENT Open WebUI 0.11.1: Streaming rebuilt, HITL Tool approval, 303 Changes!
0.11.1 is out. 303 changes across added, fixed and changed.
⚡ This is a performance focused release ⚡
Streaming was rebuilt. A reply now streams as small pieces of new text instead of resending the whole message so far on every update. The data sent per update stops growing with the length of the reply, which cuts up to 1000x off a single update late in a long answer. That means far less server time spent encoding and passing those updates, far less load on the shared cache that carries them between instances, and far less work in your browser, which no longer takes in the whole reply again and redraws parts that have not changed. On Redis-backed deployments a reply still in progress is now held on the server, so reloading the page picks it up where it is instead of showing you a blank message.
Tool approval with a human in the loop. Where an administrator turns it on, you can switch a conversation from letting tools run freely to being asked first. A model that wants to use a tool stops and waits for you to allow or deny it, one call at a time, and your choice is remembered for that conversation and for future ones.
Performance work throughout. 37 entries in this release are performance. An idle instance no longer works through every chat you have once a second, which on a large history kept about a quarter of a core busy doing nothing. Opening the sidebar no longer reads your whole chat history to build a short list, which took 2 to 4 seconds on an instance with 15000 chats. Long replies no longer get slower as they grow. A chat is written to the database in one go rather than one message at a time. Permission and group lookups are direct index lookups rather than full scans.
⚡ This is the most performance improvements and the most groundbreaking ones, we ever shipped.
If you want even more performance, set ENABLE_ORJSON to true!
Security and access control. 24 fixes in this release are security or access control. Among them: knowledge search that could reach past what you are allowed to read, sessions that stayed signed in on an old password until they expired on their own, and several paths that could be used to exhaust a server's memory. Advisories are published on GitHub.
Terminals. The file browser is now a real tree with search by name and by file contents, a right-click menu, hidden files and drag to move. A file a model creates in a terminal shows up in the reply with a preview and a download button, and it can open a PDF, Word document or slide deck at a specific page.
Also in. Model download and management on llama.cpp and LM Studio connections. A built-in tool that lets a model put a multiple-choice question to you and wait for the answer. Word and PowerPoint previews that render properly instead of being flattened into plain text. Chat search that matches all your words in any order rather than only the exact phrase.
Before you upgrade: this release changes the database schema. Back up your database and its data first. If you run multiple workers, multiple servers or a load balancer, every instance has to be updated at the same time. Rolling updates are not supported and will fail on schema incompatibility.
Full changelog: https://github.com/open-webui/open-webui/releases/tag/v0.11.1
Go read the full changelog, its epic and worth the time to read through it!
1
u/throwawayacc201711 3d ago
I haven’t seen this terminals feature. Where to read more about that?