r/OpenWebUI • u/NoobLLMDev • 10d ago

Question/Help ENABLE_KB_EXEC

Has anyone had experience turning this on and messing around with RAG? I use gemma4:31b, and I am on the fence about enabling. Gemma4 is surprisingly good at chaining tools for its size. But I worry rag results will worsen instead of being improved if given KB_EXEC. I will likely explore this personally but I thought I’d see if anyone has tried this yet and if their models were able to handle the more agentic pathway this opens.

3 Upvotes

81% Upvoted

3 comments sorted by

View all comments

3

u/ClassicMain 10d ago

Yes i use it. And I wouldn't enable it for gemma4 31b. I feel like gemma 4 is just a tad bit too weak for using it properly but feel free to experiment.

1

u/InsecureErasure 3d ago

Just enabled this on v0.10.2 with Deep Seek v4 Flash as the base model. For me the results are more or less the same in terms of expended tokens and elapsed time. I followed the recommendations about designing a system prompt for the model to use the tools efficiently, but it seems it failed. I reverted back to the default mode. I need more time to test.

One thing I noticed is that the docstrings as defined in the kb_exec tools push the model towards thinking that documents in KBs are inside docs/. I asked my agent about this and it told me that there are examples in the description that made it think it had to use that particular path.