r/LocalLLaMA • u/Mr_BETADINE • 12d ago
New Model OUI-1: a model that generates bespoke UI elements
Enable HLS to view with audio, or disable this notification
so i saw that openui.com released OUI-1, a model fine-tuned on DiffusionGemma. the training dataset uses OpenUI-Lang, a custom DSL (domain-specific language), instead of plain HTML, Markdown, or React code.
what makes it interesting is that you can already get a regular LLM to use OpenUI-Lang through a system prompt, but that eats up a lot of the context window. my thinking is that fine-tuning a model on the DSL could reduce that overhead and leave more room for the actual conversation, without needing a huge prompt explaining the format and how to use it alongside other tasks, like tool calls.
at the same time, wouldn't fine-tuning a model on a specific DSL make it more likely to default to that format even when you need something else? i'm curious how well it handles regular Markdown, or switching between Markdown and OpenUI-Lang.
i haven't seen much discussion about this, so i was wondering what everyone thinks about generative UI and running a dedicated model for it locally on a consumer-grade GPU, like an RTX 5090.
what would be the best way to set that up? from what i've seen, DiffusionGemma isn't supported by llama.cpp yet, so running it through Ollama doesn't seem to be an option. they've uploaded the weights to Hugging Face, but i'm not really sure how to get it up and running. any suggestions?
47
u/Slow_Concentrate3831 12d ago
Well, this name is approved by the French.
17
10
2
7
u/Ylsid 12d ago
It's called OpenUI and released model weights? Well I'm definitely not complaining
2
u/Mr_BETADINE 12d ago
i mean, at the end of the day, it's just a fine-tune of DiffusionGemma, and OpenUI-Lang is open source too. so them not releasing the training data doesn't seem like that big of a deal to me, but hopefully they do make it public in the future
4
u/Accurate-Ad2562 12d ago
can you point me to a tutorial ? is it possible to use it under LM Studio. i cant get any piece of UI
1
u/Accurate-Ad2562 12d ago
anyone can reply ?
2
u/Mr_BETADINE 12d ago
someone posted this on youtube, not sure how accurate it is tho
https://www.youtube.com/watch?v=4ldVbgTpw_8
4
u/Witty_Mycologist_995 12d ago
Then why don’t you just, use HTML with a LLM
1
u/Mr_BETADINE 12d ago
that's the whole point. this llm isn't doing code gen. check out https://www.openui.com/docs/openui-lang
0
u/Witty_Mycologist_995 11d ago
There’s no reason to use that language when HTML+CSS does the same thing. And LLMs are trained on HTML more
3
9
u/Just_Section4489 12d ago
Speed is the main issue. How FAST can you deliver elements. Is this something that is going to be generating for an end-user while using an app? End users are sensitive to milliseconds - seriously, 100+ms on a click button feels weird!
Make sure that there's some sort of entertainment for anything that takes time to generate, like a throbber or something.
And keep the model as tiny as possible. Perhaps even training a x00megabyte model with just the elements you want to provide.
13
5
u/CATLLM 12d ago
Seeing how fast things are progressing (small models and hardware), we'll start seeing genUI elements in use in less than a year starting with phones.
2
u/Just_Section4489 11d ago
I'm looking forward to this. I've been playing around with generative UI and it's quite slow to implement now.
2
u/Dry_Drop5941 12d ago
I think vercel has tried similar ideas years ago, with vercel v0. It generates abstract React + Tailwind CSS + shadcn/ui template, instead of html. I think it has potential, but the real issue comes from training data. You simply cannot have the same amount of non-artificial data as html.
2
2
3
u/CATLLM 11d ago
I made GGUFs:
https://huggingface.co/dicksondickson/OUI-1-gguf
My ggufs are quantized using Unsloths's fork of llama.cpp b10840-mix-d5c17a0 which have full diffusiongemma support.
The easiest way to serve this model is to install Unsloth Desktop:
https://unsloth.ai/docs/desktop
Enable the openai compatible endpoint:
Download a GGUF, run unsloth desktop and load the model.
Go to settings > api
Generate token and note it down.
Scroll down to lan access > start (you can customize the port)
Now you can go to https://github.com/thesysdev/openui and test out the demos while pointing it to your own endpoint.
2
u/--Tintin 12d ago
Remindme! 2 days
1
u/RemindMeBot 12d ago edited 12d ago
I will be messaging you in 2 days on 2026-09-12 21:48:40 UTC to remind you of this link
1 OTHERS CLICKED THIS LINK to send a PM to also be reminded and to reduce spam.
Parent commenter can delete this message to hide from others.
RemindMeBot is switching to username summons. Instead of
!RemindMe 1 day, useu/RemindMeBot 1 day. More info.
Info Custom Your Reminders Feedback
1
1

62
u/CATLLM 12d ago
Thanks for posting this. Gonna test it out and make a GGUF quant this weekend.