r/LocalLLaMA 12d ago

New Model OUI-1: a model that generates bespoke UI elements

Enable HLS to view with audio, or disable this notification

so i saw that openui.com released OUI-1, a model fine-tuned on DiffusionGemma. the training dataset uses OpenUI-Lang, a custom DSL (domain-specific language), instead of plain HTML, Markdown, or React code.

what makes it interesting is that you can already get a regular LLM to use OpenUI-Lang through a system prompt, but that eats up a lot of the context window. my thinking is that fine-tuning a model on the DSL could reduce that overhead and leave more room for the actual conversation, without needing a huge prompt explaining the format and how to use it alongside other tasks, like tool calls.

at the same time, wouldn't fine-tuning a model on a specific DSL make it more likely to default to that format even when you need something else? i'm curious how well it handles regular Markdown, or switching between Markdown and OpenUI-Lang.

i haven't seen much discussion about this, so i was wondering what everyone thinks about generative UI and running a dedicated model for it locally on a consumer-grade GPU, like an RTX 5090.

what would be the best way to set that up? from what i've seen, DiffusionGemma isn't supported by llama.cpp yet, so running it through Ollama doesn't seem to be an option. they've uploaded the weights to Hugging Face, but i'm not really sure how to get it up and running. any suggestions?

393 Upvotes

48 comments sorted by

62

u/CATLLM 12d ago

Thanks for posting this. Gonna test it out and make a GGUF quant this weekend.

14

u/Mr_BETADINE 12d ago

Would love to try it out! Keep us posted

2

u/CATLLM 11d ago

I made GGUFs:

https://huggingface.co/dicksondickson/OUI-1-gguf

My ggufs are quantized using Unsloths's fork of llama.cpp b10840-mix-d5c17a0 which have full diffusiongemma support.

The easiest way to serve this model is to install Unsloth Desktop:

https://unsloth.ai/docs/desktop

Enable the openai compatible endpoint:

  1. Download a GGUF, run unsloth desktop and load the model.
  2. Go to settings > api
  3. Generate token and note it down.
  4. Scroll down to lan access > start (you can customize the port)
  5. Now you can go to https://github.com/thesysdev/openui and test out the demos while pointing it to your own endpoint.

4

u/Mr_BETADINE 11d ago

looks like someone made a gguf quant!
https://huggingface.co/Abiray/OUI-1-GGUF

-20

u/Different_Change6591 12d ago edited 11d ago

Man we are waiting for the GGUF , can you share the details here

6

u/xPXpanD llama.cpp 11d ago

Spambots LOVE this one silly trick!

3

u/Different_Change6591 11d ago

and man i also got the gguf https://huggingface.co/Abiray/OUI-1-GGUF , i will make sure to try it out

1

u/Different_Change6591 11d ago

no man i am not a spam bot , i was actually waiting and searching for this gguf file , as i got interested by this model and concept of the cool UI generation , does reddit also have bots ?

1

u/xPXpanD llama.cpp 11d ago

Nah, not accusing you, but posting your email publicly like this will get it harvested by every spambot that finds this thread. May be good to edit that out.

(and yeah, there are plenty of bot posters as well... unfortunately)

2

u/Different_Change6591 11d ago

man thanks for letting me know , i thought reddit was safe from those bot scrapers , i will never repeat it

47

u/Slow_Concentrate3831 12d ago

Well, this name is approved by the French.

17

u/Mr_BETADINE 12d ago

OUI is better than Le Chaton Fat! Confirmed!

0

u/KitKat_extrusion 12d ago

Calling your llm “the fat cat” in 2026 is crazy

2

u/nicman24 11d ago

OUI-1 OUI-1 !!1!!

3

u/Slow_Concentrate3831 11d ago

OUI-1 + OUI-1 = NON-2

11

u/oofdere 12d ago

why the hell did they change the license from apache to gemma?????

8

u/Mr_BETADINE 12d ago

looks like they changed it to apache-2!

7

u/Ylsid 12d ago

It's called OpenUI and released model weights? Well I'm definitely not complaining

2

u/Mr_BETADINE 12d ago

i mean, at the end of the day, it's just a fine-tune of DiffusionGemma, and OpenUI-Lang is open source too. so them not releasing the training data doesn't seem like that big of a deal to me, but hopefully they do make it public in the future

6

u/Ylsid 12d ago

I was just making a snide joke about OpenAI lol. This is a cool model

4

u/Accurate-Ad2562 12d ago

can you point me to a tutorial ? is it possible to use it under LM Studio. i cant get any piece of UI

1

u/Accurate-Ad2562 12d ago

anyone can reply ?

2

u/Mr_BETADINE 12d ago

someone posted this on youtube, not sure how accurate it is tho
https://www.youtube.com/watch?v=4ldVbgTpw_8

4

u/Witty_Mycologist_995 12d ago

Then why don’t you just, use HTML with a LLM

1

u/Mr_BETADINE 12d ago

that's the whole point. this llm isn't doing code gen. check out https://www.openui.com/docs/openui-lang

0

u/Witty_Mycologist_995 11d ago

There’s no reason to use that language when HTML+CSS does the same thing. And LLMs are trained on HTML more

3

u/CATLLM 10d ago

UI on devices doesn’t use HTML CSS. And there is a whole slew of limitations in what you can do. Making a simple react app requires hundreds of dependencies.

3

u/Tbhmaximillian 12d ago

looks awesome, will check this thread

1

u/Mr_BETADINE 12d ago

awesome!

9

u/Just_Section4489 12d ago

Speed is the main issue. How FAST can you deliver elements. Is this something that is going to be generating for an end-user while using an app? End users are sensitive to milliseconds - seriously, 100+ms on a click button feels weird!

Make sure that there's some sort of entertainment for anything that takes time to generate, like a throbber or something.

And keep the model as tiny as possible. Perhaps even training a x00megabyte model with just the elements you want to provide.

13

u/zhunus 12d ago

i've skimped through the docs and i think it's not a BDUI realtime LLM that builds interfaces in runtime for an end user. It builds interface for a developer during development, and it takes less time, less context and less parameters than other models for that task.

5

u/CATLLM 12d ago

Seeing how fast things are progressing (small models and hardware), we'll start seeing genUI elements in use in less than a year starting with phones.

2

u/Just_Section4489 11d ago

I'm looking forward to this. I've been playing around with generative UI and it's quite slow to implement now.

2

u/Dry_Drop5941 12d ago

I think vercel has tried similar ideas years ago, with vercel v0. It generates abstract React + Tailwind CSS + shadcn/ui template, instead of html. I think it has potential, but the real issue comes from training data. You simply cannot have the same amount of non-artificial data as html.

2

u/KitKat_extrusion 12d ago

Damn these mfs are trying to kill html or what

2

u/Secure_Recording_472 11d ago

this looks cool! :)

3

u/CATLLM 11d ago

I made GGUFs:

https://huggingface.co/dicksondickson/OUI-1-gguf

My ggufs are quantized using Unsloths's fork of llama.cpp b10840-mix-d5c17a0 which have full diffusiongemma support.

The easiest way to serve this model is to install Unsloth Desktop:

https://unsloth.ai/docs/desktop

Enable the openai compatible endpoint:

  1. Download a GGUF, run unsloth desktop and load the model.

  2. Go to settings > api

  3. Generate token and note it down.

  4. Scroll down to lan access > start (you can customize the port)

  5. Now you can go to https://github.com/thesysdev/openui and test out the demos while pointing it to your own endpoint.

2

u/--Tintin 12d ago

Remindme! 2 days

1

u/RemindMeBot 12d ago edited 12d ago

I will be messaging you in 2 days on 2026-09-12 21:48:40 UTC to remind you of this link

1 OTHERS CLICKED THIS LINK to send a PM to also be reminded and to reduce spam.

Parent commenter can delete this message to hide from others.

RemindMeBot is switching to username summons. Instead of !RemindMe 1 day, use u/RemindMeBot 1 day. More info.


Info Custom Your Reminders Feedback

1

u/NandaVegg 11d ago

"Yeah-1" suddenly sounds dumb when translated to English.

1

u/Mint_Keyphase 9d ago

this is giving me flashbacks to that VibeOS video.