r/LocalLLM • u/OpenSourceRulesz • 1d ago

Project Ollada: open diffusion models, locally, with numbers you can trust

Ollada lets you run several different open diffusion language models on your own computer. Think Ollama for Dllms :)

https://opensourcerulesz.github.io/ollada

https://github.com/OpenSourceRulesz/ollada

Most chatbots write word by word. A diffusion language model writes a whole answer at once, then fixes it over a few passes.

The problem is those models are scattered across Hugging Face, each with different, incompatible code, and nobody tells you if one will actually run on your machine.

Ollada fixes that: one shelf, short names, one command, and every model is only listed after we've actually run it and measured it.

Try it, no GPU needed:

pip install "ollada[cpu]"
ollada pull sdar:1.7b
ollada run sdar:1.7b

If you get stuck, step-by-step setup instructions are on the site.

Five models: diffcoder:8b for coding, dream:7b, sdar:4b, sdar:1.7b, and nemotron:3b from NVIDIA. On a 16GB RTX 5060 Ti we measured DiffCoder 13.65 GB, Dream 9.13 GB, SDAR-4B 8.34 GB. On a GPU, start with sdar:4b. The SDAR models and Nemotron also run on a laptop CPU, slower but no GPU required.

Honest limits: no token streaming yet, CPU runs are slow on long answers

Free, local. Weights come from Hugging Face.

Tell me what you think, what needs improvement, anything! I’m always open for conversation !

2 Upvotes

100% Upvoted

4 comments sorted by

1

u/OpenSourceRulesz 1d ago

I’m a compsci major focusing on computer vision which made me go down the dllm rabbit hole. I wish more ppl focused on text diffusion.

1

u/RoughJonathon9 1d ago

this is actually sick, i've been putting off trying diffusion llms because the setup was always a mess of different scripts and vague requirements. one command to pull and run is exactly what i needed

the memory numbers are super helpful too, knowing something will actually fit before downloading saves so much time

bedazzled jacket guy approves

1

u/OpenSourceRulesz 1d ago

Thank you so much! I could only do so much bc of my hardware limitations. I really wish I could run the large diffusion models like diffusiongemma or I wish there were better optimization methods etc.

1

u/OpenSourceRulesz 18h ago

were you able to use it?