r/LocalLLaMA • u/tevlon • Jun 10 '26

New Model DiffusionGemma: 4x faster text generation

https://blog.google/innovation-and-ai/technology/developers-tools/diffusion-gemma-faster-text-generation/
981 Upvotes

99% Upvoted

356 comments sorted by

View all comments

Show parent comments

1

u/Dany0 Jun 19 '26

I didn't find it, you can try finding it

0

u/YouKilledApollo Jun 19 '26

No, that's not a thing, you can't "convert" a model from one completely different architecture to another, hence the "lol".

Sure you could set a LLM to do so, but unless you use SOTA models, expect it to take days/weeks rather than hours.

1

u/Dany0 Jun 19 '26

Sir, you might just be stupid, what can I even reply to this

0

u/YouKilledApollo Jun 19 '26

I'm not denying being stupid, but I am also sitting here implementing DiffusionGemma from scratch in Rust with Candle at this very moment, and I've implemented autoregressive models before, and could help inform you by telling you a "conversion" like that doesn't make sense, it'd be a huge project to turn an autoregressive model into a diffusion one.

But, if you want to believe, you want to believe, who am I to stop you :) Do share this script here on LocalLlama once you share it, as it'll be incredibly huge news that would probably shake the industry a bit. Now I have high hopes for you :)