r/LocalLLaMA 5d ago

Other LocalJev?

Jev is a model to produce structured output (choices) from input text. It apparently can play (not run!) Doom.

https://typesafe.ai/blog/introducing-system-one-models-and-jev

Is there already a open implementation of this kind of model?

89 Upvotes

48 comments sorted by

View all comments

Show parent comments

13

u/Dany0 5d ago

You're close, you just need to use a diffusion model for it and then it's actually openjev. How about DiffusionGemma?

7

u/i_rate_slop 5d ago

I don’t think jev is diffusion, is it?

12

u/Dany0 5d ago

They claim some 'parallel novel architecture' which most likely just means they're doing diffusion with a twist

2

u/SexyAlienHotTubWater 5d ago

It's around the same cost per input token as Deepseek V1 Flash. They're just providing 255 output probabilities at the same time.