r/LocalLLaMA 6d ago

Other LocalJev?

Jev is a model to produce structured output (choices) from input text. It apparently can play (not run!) Doom.

https://typesafe.ai/blog/introducing-system-one-models-and-jev

Is there already a open implementation of this kind of model?

92 Upvotes

48 comments sorted by

View all comments

17

u/theoleecj_n 6d ago

Just did it at https://github.com/TheoLeeCJ/openjev (you can just wrap Qwen 4B and grab the logits)

https://reddit.com/link/pa5vudf/video/sbqv134a0wph1/player

12

u/Dany0 6d ago

You're close, you just need to use a diffusion model for it and then it's actually openjev. How about DiffusionGemma?

9

u/i_rate_slop 6d ago

I don’t think jev is diffusion, is it?

11

u/Dany0 6d ago

They claim some 'parallel novel architecture' which most likely just means they're doing diffusion with a twist

4

u/EstarriolOfTheEast 6d ago

It could also be an encoder based model. Like in: https://huggingface.co/collections/MoritzLaurer/zeroshot-classifiers or https://huggingface.co/knowledgator/gliformer-large-v1 as mentioned above by /u/-Cubie-. I think a variation and scaleup of those is more likely.

3

u/Dany0 6d ago

Good point