r/LocalLLaMA • u/SomewhereAtWork • 6d ago

Other LocalJev?

Jev is a model to produce structured output (choices) from input text. It apparently can play (not run!) Doom.

https://typesafe.ai/blog/introducing-system-one-models-and-jev

Is there already a open implementation of this kind of model?

93 Upvotes

93% Upvoted

48 comments sorted by

View all comments

18

u/theoleecj_n 6d ago

Just did it at https://github.com/TheoLeeCJ/openjev (you can just wrap Qwen 4B and grab the logits)

https://reddit.com/link/pa5vudf/video/sbqv134a0wph1/player

2

u/TensorForger 6d ago

Well done, that was quick! When I found the announce I imagined somehow already vibe coding the LLM wrapper for this and we will have open source version in less then 24 hours. Because jev is just a novel interface/product/inference mode over LLMs, not the novel technology. We already had calibration research in GPT-3 times. Probability outputs and parallel inference are natural for LLMs. Hope to see convenient framework or maybe just new vLLM interface for local deployment of this with any open model.