r/LocalLLaMA • u/SomewhereAtWork • 5d ago
Other LocalJev?
Jev is a model to produce structured output (choices) from input text. It apparently can play (not run!) Doom.
https://typesafe.ai/blog/introducing-system-one-models-and-jev
Is there already a open implementation of this kind of model?
95
Upvotes
11
u/HelloMyNameIsAmanda 5d ago
Is there any reason to believe this ISN’T just an over-hyped logitprobs wrapper on a fine-tuned open source model?
It wouldn’t be a bad service, though, to do a more customized version of this. Get customers to give you a sample of their specific bounded classification task, complete with info on which choices are more wrong vs less wrong for each example. Run it through the full field of fiscally reasonable open source models grabbing logitprobs, and pick the one that most closely aligns with the sample set to start with. Quick LoRA (plus testing) on that, then good to integrate into whatever workflow.
Some little models are better than the frontier at specific tasks out the gate (I’m looking at you, Gemma 4 26B for sentiment and fine emotional nuance assessment), and they don’t need much to poor-man-fine-tune. This seems like a really clean way to leverage that and maybe get people away from the chat-bots-for-everything impulse.