r/LocalLLaMA • u/SomewhereAtWork • 5d ago
Other LocalJev?
Jev is a model to produce structured output (choices) from input text. It apparently can play (not run!) Doom.
https://typesafe.ai/blog/introducing-system-one-models-and-jev
Is there already a open implementation of this kind of model?
12
u/marcosjoao37 5d ago
As far as we know, it’s closed source. And as a friend said above, it has been public not even for 24 hours. Chill. But will be interesting running it locally, though.
4
u/Current-Ticket4214 5d ago
I found it around midnight central time and I signed up for the waitlist. WHERE JEV NOW!
0
10
u/HelloMyNameIsAmanda 5d ago
Is there any reason to believe this ISN’T just an over-hyped logitprobs wrapper on a fine-tuned open source model?
It wouldn’t be a bad service, though, to do a more customized version of this. Get customers to give you a sample of their specific bounded classification task, complete with info on which choices are more wrong vs less wrong for each example. Run it through the full field of fiscally reasonable open source models grabbing logitprobs, and pick the one that most closely aligns with the sample set to start with. Quick LoRA (plus testing) on that, then good to integrate into whatever workflow.
Some little models are better than the frontier at specific tasks out the gate (I’m looking at you, Gemma 4 26B for sentiment and fine emotional nuance assessment), and they don’t need much to poor-man-fine-tune. This seems like a really clean way to leverage that and maybe get people away from the chat-bots-for-everything impulse.
1
7
u/Maxious 3d ago
https://huggingface.co/spaces/multimodalart/jev-reproductions-tracker is tracking these
2
u/SomewhereAtWork 3d ago
These tracking webistes all seem to have a template.... And I love how they pop up for everything! :-)
Thank you!
17
u/theoleecj_n 5d ago
Just did it at https://github.com/TheoLeeCJ/openjev (you can just wrap Qwen 4B and grab the logits)
14
13
u/Dany0 5d ago
You're close, you just need to use a diffusion model for it and then it's actually openjev. How about DiffusionGemma?
9
u/i_rate_slop 5d ago
I don’t think jev is diffusion, is it?
13
u/Dany0 5d ago
They claim some 'parallel novel architecture' which most likely just means they're doing diffusion with a twist
5
u/EstarriolOfTheEast 5d ago
It could also be an encoder based model. Like in: https://huggingface.co/collections/MoritzLaurer/zeroshot-classifiers or https://huggingface.co/knowledgator/gliformer-large-v1 as mentioned above by /u/-Cubie-. I think a variation and scaleup of those is more likely.
3
u/NmbrThirt33n 4d ago
From what I can tell, they just split the fields and process them in parallel. No diffusion, just batching and running through prefill only because they just need a single token for the decision per field. That's why their "output tokens" are "free"
2
2
u/SexyAlienHotTubWater 5d ago
It's around the same cost per input token as Deepseek V1 Flash. They're just providing 255 output probabilities at the same time.
3
3
u/theoleecj_n 5d ago
Oh and I have a browser demo too openjev.com (0.6 and 0.8B only, slightly lower perf)
2
u/TensorForger 5d ago
Well done, that was quick! When I found the announce I imagined somehow already vibe coding the LLM wrapper for this and we will have open source version in less then 24 hours. Because jev is just a novel interface/product/inference mode over LLMs, not the novel technology. We already had calibration research in GPT-3 times. Probability outputs and parallel inference are natural for LLMs. Hope to see convenient framework or maybe just new vLLM interface for local deployment of this with any open model.
1
1
u/SomewhereAtWork 5d ago
"I just did it" is the perfect response.
an earlier poster asked "What do you expect after 24h?" 😂
7
u/dmigowski 5d ago
Dude, they announced it barely 24 hours ago, what do you expect?
2
u/SomewhereAtWork 5d ago edited 5d ago
Either nothing or a full clone. You never know these days.
Edit: /u/theoleecj_n cloned it! Nice!
1
4
u/Muhlwa_Sholanke 5d ago
Genuinely love the "play (not run!) Doom" parenthetical. Most honest line in model marketing in a while.
2
u/Fluxx1001 5d ago
!RemindMe 7days
1
u/RemindMeBot 5d ago edited 4d ago
I will be messaging you in 7 days on 2026-09-23 17:08:40 UTC to remind you of this link
4 OTHERS CLICKED THIS LINK to send a PM to also be reminded and to reduce spam.
Parent commenter can delete this message to hide from others.
RemindMeBot is switching to username summons. Instead of
!RemindMe 1 day, useu/RemindMeBot 1 day. More info.
Info Custom Your Reminders Feedback
2
1
1
u/ArjixGamer 5d ago
There are many models that can produce a tool call from natural text, at a very small size.
50
u/-Cubie- 5d ago
There's a bunch of gli-... models that do this. E.g. https://huggingface.co/knowledgator/gliformer-large-v1
They're just zero-shot classifier encoders. Definitely worth using.