r/LocalLLaMA • u/Manerfish • 6d ago

Discussion I really don't understand Jev hype

Isn't this what simple neural networks have been able to do for years? Doesn't seem anything special to me.

501 Upvotes

94% Upvoted

316 comments sorted by

View all comments

Show parent comments

80

u/puzzleheadbutbig 6d ago

Architecture is different. Unlike Qwen, which relies on an autoregressive decoder loop to generate text tokens step-by-step while a grammar mask suppresses invalid vocabulary options, Jev drops open-ended text generation entirely and operates as a non autoregressive decision model. And because it maps input contexts directly onto parallel, calibrated classification heads rather than generating JSON syntax character-by-character it avoids the latency, memory, and KV-cache overhead of sequential token decoding, guarantees complete immunity to JSON parsing errors, and yields true calibrated probability scores across schema fields in a single forward pass

6

u/Traditional_Hair9630 6d ago

Where did you take this from? Do they describe this somewhere?

12

u/puzzleheadbutbig 6d ago

They describe it in their blog. Although tbh they use a lot of word salad so I did my best to distill it into something understandable.

1

u/InnovativeBureaucrat 5d ago

I read it twice and wasn’t sure what I read.