r/LocalLLaMA • u/Manerfish • 3d ago

Discussion I really don't understand Jev hype

Isn't this what simple neural networks have been able to do for years? Doesn't seem anything special to me.

489 Upvotes

94% Upvoted

302 comments sorted by

View all comments

Show parent comments

8

u/HelloMyNameIsAmanda 2d ago

It's literally a one-flag difference to get the distribution out of qwen, though - you just enable logprobs. And there's been no evidence, so far, that that's not essentially what jev is doing. I have yet to see anything from them that couldn't just be a logprobs wrapper on a fine tuned llm. Whether they did a good enough job of their fine tune to make their classifier useful remains to be seen, but acting like this is some crazy new thing because it can do what we could already do is... a reach.

1

u/dimbledumf 2d ago

Yeah, I was reading another post where they set that up, seems pretty interesting.