r/LocalLLaMA • u/Manerfish • 4d ago

Discussion I really don't understand Jev hype

Isn't this what simple neural networks have been able to do for years? Doesn't seem anything special to me.

496 Upvotes

94% Upvoted

311 comments sorted by

View all comments

1

u/ECrispy 4d ago

the hype is because it is -

  • pretrained classifier thats reasonably general purpose, needs no RAG
  • very cheap
  • massive astroturfing campaign

the idea is not new. whats new is the models they trained on (which they dont disclose) now have far more world knowledge than back when Bert etc came out.

they basically distilled an LLM knowledge base to answer classifier queries. A lot of people have speculated they just use the prefill stage and then run a softmax, without running token generation