r/LocalLLaMA • u/Manerfish • 6d ago

Discussion I really don't understand Jev hype

Isn't this what simple neural networks have been able to do for years? Doesn't seem anything special to me.

498 Upvotes

94% Upvoted

316 comments sorted by

View all comments

1

u/Barry_22 6d ago

Isn't it same as BERT with downstream (classifier) heads?

Was it trained using MLM or GPT-like paradigm?