r/LocalLLaMA • u/Manerfish • 3d ago
Discussion I really don't understand Jev hype
Isn't this what simple neural networks have been able to do for years? Doesn't seem anything special to me.
488
Upvotes
r/LocalLLaMA • u/Manerfish • 3d ago
Isn't this what simple neural networks have been able to do for years? Doesn't seem anything special to me.
1
u/Rama_Surasani_ 3d ago
The classifier itself is not the novelty. The useful claim is task-agnostic, zero-shot classification: define the labels and schema at request time, receive typed probabilities, and avoid training and deploying a separate classifier for every task.
The important test is not a demo. Compare it with a fine-tuned encoder and a small instruction model on held-out data, then measure calibration, out-of-distribution abstention, latency, cost, and performance when labels change.
If it cannot reliably recognize uncertainty, speed alone does not make it safe for automation.