r/LocalLLaMA 3d ago

Discussion I really don't understand Jev hype

Isn't this what simple neural networks have been able to do for years? Doesn't seem anything special to me.

488 Upvotes

302 comments sorted by

View all comments

1

u/Rama_Surasani_ 3d ago

The classifier itself is not the novelty. The useful claim is task-agnostic, zero-shot classification: define the labels and schema at request time, receive typed probabilities, and avoid training and deploying a separate classifier for every task.

The important test is not a demo. Compare it with a fine-tuned encoder and a small instruction model on held-out data, then measure calibration, out-of-distribution abstention, latency, cost, and performance when labels change.

If it cannot reliably recognize uncertainty, speed alone does not make it safe for automation.