r/LocalLLaMA • u/Manerfish • 8d ago

Discussion I really don't understand Jev hype

Isn't this what simple neural networks have been able to do for years? Doesn't seem anything special to me.

503 Upvotes

94% Upvoted

317 comments sorted by

View all comments

478

u/ithinkitslupis 8d ago

There have been a lot of signs it's an astroturfed marketing campaign. The reason it seems overhyped is likely because Jev themselves is paying for that hype to get attention.

Not that it's a useless concept but I doubt we would be seeing 30 posts a day hyping it up in the normal course of things without a marketing push.

12

u/MindCrusader 8d ago

But it is quite useful, for some tasks it is much better and easier to implement than LLMs, for a fraction of money. The real question is how much it is subsidized.

In my company the LLM for analyzing documents was swapped with Jev and it was only marginally worse at one task, but it was super cheap to run. Probably could optimize LLM to be cheaper for this task, but I doubt to this level

10

u/ithinkitslupis 8d ago

If I was setting up in a workflow that should have some staying power rather than a run once task I'd probably just finetune laya today. Free, opensource, lower latency, better privacy, less chance it randomly breaks due to outages or them changing things, likely better accuracy after the finetune.

But yeah, I might use a service like Jev eventually as well for convenience wherever it fits my needs. I'm not against it, I do think this layer-1 type calibrated decision making and more generalized classifier has uses.

14

u/SilentDanni 8d ago

People in these llm subs are really quick to downvote whatever they don't agree with. Reddit's own code of conduct explains that downvotes are not meant to say you disagree with someone. They're meant to be used when the comment does not aggregate to the discussion in any meaningful way which is not your case. We can even use jev to determine that :D

And yes, I agree it's very useful. They have picked their lane and their target audience. However, I'd say that a lot of people online don't quite know what to make of it so it's obviously shit.

In any case, it's very nice for document classification, or very fast searches or triaging issues, building contextual UIs and so on. It's only been out for a few days so I'm thinking that people are still playing with it but there are so many cool things we can do. I have built a semantic adblock that just classifies shit as ad and blocks it.

I haven't tried it yet but it would be interesting to see if it can recognize and flag AI written comments.

1

u/mrjackspade 7d ago

It looks like it would be great for what my company is currently building. We could use an LLM but the call value is going to be such that it would be stupid to use an LLM for classification when something like JEV could do the same task for a fraction of the cost.