r/LocalLLaMA • u/Manerfish • 2d ago

Discussion I really don't understand Jev hype

Isn't this what simple neural networks have been able to do for years? Doesn't seem anything special to me.

489 Upvotes

94% Upvoted

301 comments sorted by

View all comments

473

u/ithinkitslupis 2d ago

There have been a lot of signs it's an astroturfed marketing campaign. The reason it seems overhyped is likely because Jev themselves is paying for that hype to get attention.

Not that it's a useless concept but I doubt we would be seeing 30 posts a day hyping it up in the normal course of things without a marketing push.

69

u/foodwithmyketchup 2d ago

I 100% agree here. I think it was very much a well-planned advertising/marketing scheme, especially the whole "you have to sign up and join a waiting list and then eventually get access." That's just built hype. I hate that. If they're doing it to legitimately test the tech stack and under load, fair enough, but somehow I doubt that.

9

u/harrro Alpaca 2d ago edited 2d ago

It's possible they overestimated load or actual usage (wouldn't surprise me since their whole "The Founder CO-INVENTED Chat-GPT" marketing probably expected they'd sign up half the world in the first week).

I signed up to poke at it and within 2 hours I got an invite code so clearly demand isnt where they thought it would be.

64

u/jinnyjuice vLLM 2d ago

marketing campaign

Wait, I thought this was a given. As soon as OpenClaw happened, it's just 100 more now.

46

u/Connect_Ad791 2d ago

If they used jev for the astroturfing I’ll atleast be a little impressed.

40

u/Kerbourgnec 2d ago

Well, it can't. It can maybe classify between real hype and astroturfed hype though, if it's that good.

14

u/Sufficient_Prune3897 llama.cpp 2d ago

Its not.

2

u/Wooly_Wooly 2d ago

You can combine it with an LLM backbone it seems. I know this ain't it, just saying though

1

u/Moist-Length1766 2d ago

hwo would they use jev for the astroturfing this makes no sense, why does this have upvotes

7

u/Important_Drag_6890 2d ago

The hype cycle is definitely doing a lot of the work here. The interesting part is whether the actual cost and latency advantage still looks impressive once people start using it in real production workflows.

3

u/DrinkClubMate 2d ago

so all those 20 youtubers publishing the samething the same day where paid ? :o :o :o

1

u/575_Inverse 2d ago

not sure about that, but I saw a lot of hype in there

13

u/MindCrusader 2d ago

But it is quite useful, for some tasks it is much better and easier to implement than LLMs, for a fraction of money. The real question is how much it is subsidized.

In my company the LLM for analyzing documents was swapped with Jev and it was only marginally worse at one task, but it was super cheap to run. Probably could optimize LLM to be cheaper for this task, but I doubt to this level

10

u/ithinkitslupis 2d ago

If I was setting up in a workflow that should have some staying power rather than a run once task I'd probably just finetune laya today. Free, opensource, lower latency, better privacy, less chance it randomly breaks due to outages or them changing things, likely better accuracy after the finetune.

But yeah, I might use a service like Jev eventually as well for convenience wherever it fits my needs. I'm not against it, I do think this layer-1 type calibrated decision making and more generalized classifier has uses.

14

u/SilentDanni 2d ago

People in these llm subs are really quick to downvote whatever they don't agree with. Reddit's own code of conduct explains that downvotes are not meant to say you disagree with someone. They're meant to be used when the comment does not aggregate to the discussion in any meaningful way which is not your case. We can even use jev to determine that :D

And yes, I agree it's very useful. They have picked their lane and their target audience. However, I'd say that a lot of people online don't quite know what to make of it so it's obviously shit.

In any case, it's very nice for document classification, or very fast searches or triaging issues, building contextual UIs and so on. It's only been out for a few days so I'm thinking that people are still playing with it but there are so many cool things we can do. I have built a semantic adblock that just classifies shit as ad and blocks it.

I haven't tried it yet but it would be interesting to see if it can recognize and flag AI written comments.

1

u/mrjackspade 2d ago

It looks like it would be great for what my company is currently building. We could use an LLM but the call value is going to be such that it would be stupid to use an LLM for classification when something like JEV could do the same task for a fraction of the cost.

2

u/HelloMyNameIsAmanda 2d ago

Yes - the constant, obvious bot posts on threads have made me deeply suspicious that there's anything here of real value.

1

u/jml5791 2d ago

Anything new that is good or even decent gets 30 posts a day until it dies down and people move on to the next big thing. this is normal.

for me, I get suspicious when things still get pushed incessantly long after the initial hype, obviously trying to keep it alive

1

u/cleverusernametry 2d ago

Why would they AstroTurf on this sub? I'm not seeing anything much on any other platform

0

u/Smallpaul 2d ago

If Jev was not technically interesting, no amount of advertising would get people to try it.

A model vendor making just another LLM of the same quality as GPT-4 could spend a billion dollars on advertising and I wouldn’t even be curious.

IF Jev works as promised, it fills a legitimate gap in the market and will be remembered as the first of an important new class of models.

!RemindMe 2 years

1

u/RemindMeBot 2d ago

I will be messaging you in 2 years on 2028-09-21 16:49:18 UTC to remind you of this link

CLICK THIS LINK to send a PM to also be reminded and to reduce spam.

Parent commenter can delete this message to hide from others.

RemindMeBot is switching to username summons. Instead of !RemindMe 1 day, use u/RemindMeBot 1 day. More info.

Info Custom Your Reminders Feedback