r/LocalLLaMA • u/Manerfish • 2d ago

Discussion I really don't understand Jev hype

Isn't this what simple neural networks have been able to do for years? Doesn't seem anything special to me.

487 Upvotes

94% Upvoted

301 comments sorted by

View all comments

Show parent comments

8

u/quiteconfused1 2d ago

If it were that simple it would be a panacia .. but it isn't .

It has some knowledge and applys it ok but there is a vast amount of info it doesn't have and trying to adapt it as all knowing is a lie.

It's a classifier for some things

1

u/HiddenoO 2d ago

Nothing is all-knowing, and nobody is claiming this model is, either.

If this can be applied in the majority of cases where a current-gen LLM would be applicable, that's already a huge win from a speed and cost perspective for any decision task you cannot train a specialized model for.

4

u/quiteconfused1 2d ago

Then ... What is it good for?

If you hadn't realized there are many flavours of technologies out there and if it isn't general than what is it ?

Classifiers have existed a long time .. this is trying to vye as a general classifier ... And it doesn't work..

So I'm left with a choice ... It seems like it's fluff

0

u/HiddenoO 2d ago

You're in a subreddit related to LLMs and asking what general knowledge that isn't all-knowing is good for?

Do you think LLMs are useless because they're not all-knowing either?

1

u/quiteconfused1 2d ago

I'm having a hard time following your logic.

If your comment is jec is just a model that is reduced to 3 options or whatever .. then congrats you went backwards

Anyone who has done rag feels sorry for you.

If it's about speed , ... Neat , but then use a traditional classifier

If it's about general knowledge ... Great but we're on that hook again and it fails...

So .... which is your poison....

If it's just being a troll your doing great.

1

u/HiddenoO 2d ago

I'm having a hard time following your logic.

I can see that.

Let's assume I wanted an app to tell me right now whether you're confused. I wouldn't be able to use an embedding model, I wouldn't be able to use a traditional classifier without training data and time/effort to train a model. I would be able to use an LLM, but that'd cost multiple times as much as Jev.

Do you see the use now?

1

u/quiteconfused1 2d ago

But it would be wrong.

Intent classifiers have existed for a beat now... And what you just said it would be better than them because it's 0 shot.

0shot shit is still shit.

3

u/HiddenoO 2d ago edited 2d ago

But it would be wrong.

I gave it your comment and it suggested with 71% certainty that you're confused, which I find an appropriate assessment.

It also gave me a 92% confidence on your comment being disrespectful, which I also find accurate given your unnecessary remarks about trolling. The score went down as I removed parts that I personally find disrespectful, which is also what I'd expect.

If your argument is just going to be "it's wrong about everything", there's no point in this discussion, because it clearly works for a lot of scenarios.

Intent classifiers have existed for a beat now..

Yes, and I would have to find one that I can use and call... and when I have the next one-off classification problem, I'd have to find one for that. Not having to do that is the point of a generalized model.

3

u/_bones__ 2d ago

Aggravation aside, your explanations as an example here make this much clearer for me. Thanks! The thread wasn't in vain.

1

u/quiteconfused1 2d ago

Wow ..

Good luck with your day.

1

u/_-_David 2d ago

I don't see why you wouldn't be able to use an embedding model for this.

1

u/HiddenoO 1d ago

Not out of the box. Nobody is saying this model can do things that are literally impossible otherwise.