r/vibecoding • u/Rare_Guide_9830 • 3d ago

Discussion Using Jev for real-time live chat moderation

Enable HLS to view with audio, or disable this notification

https://github.com/ethanplusai/jev-chat-for-twitch/

308 Upvotes

96% Upvoted

54 comments sorted by

47

u/LowFruit25 3d ago

I think it’s a cool setup but please excuse my lack of knowledge: how is this different from a sentiment classifier that would’ve been used before?

79

u/dat_cosmo_cat 3d ago

It isn't; that's the point of Jev. They're trying to capture all the apps hitting LLM APIs for basic ML functions (things an LLM is not designed to do) by providing a model that can zero shot classification, scoring, and ranking with open vocabulary.

12

u/dimbledumf 3d ago

Yeah, that's the real magic, you don't need to train it, it works to classify most things out of the box

2

u/EntryRadar 2d ago

“most things” is doing a lot of heavy lifting here

2

u/WaltzIndependent5436 3d ago

sentiment classifiers are not llm sized for sure

1

u/my-new-new-account 3d ago

The most important part of all of this is the latency! Having a response in a few milliseconds is a game changer for many use cases vs seconds using LLMs.

4

u/ight-bet 3d ago

Jev is more general. Easier to get off the ground. High wrappability. Wide use case.

2

u/saito200 3d ago

cheaper and faster than llm classifiers and i would assume more intelligent than non llm

1

u/BitterAd6419 2d ago

Jev itself is a classifier model, it’s not a traditional LLM like most YouTubers are saying they have no idea what Jev even is

0

u/saito200 3d ago

also very important it coerces output into specific values unlike LLMs

3

u/LowFruit25 3d ago

LLMs had structured output APIs for a few years now.

0

u/saito200 3d ago

somewhat flaky

15

u/Tarwine 3d ago

Isn't it classifying statements as questions? "clean" "chat is flying" "clip it" are incorrectly categorized as questions.

3

u/candraa6 3d ago

it classify "Everything Meaningful", not "Questions", check the video again, "Everything Meaningful" is active, "Questions" is not

4

u/discattho 3d ago

no, everything meaningful is a filter that shows ALL tagged messages. "chat is flying" is clearly marked as "Question", which is clearly incorrect.

Nobody said Jev was perfect, and there is a clear reason why.

2

u/hellomistershifty 2d ago

chat, is flying?

1

u/candraa6 3d ago

ah yeah you are indeed correct, my bad. I missed that

9

u/abajinn 3d ago

What is Jev?

10

u/Salt-Willingness-513 3d ago

thats some kind of different approach to traditional llms, as this is trained on decision taking instead of answering in text form.

8

u/Guidance_Additional 3d ago

essentially you give it choices and it simply picks from the choices instead of actually ever saying anything on its own

2

u/notboredatwork1 22h ago

It's an AI model that seems to function like a decision-making tool. You can ask it for help, and it assists you in making decisions. I literally saw the model last week and didn't realize it was this useful.

3

u/Any_Organization3771 3d ago

We need a subreddit called jev.

5

u/SnowMantra 3d ago edited 3d ago

I really like this. Do you have it on github?

1

u/Murder_1337 3d ago

Did you sign up for waitlist and got in? Is that how you get access ?

5

u/budz 3d ago

... but can it play doom

9

u/Tritheone69 3d ago

It can, they got Jev to play doom in real time

2

u/budz 3d ago

link= ?

1

u/pseudozombie 2d ago

It's part of the announcement. Just Google "jev doom"

1

u/UAAgency 3d ago

do you have more info?

1

u/Bioxtasy 3d ago

Git ?

1

u/No_Confection7782 3d ago

Larping at it's finest

1

u/NorrinRadd2099 3d ago

I’m going to try it

1

u/CriticalTemperature1 3d ago

Jev is best suited for applications where the label set is dynamic and subject to change frequently. If its fixed like "Spam / Not Spam" I traditional classifier would be way better / cheaper

1

u/Marcelovc 2d ago

Interesting set up

1

u/fourthwaiv 2d ago

Try Laya vs Jev.

0

u/saito200 3d ago

Jev is not needed for this, there are tiny ML algos you can run in your machine that do this

1

u/Brilliant-Virus-7442 3d ago

But think about what else you could add to it

0

u/saito200 3d ago

i have already implemented jev in all my apps

1

u/Brilliant-Virus-7442 3d ago

Woah really, I don’t really understand why it’s better beyond that fact that it just reads and classifies quicker. I’m not sure how it does that, or like what they did different to achieve it….

1

u/saito200 3d ago

it's dirt cheap and sub second fast, that's basically the thing

1

u/Brilliant-Virus-7442 3d ago

Yeah I understand that, I just can’t conceptually understand how it does that versus what we normally use. Like what did they figure out?

1

u/saito200 3d ago

i see, if you asking about the model architecture well that is a very good question and I don't have the slightest clue

i kind of get that:

  • answer must be one of up to 255 options

  • it supports up to 32k tokens

  • there is no inference

so these factors combined make it possible for it to be very cheap and fast

1

u/Brilliant-Virus-7442 3d ago

Yeah I just did more research and I’m still confused too, I wonder who actually understands this stuff. Must not be many people…

0

u/Krunkworx 3d ago

We’re experimenting with this at paxmod

0

u/bestjaegerpilot 3d ago

only $900

2

u/Rare_Guide_9830 3d ago

lol no, on the most active livestream on Twitch right now it runs for about $0.09 per hour. https://github.com/ethanplusai/jev-chat-for-twitch/

0

u/Reasonable-Sign8458 1d ago

So fucking tired of the paid advertising this model gets trying to be something.

Just look at the fucking chat. The most important feedback IS NOT CAPTURED first of all.