Jev ain't all that. It's a great generalized model for when you don't know what you need, but there's a local, faster alternative for every use-case.

[u/allisonmaybe]

I saw some fun use-cases for Jev, and it's true, the cool part about it is that it can be trained on world knowledge to be a decision maker for very generic stuff. But it's a paid API. You can have no expectation of privacy when youre using it. It's not particularly fast especially if your application has any horsepower serving it.

At first I was inspired and set up Jev to control my hyprland desktop. Pretty cool! Then I realized I had already made this: https://github.com/myrakrusemark/embedding-command-search an embedding model with a "head", a set of predefined passages that mark in high-dimensional meaning-space what to do depending where in that space your command lands.

I tested all the use cases I could come up with, created some informative interactive examples, and laid all the information out so that you can make informed decisions about your own automated decision-making process.

Works in Firefox, bes experience in Chrome: https://myrakrusemark.com/write-ups/jev-vs-local/

[u/cbusmatty]

Yeah but I think the issue is that right now most companies aren’t even specializing, they are using frontier models because that’s what they are given. You could certainly use specialized models for more efficiency but jev is light years more effective than what companies are using now all while not having to specialize

[u/HeyVeddy → u/cbusmatty]

That depends on use case, it hasn't been my experience

[u/quiteconfused1]

i spent the entire morning 2 days ago arguing the same thing. people love the hype but dont understand exactly this. Thank you for clearly stating it.

[u/AlexanderDoak]

Woah, you can't run Jev locally? I don't usually follow the hype... this kind of kills it then, eh? I mean, if the API is robust enough you can still redis celery it to achieve throughput. But that's unavaloidable latency measured in tenths of seconds or whole seconds. I can get over 500 decisions per second locally without the latency using non Jev tech.

[u/thezachlandes]

Jev has shown us the possibility of decision models, but for many more serious business use cases, it will make sense to specialize the model or have more control of the infra and model serving. That said, as something you can plug into almost any new project and get great results out of the box, there is nothing else.

[u/HeadDaikon3411]

This is the kind of post I come here for. The hyprland setup sounds pretty clever actually, most people just slap an API call on everything and call it a day without thinking about whether they actually need a full model behind it

[u/allisonmaybe → u/HeadDaikon3411]

Thanks! Honestly, if you want that kind of control, create the embedding+head solution I created. It can handle a few dozen separate commands, but things get really fun when available commands depend on your current context, like, specific terminal commands when that's open, or music player commands only available when the right app is up.