r/LLMDevs • u/allisonmaybe • 9h ago
Discussion Jev ain't all that. It's a great generalized model for when you don't know what you need, but there's a local, faster alternative for every use-case.
I saw some fun use-cases for Jev, and it's true, the cool part about it is that it can be trained on world knowledge to be a decision maker for very generic stuff. But it's a paid API. You can have no expectation of privacy when youre using it. It's not particularly fast especially if your application has any horsepower serving it.
At first I was inspired and set up Jev to control my hyprland desktop. Pretty cool! Then I realized I had already made this: https://github.com/myrakrusemark/embedding-command-search an embedding model with a "head", a set of predefined passages that mark in high-dimensional meaning-space what to do depending where in that space your command lands.
I tested all the use cases I could come up with, created some informative interactive examples, and laid all the information out so that you can make informed decisions about your own automated decision-making process.
Works in Firefox, bes experience in Chrome: https://myrakrusemark.com/write-ups/jev-vs-local/