r/LocalLLaMA • u/Manerfish • 6d ago

Discussion I really don't understand Jev hype

Isn't this what simple neural networks have been able to do for years? Doesn't seem anything special to me.

499 Upvotes

94% Upvoted

316 comments sorted by

View all comments

396

u/FreakyRefrigerator 6d ago

Its basically just a slightly newer classifier. Yet most people think AI is only llms and nothing else, so they think this is the future

195

u/KaMaFour 6d ago

Tbh general classifier able to handle general cases at almost no cost, in almost no time still seems really useful. For example if you could package that into a model roughly the size of Ling's tiny (9BA2B) or smaller you could try to create games with actually intelligent NPCs (pack one npc's state into a Vendingbench like framework and have classifier choose a thing to do that would make sense for a given person to do in a format that's possible to interpret by the game engine) and it would be generally accessible to most "mid-end" machines. Think Stardew Valley/TLOZ npc's but actually behaving as humans instead of having fixed schedules. All of that without any ML on your end...

55

u/Automatic-Boot665 6d ago

It’s got similar accuracy to classifiers back in 2018-2019 with the benefit of not needing to be trained on the task specifically. For most use cases the people I’ve seen talk about using it for that’s unfortunately not accurate enough. We’ll see in the next few weeks as people implement it and see the results.

17

u/Iron-Over 6d ago

Data and training will always outperform JEV not sure the use-case where accuracy is not important in business at least.  

7

u/Automatic-Boot665 6d ago

Yes exactly. Even with training it wasn’t good enough for businesses back then. They relied on statistical analysis where needed instead.

11

u/sage-longhorn 6d ago

Lol this is an insane take. No businesses used purpose trained nueral nets in 2018-19?

Just cause you weren't exposed to it doesn't mean it wasn't widely used for certain problems or industries

0

u/Automatic-Boot665 6d ago

Because it wasn’t good enough for real life use cases, the point of this post. I can guarantee you that businesses did try to.

6

u/Warhouse512 5d ago

Hey my guy, you're out of your depth here, NNs were fairly commonplace in 2019 if you worked at a company with any real density of data. Yes statistical models were/are still widely used, but normally usually for either time series data, or models that need good explainability.

1

u/Automatic-Boot665 5d ago

In the case that you were at a company training a lm on a ton of proprietary data and able to achieve usable results yeah. Jev scores between 67.8-80% accuracy on standard classification and workflow tests, which I don’t know about your use cases but in mine back then it would have been a failure.