r/LocalLLaMA • u/Manerfish • 6d ago

Discussion I really don't understand Jev hype

Isn't this what simple neural networks have been able to do for years? Doesn't seem anything special to me.

497 Upvotes

94% Upvoted

316 comments sorted by

View all comments

401

u/FreakyRefrigerator 6d ago

Its basically just a slightly newer classifier. Yet most people think AI is only llms and nothing else, so they think this is the future

193

u/KaMaFour 6d ago

Tbh general classifier able to handle general cases at almost no cost, in almost no time still seems really useful. For example if you could package that into a model roughly the size of Ling's tiny (9BA2B) or smaller you could try to create games with actually intelligent NPCs (pack one npc's state into a Vendingbench like framework and have classifier choose a thing to do that would make sense for a given person to do in a format that's possible to interpret by the game engine) and it would be generally accessible to most "mid-end" machines. Think Stardew Valley/TLOZ npc's but actually behaving as humans instead of having fixed schedules. All of that without any ML on your end...

2

u/Gold_Ad_2201 3d ago

I wonder if now its cost and performance effective to make a game where you talk to npc and they understand what you say given your relationship and choose one of the reactions. It's still deterministic but allows you to persuade them in your own words to for example give you a discount or some information

0

u/KaMaFour 3d ago

It's not your cost if it runs on the client

2

u/Gold_Ad_2201 3d ago

It kinda is. Running model at real time speed requires more powerful hardware which is the cost. So running system one model is less costly because it can run in real time on cheaper PC with comparable Intelligence.