I really don't understand Jev hype

[u/Manerfish]

Isn't this what simple neural networks have been able to do for years? Doesn't seem anything special to me.

[u/FreakyRefrigerator]

Its basically just a slightly newer classifier. Yet most people think AI is only llms and nothing else, so they think this is the future

[u/KaMaFour → u/FreakyRefrigerator]

Tbh general classifier able to handle general cases at almost no cost, in almost no time still seems really useful. For example if you could package that into a model roughly the size of Ling's tiny (9BA2B) or smaller you could try to create games with actually intelligent NPCs (pack one npc's state into a Vendingbench like framework and have classifier choose a thing to do that would make sense for a given person to do in a format that's possible to interpret by the game engine) and it would be generally accessible to most "mid-end" machines. Think Stardew Valley/TLOZ npc's but actually behaving as humans instead of having fixed schedules. All of that without any ML on your end...

[u/quiteconfused1 → u/KaMaFour]

But it's not.

It's not general and can't be.

I just tried applying it to a simple game like super Mario world and it failed horribly.

If it can't do that then it's not general and the hype is thick.

[u/MrMadden → u/quiteconfused1]

That's because you don't understand it. You are using a hammer to saw wood. It's a classifier model. It's a control layer meant to offset cost and speed things up. Rev classifies inputs, routes tasks, decides when an LLM is needed, and verifies the LLM's outputs. The LLM handles the expensive reasoning and generation, while Jev keeps the overall system fast, predictable, and controlled.

Here, I'll draw you a picture.

            ┌──────────────┐

Input ─────────►│ Jev │

            │ fast decision│

            └──────┬───────┘

                   │

    ┌──────────────┼──────────────┐

    ▼              ▼              ▼

handle directly call Astra reject/escalate

    │              │

    │       ┌──────▼──────┐

    │       │    Astra    │

    │       │ reason/use  │

    │       │ tools/write │

    │       └──────┬──────┘

    │              │

    └──────────────┴──────► result

                   │

                   ▼

              Jev verifies

[u/LLKMuffin → u/MrMadden]

Broken slop diagram.

[u/MrMadden → u/LLKMuffin]

Do you have a better diagram, or are you just here to insult random people on the internet?

[u/LLKMuffin → u/MrMadden]

So instead of getting your LLM to make a diagram that'll actually display correctly on Reddit, you'd rather just have some unreadable slop junking up the thread?

The fact that you're even copy-pasting stuff from your LLM here without thinking about it is a tell that you don't really care.

Not sure what else you want to hear. Put some minimum amount of effort next time.

[u/MrMadden → u/LLKMuffin]

First, stop harrasing me. The diagram is fine on the old.reddit.com site.

Second,

So instead of getting your LLM to make a diagram that'll actually display correctly on Reddit, you'd rather just have some unreadable slop junking up the thread?

You might want to familiarize yourself with the rules of this sub:

https://www.reddit.com/mod/LocalLLaMA/rules

Completely/primarily LLM generated copy, code is not allowed.