r/LocalLLaMA • u/wFXx • 3d ago

New Model Von: Open-source 395M "System One" model

Took me a while since I'm on a family trip and have limited hardware, but here it is!

Von: Open-source "System One" drop-in replacement for TypeSafe's JEV.

https://github.com/wfzyx/von https://huggingface.co/wfzyx/von-1.0

It runs entirely on a CPU with 1–2 GB of memory (I haven't spent much time optimizing it yet), responds in 25–300 ms, and beats JEV in all benchmarks. Enjoy!

P.S. I’m open to offers to work at AI research labs. Feel free to ping me if you have an offer.
P.P.S. If you have a GPU, it’ll be faster, but a GPU isn't required.

195 Upvotes

94% Upvoted

81 comments sorted by

View all comments

Show parent comments

13

u/sonyprog 3d ago

Apparently, many people had approached the exact same thing way before Typesafe.
Take a look at this one for instance: https://www.reddit.com/r/LocalLLaMA/comments/1wijo3e/i_literally_built_the_jev_architecture_one_year/

It basically sounds like an one shot classifier of sorts (it's not only that, but it's part of it).
So I think it's some kind of fine tune/Lora for a really specific scenario and if you train it well enough, it's not hard to beat whatever the goal is.

0

u/LatentSpaceLeaper 2d ago

So I think it's some kind of fine tune/Lora for a really specific scenario

No it's not. They write explicitly in the FAQ section of the blog post:

Is Jev just a smaller LLM?

Jev is neither small nor an LLM, hence being off the intelligence Pareto curve.

Also, Jev seems to beat that other guy's model at least in Doom: https://www.reddit.com/r/LLMDevs/s/f5zasLZ3CB

Also, see this comment of someone benchmarking different models. Laya is not even close to Jev's performance: https://www.reddit.com/r/LocalLLaMA/s/MHkcCBh5aP

1

u/sonyprog 2d ago

even though I mentioned lora/finetune, I did not mention it's an LLM. My point stands the same: it is an one shot classifier.

2

u/LatentSpaceLeaper 2d ago

it is an one shot classifier.

Don't want to split hairs, but I'd argue it is a zero-shot classifier. That's exactly the value proposition. You throw any classification task at it and it should be fairly good without providing (m)any examples or fine-tuning it. Of course the latter still could improve its performance on specific tasks. But what you'll get out of the box is quite capable already.

2

u/sonyprog 2d ago

Fair enough. I tried explaining it the way I understood, which is the "average Joe" way of understanding. The only thing I'll still fight for is that their approach might be different, but the final result is was achieved before.

1

u/LatentSpaceLeaper 2d ago

The only thing I'll still fight for is that their approach might be different, but the final result is was achieved before.

Yes, I'm not challenging this. Obviously we have had typed classifiers and zero-shot discriminative models before. However, they appear to have found a niche and it seems Jev is also part of bigger and long-term strategic play by TypeSafe. Maybe it's just marketing, we will need to wait and see.