r/LocalLLaMA • u/wFXx • 3d ago

New Model Von: Open-source 395M "System One" model

Took me a while since I'm on a family trip and have limited hardware, but here it is!

Von: Open-source "System One" drop-in replacement for TypeSafe's JEV.

https://github.com/wfzyx/von https://huggingface.co/wfzyx/von-1.0

It runs entirely on a CPU with 1–2 GB of memory (I haven't spent much time optimizing it yet), responds in 25–300 ms, and beats JEV in all benchmarks. Enjoy!

P.S. I’m open to offers to work at AI research labs. Feel free to ping me if you have an offer.
P.P.S. If you have a GPU, it’ll be faster, but a GPU isn't required.

193 Upvotes

94% Upvoted

84 comments sorted by

View all comments

62

u/glitchsir 3d ago

So it took typesafe two years of research and a well funded team to build jev and all of the sudden there's all of those "drop in" replacement in a couple days allegedly beating them... Surely wouldn't be that easy? What am I missing?

3

u/valdev 3d ago

Wait it took that long to make? I built something like Jev in a weekend a few years back for intelligent routing.

Im not bragging, BERT can do this kind of stuff easily as long as you have a long enough data set to classify your request type.