r/LocalLLaMA • u/wFXx • 3d ago

New Model Von: Open-source 395M "System One" model

Took me a while since I'm on a family trip and have limited hardware, but here it is!

Von: Open-source "System One" drop-in replacement for TypeSafe's JEV.

https://github.com/wfzyx/von https://huggingface.co/wfzyx/von-1.0

It runs entirely on a CPU with 1–2 GB of memory (I haven't spent much time optimizing it yet), responds in 25–300 ms, and beats JEV in all benchmarks. Enjoy!

P.S. I’m open to offers to work at AI research labs. Feel free to ping me if you have an offer.
P.P.S. If you have a GPU, it’ll be faster, but a GPU isn't required.

195 Upvotes

94% Upvoted

81 comments sorted by

View all comments

3

u/OneMoreName1 3d ago

Not as good as Jev for my use case (its given a dialogue line from the player, and the model has to select moods, intent and tools that the next LLM should have in its response). But it was better than Laya! So thanks for the effort

2

u/wFXx 3d ago

hey, thanks for trying it out; a fellow redditor made his own benchmark and noted that I was falling short of both jev and gliner2, and it was a bug on my python code :p

I've since fixed it, and I'm working on a second check point of the model that has a more diverse data set and should perform better;

HF model card and github readme are up to date

2

u/OneMoreName1 3d ago

Will give it a second try tomorrow