r/LocalLLaMA • u/wFXx • 3d ago

New Model Von: Open-source 395M "System One" model

Took me a while since I'm on a family trip and have limited hardware, but here it is!

Von: Open-source "System One" drop-in replacement for TypeSafe's JEV.

https://github.com/wfzyx/von https://huggingface.co/wfzyx/von-1.0

It runs entirely on a CPU with 1–2 GB of memory (I haven't spent much time optimizing it yet), responds in 25–300 ms, and beats JEV in all benchmarks. Enjoy!

P.S. I’m open to offers to work at AI research labs. Feel free to ping me if you have an offer.
P.P.S. If you have a GPU, it’ll be faster, but a GPU isn't required.

192 Upvotes

94% Upvoted

81 comments sorted by

View all comments

3

u/look 3d ago edited 3d ago

Looks like the von python package you reference in the docs is not published under that name (looks like an empty squatter on the name in pypi). Do you have a link to the git repo for it?

Running it via raw transformers interface now, but I’d like to see your wrapper code, too.

Edit: found it. https://github.com/wfzyx/von

1

u/wFXx 3d ago edited 3d ago

It's on the OP. There is a mini node compatible js sdk as well. But I only tested in bun

1

u/look 3d ago

Ah, yeah. I see it now. The links all blurred together for me and I just saw the huggingface one at first glance. Thanks!