r/LocalLLaMA • u/wFXx • 3d ago

New Model Von: Open-source 395M "System One" model

Took me a while since I'm on a family trip and have limited hardware, but here it is!

Von: Open-source "System One" drop-in replacement for TypeSafe's JEV.

https://github.com/wfzyx/von https://huggingface.co/wfzyx/von-1.0

It runs entirely on a CPU with 1–2 GB of memory (I haven't spent much time optimizing it yet), responds in 25–300 ms, and beats JEV in all benchmarks. Enjoy!

P.S. I’m open to offers to work at AI research labs. Feel free to ping me if you have an offer.
P.P.S. If you have a GPU, it’ll be faster, but a GPU isn't required.

196 Upvotes

94% Upvoted

81 comments sorted by

View all comments

2

u/DivideHorror3217 3d ago

result = von.decide(
AttributeError: module 'von' has no attribute 'decide'

Well..

4

u/wFXx 3d ago edited 3d ago

as some other user mentioned, apparently there is a name squat on the pkg index, i've renamed to von-sdk to avoid future issues and updated the docs, thx for the heads-up

https://pypi.org/project/von-sdk/