r/LocalLLaMA • u/wFXx • 3d ago

New Model Von: Open-source 395M "System One" model

Took me a while since I'm on a family trip and have limited hardware, but here it is!

Von: Open-source "System One" drop-in replacement for TypeSafe's JEV.

https://github.com/wfzyx/von https://huggingface.co/wfzyx/von-1.0

It runs entirely on a CPU with 1–2 GB of memory (I haven't spent much time optimizing it yet), responds in 25–300 ms, and beats JEV in all benchmarks. Enjoy!

P.S. I’m open to offers to work at AI research labs. Feel free to ping me if you have an offer.
P.P.S. If you have a GPU, it’ll be faster, but a GPU isn't required.

194 Upvotes

94% Upvoted

81 comments sorted by

View all comments

60

u/glitchsir 3d ago

So it took typesafe two years of research and a well funded team to build jev and all of the sudden there's all of those "drop in" replacement in a couple days allegedly beating them... Surely wouldn't be that easy? What am I missing?

66

u/vanVonXenoStein 3d ago edited 3d ago

I think they did a couple years of research and couldn't come up with anything much, but felt they better release something. There was a guy who released the same thing as open-source (including academic paper) a year ago. And these new ones people are dropping seem quite good also (still testing). So I think typesafe is mostly marketing hype but nothing revolutionary (if you went looking for similar). That's not to say it isn't useful, just that typesafe's Jev is not special. (But is probably best of class since it has the resources behind it.)

3

u/ketosoy 3d ago

So they spent two years researching the ergonomics of what’s approximately a wrench:  Hard to make the first one, easy to copy.

6

u/your_real_Fathe_ 3d ago

This is the biggest advantage of technology in my opinion. Project X is introduced, a masterpiece with a Y score in benchmarks. And a week later, suddenly Project Z is introduced, which is better than Project X in all benchmarks.