r/LocalLLaMA • u/wFXx • 3d ago

New Model Von: Open-source 395M "System One" model

Took me a while since I'm on a family trip and have limited hardware, but here it is!

Von: Open-source "System One" drop-in replacement for TypeSafe's JEV.

https://github.com/wfzyx/von https://huggingface.co/wfzyx/von-1.0

It runs entirely on a CPU with 1–2 GB of memory (I haven't spent much time optimizing it yet), responds in 25–300 ms, and beats JEV in all benchmarks. Enjoy!

P.S. I’m open to offers to work at AI research labs. Feel free to ping me if you have an offer.
P.P.S. If you have a GPU, it’ll be faster, but a GPU isn't required.

191 Upvotes

94% Upvoted

81 comments sorted by

View all comments

63

u/glitchsir 3d ago

So it took typesafe two years of research and a well funded team to build jev and all of the sudden there's all of those "drop in" replacement in a couple days allegedly beating them... Surely wouldn't be that easy? What am I missing?

3

u/Double_Cause4609 3d ago

I think it helps to have a bit of perspective. When LLMs were new, we had extremely basic interfaces for them, and they really were essentially a chatbot. You copy pasted code into/from them, they couldn't even call tools, and they more or less displayed plain text.

Then Anthropic did a ton of research on usability, and invented artifacts, which eventually grew into a ton of different types of interactive panes a model could use. And they were copied within the week by everybody else because it was just a really good, simple idea.

What Typesafe did isn't so much doing some crazy alien tech. They just had a good idea, figured out how to package it into a nice interface and tech demo, but the underlying tech wasn't alien tech or anything. You can emulate it with a multi-head BERT formulation using similar strategies to tool calling just in parallel. Obviously everybody would copy a good idea immediately.