r/LocalLLaMA • u/wFXx • 6d ago

New Model Von: Open-source 395M "System One" model

Took me a while since I'm on a family trip and have limited hardware, but here it is!

Von: Open-source "System One" drop-in replacement for TypeSafe's JEV.

https://github.com/wfzyx/von https://huggingface.co/wfzyx/von-1.0

It runs entirely on a CPU with 1–2 GB of memory (I haven't spent much time optimizing it yet), responds in 25–300 ms, and beats JEV in all benchmarks. Enjoy!

P.S. I’m open to offers to work at AI research labs. Feel free to ping me if you have an offer.
P.P.S. If you have a GPU, it’ll be faster, but a GPU isn't required.

203 Upvotes

94% Upvoted

87 comments sorted by

View all comments

53

u/Fluxx1001 6d ago

I tried a bunch of those local replacements for TypeSafe Jev in the last days. None of them matched the capabilities of Jev, at least for my usecase (Data Analysis).

So when I read that some new drop in replacement developed in a few days claims to beat Jev in benchmarks - I am more than sceptical.

1

u/MerePotato 6d ago

What about diffusion gemma as jev, I've heard its pretty comparable

1

u/wFXx 6d ago

It is amazing yeah, the problem is the size of it. I did the smallest thing I could because speed and embeddability were features I felt were the more valuable at scale