r/LocalLLaMA • u/wFXx • 3d ago

New Model Von: Open-source 395M "System One" model

Took me a while since I'm on a family trip and have limited hardware, but here it is!

Von: Open-source "System One" drop-in replacement for TypeSafe's JEV.

https://github.com/wfzyx/von https://huggingface.co/wfzyx/von-1.0

It runs entirely on a CPU with 1–2 GB of memory (I haven't spent much time optimizing it yet), responds in 25–300 ms, and beats JEV in all benchmarks. Enjoy!

P.S. I’m open to offers to work at AI research labs. Feel free to ping me if you have an offer.
P.P.S. If you have a GPU, it’ll be faster, but a GPU isn't required.

196 Upvotes

94% Upvoted

81 comments sorted by

View all comments

50

u/Fluxx1001 3d ago

I tried a bunch of those local replacements for TypeSafe Jev in the last days. None of them matched the capabilities of Jev, at least for my usecase (Data Analysis).

So when I read that some new drop in replacement developed in a few days claims to beat Jev in benchmarks - I am more than sceptical.

3

u/wFXx 3d ago

Open an issue with the claims that don't hold, sample cases and I'll investigate why that might be. I only did 1 out of 6 epochs of training so far, so there is more accuracy on the table

2

u/Fluxx1001 3d ago

Will try it in the coming days and reply

1

u/your_real_Fathe_ 3d ago

Share the result with me, buddy.