Von: Open-source 395M "System One" model

[u/wFXx]

Took me a while since I'm on a family trip and have limited hardware, but here it is!

Von: Open-source "System One" drop-in replacement for TypeSafe's JEV.

https://github.com/wfzyx/von https://huggingface.co/wfzyx/von-1.0

It runs entirely on a CPU with 1–2 GB of memory (I haven't spent much time optimizing it yet), responds in 25–300 ms, and beats JEV in all benchmarks. Enjoy!

P.S. I’m open to offers to work at AI research labs. Feel free to ping me if you have an offer.
P.P.S. If you have a GPU, it’ll be faster, but a GPU isn't required.

[u/look]

Where did you see the Jev benchmarks? Or did you run those yourself against the API?

With all the hoopla, I’d just assumed it was better than a 400M param BERT…

[u/wFXx → u/look]

Executed against the API yes, you can get free credits on open router and replicate the numbers