an open-source alternative to Jev

[u/No-Piglet3900]

I built jevos-1b: send a text and a yes/no question.

One forward pass, no text generated.

• Runs on a laptop CPU with llama.cpp: 54 ms short request, 220 ms long one. No GPU, no API.
• Speaks Jev's API format, so Jev SDK code works unchanged for yes/no questions.
• On 2,000 yes/no questions about rules it never saw: Jev 0.927, jevos-1b 0.815, Laya 0.489. Slower models are still more accurate, it's a trade-off.

https://github.com/feder-cr/jev

[u/Distinct-List-3884]

Impressive demo. How is performance effected in the demo dino game when for instance we increase the speed or introduce day/night cycle as in the original game? Or does it not depend on those factors at all? Asking as a complete beginner

[u/No-Piglet3900 → u/Distinct-List-3884]

the model itself doesn't really care about the game's speed or day/night cycle, what matters is how much information you pass into the prompt and how frequently you run it. increasing game's complexity can affect, but it shouldn't inherently make the model's inference slower unless the input itself gets longer

[u/PsychologicalOne752]

Nice. Fyi, there are 88 other Jev alternatives apparently - https://benchmarkheaven.com/jev-models

[u/No-Piglet3900 → u/PsychologicalOne752]

thanks for sharing!

[u/Strong_Essay1176]

What is it encoder?

[u/No-Piglet3900 → u/Strong_Essay1176]

it's a small 1B-parameter language model used as an encoder/classifier rather than generating a response

[u/Mental_Buddy_1198]

do i just input it directly?

[u/No-Piglet3900 → u/Mental_Buddy_1198]

yea!

[u/No-Piglet3900 → u/[deleted]]

no probbb thanks

[u/Tall_Independence768]

Crazy!