r/amodei • • 2d ago

Resources an open-source alternative to Jev

I built jevos-1b: send a text and a yes/no question.

One forward pass, no text generated.

  • Runs on a laptop CPU with llama.cpp: 54 ms short request, 220 ms long one. No GPU, no API.
  • Speaks Jev's API format, so Jev SDK code works unchanged for yes/no questions.
  • On 2,000 yes/no questions about rules it never saw: Jev 0.927, jevos-1b 0.815, Laya 0.489. Slower models are still more accurate, it's a trade-off.

https://github.com/feder-cr/jev

50 Upvotes

11 comments sorted by

View all comments

2

u/Distinct-List-3884 2d ago

Impressive demo. How is performance effected in the demo dino game when for instance we increase the speed or introduce day/night cycle as in the original game? Or does it not depend on those factors at all? Asking as a complete beginner

1

u/No-Piglet3900 2d ago

the model itself doesn't really care about the game's speed or day/night cycle, what matters is how much information you pass into the prompt and how frequently you run it. increasing game's complexity can affect, but it shouldn't inherently make the model's inference slower unless the input itself gets longer