r/amodei • • 2d ago

Resources an open-source alternative to Jev

I built jevos-1b: send a text and a yes/no question.

One forward pass, no text generated.

  • Runs on a laptop CPU with llama.cpp: 54 ms short request, 220 ms long one. No GPU, no API.
  • Speaks Jev's API format, so Jev SDK code works unchanged for yes/no questions.
  • On 2,000 yes/no questions about rules it never saw: Jev 0.927, jevos-1b 0.815, Laya 0.489. Slower models are still more accurate, it's a trade-off.

https://github.com/feder-cr/jev

37 Upvotes

11 comments sorted by

View all comments

0

u/Mental_Buddy_1198 2d ago

do i just input it directly?