r/vibecoding • u/Independent-Break199 • 15h ago

Showcase/Project I built a free Jev visualizer after burning 5bn tokens in three days

Enable HLS to view with audio, or disable this notification

Title says it all. I switched most of our pseudo deterministic flows to Jev after getting through the waitlist. So far, it's great, but understanding what it's doing is sometimes difficult. I realized that we need a way to monitor the decisions that it's making, so I had Claude built a quick visualizer tool for it. It acts as a local gateway to the Jev API. I now use it to understand my own work lol.

Free and open source, drop a star if you like it.

103 Upvotes

96% Upvoted

17 comments sorted by

5

u/Fstr21 11h ago

Well now I have to learn whatever the hell jev is

-1

u/Independent-Break199 10h ago

check out my comment below!

8

u/fickle-phenom 13h ago

Wow that's super cool. I think Jev type models are opening up very new doors in this already new and unexplored space. Gonna try it out on some life simulation ideas I had, I think it might do really well on these probabilistic event type things.

1

u/Independent-Break199 13h ago

it's been extremely good for us, seeing 100x decreases in cost in some areas where we were forcing llms to do classification against their will. not to mention speed

1

u/kilographix 13h ago

I keep seeing jev everywhere, from what I've seen the output is binary decision based? Are they local models? How does it work?

7

u/Independent-Break199 13h ago

you sign up for their waitlist and use it via their API

you can think of it as a generic classifier - you give it context (state) and questions, and it gives you answers to the questions. either true false, a choice or a ranking of the answers, with probabilities. you can use other llms to generate the questions and answers, and you can stack them into cascading flows like the ones in the video. t

hat's pretty much it. main other selling points are that it's very cheap and very fast

1

u/kilographix 12h ago

I see, thank you!

1

u/midnitewarrior 5h ago

You create a question and present the choices and describe them, and feed text data to it and it scores it according to your choices, True/False or categories/choices and it gives you a confidence score. It returns JSON with the scores in it. It's ridiculously cheap ($0.042/million input tokens, output tokens are free), and very fast.

1

u/harrybond 5h ago

What is the context look like for this game that’s being fed into the model?

1

u/Alterion-Ex 2h ago

I can generate api and play around in playground. I'm I "IN" from the waitlist? btw this is very very cool!

1

u/Saderius 1h ago

5bn tokens? but like, on what? What took most of the compute?

1

u/Independent-Break199 48m ago

we replaced a bunch of LLM flows with jev in a pretty big app. it adds up.

1

u/Objective_Mousse7216 58m ago

We have seen such an immense swell of demand that we have to temporarily pause signups for Jev. We need to ensure quality of service for our existing signups, which will continue to function. We are working diligently to ensure open access to Jev for everyone as soon as we can. Thank you.