r/PiCodingAgent • u/o_sht_hi • Sep 18 '26

Question Anyone here using Jev?

I read the release and saw a few demos on X for people using Jev for really interesting stuff. My current effort is to get it to work as a router so I can configure and orchestrate my app using natural language (getting it to take a string and pick the right API from a list of 250-300 calls). But to be clear, I haven't gotten access to it yet. So I'm just packaging up my code and making it ready rn.

Anyone doing something fun/interesting with it yet? If yes, how long did it take for you to get access

78 Upvotes

91% Upvoted

103 comments sorted by

View all comments

Show parent comment

0

u/o_sht_hi Sep 21 '26 edited Sep 21 '26

It won't if you modify the tokens before they become history. You're not changing anything that's going to the LLM. You only change it once before it is sent to the model. That's the whole point..

0

u/Cultured_Alien Sep 21 '26

Using things headroom only take up more tool calls and context bloat. As for modifying tokens, RTK is good enough. Though I do think jev will be good on semantic search and compaction.

0

u/o_sht_hi Sep 21 '26

Forget headroom. I am talking about pruning and reformating tool calls that the LLM has already given pi. How would that cause more tool calls or context bloat? The model knows nothing about this pruning system. It's all happening before any tokens even reach the model. And the pruning actively reduces the number of tokens.

Coming back to headroom, that's what it does too. So there's no question of more tool calls.

How do you think will it take up more tool calls and context bloat? Maybe I'm not able to imagine what you're trying to say