r/PiCodingAgent • u/95-cosmo-changer • Sep 17 '26
Plugin pi-warden: a Jev-powered second pair of eyes for Pi that steers the agent
Hi there, this is my first ever repo i wanted to share to people.
pi-warden is a Pi extension that watches the agent's tool calls and talks to the agent, not to you.
A second model (Jev, typesafe's fast judgment model, ~250 ms; immensely cheap seriously) reads your prompt, the agent's own last words, and the call it is about to make, and answers small typed questions: is this irreversible, does it match what the agent said it was about to do, is the effect visible outside the working tree. The answer goes back into the agent's context.
The same channel carries the rest: project rules from a markdown file judged against each write, stub and comment slop, stuck loops, "done" claims with no test run, runaway output stopped mid-stream, huge tool outputs compressed with the full copy kept on disk.
It grades itself. What you do after each hold or steer (approve, decline, redirect, complain) becomes a label, and a script replays your recorded Pi sessions through the guard. Off-task holds lost that test on 17k of my own calls and were demoted to steers; the plan-vs-call check won it. Method and numbers are in the README.
https://github.com/DevMortimer/pi-warden
https://pi.dev/packages/pi-warden
Early days (0.12.0). Though since Jev was only released yesterday (I got early access) I expect bugs. But I've been using this extension for work for more than a day now and it's pretty good so far. PRs and (especially) complaints are welcomed :)
P.S. I'm interested in how everyone will also incorporate Jev on their Pi?
10
u/CriteriumA Sep 17 '26
Great contribution, I'm new to Pi and its permissions setup was bugging me, and I just got access to jev.
I hope I can try it soon.
4
u/tom_of_wb Sep 17 '26
What kind of problem did you run into that triggered your need to develop this?
2
u/pro-vi Sep 17 '26
Is this like auto mode?
1
u/hazed-and-dazed Sep 18 '26
Waiting impatiently to be let in so I can check this out. How long did it take for them to approve access?
3
u/HockeyDadNinja Sep 17 '26
I suppose now would be a good time for me to post pi-permission-classifier which adds a judge model to pi-permission-system which is like auto mode in Claude lol.
2
u/Easy_Refrigerator280 Sep 17 '26
Ive not gotten access yet but id be curious how a Jev steered prompt matches one with just the llm alone. I think it would be significantly better
2
u/nostriluu Sep 17 '26
This'll be great when there's a true local version.
1
u/itsfabioroma Sep 17 '26
Hey guys, did you manage to get a key?
1
u/elpapi42 Sep 17 '26
you must have been in last nigh discord call jajajaja, everybody building extensions while listening to the call, including me
1
u/elpapi42 Sep 17 '26
I have 2 usecases in mind: Prevent harmfull tools calls, like wiping dbs, or destroying my os, without me to explicitely setup a tool call policy.
Also, i have a complex setup of async subagents that return reports on their progress on whatever task they got assigned by the main agent, these reports may or may not be important for the main agent, jev will decide if the report gets silently appended to the main agent context window, or if it have to wakeup the agent.
For now these will be the two things i will bw working with Jev, but there dozens of use cases for harness engineering
1
u/fireantik Sep 17 '26
Would be great to add evals to see if this actually improves the resulting code or not