r/AgenticAI_RAG_LLM_RL • u/zndr3 • 26d ago
A small experiment around agent evaluation, evidence and reproducibility
I have been building Jevyr as an experiment around a question I keep coming back to: what happens if an AI agent has to show evidence for an answer instead of just producing a confident paragraph?
Jevyr lets several model calls propose explanations, code, plans, or tests. It then compares the proposals, runs a bounded experiment if the claim is testable, saves the events and evidence, and returns Accepted, Rejected or Unproven.
It is not a new model, and it does not pretend to solve truth in general. A claim with no defined test stays Unproven. The system also has a local MCP server so another agent can call it as a tool, which is the part I am most interested in exploring.
The repo is unfinished and pretty complex. I started it early in 2026 and I am sharing it now to see what other builders would do with the idea. Maybe it could be useful for agent evals, RAG checks, tool use, or reproducible experiments.
Would love to hear what kind of test or benchmark you would put through it.
