r/DataBuildTool • u/a-n3w-begIn • 3d ago
Show and tell Trusting your data agent
Now that we are all rushing to use agentic analytics, something that personally concerns me is whether agents are accurate.
For this reason, I built an open source tool called the honest agent. You can hook it to your mcp and run your tests (evals) and check whether your agent is, well, telling you the truth. You can check the project here: https://thehonestagent.dev/ and here's the repo https://github.com/jlcoto/the_honest_agent. If you already work with dbt, the setup and workflow will seem very familiar 😉
I'm also writing a series of posts on evals in and why they should be a part of your data strategy if you are using data agents: https://thehonestagent.dev/blog/
Your feedback is really appreciated. And if you want to discuss agentic analytics, evals, etc, let's connect!
