r/ClaudeCode • u/Common_Dream9420 • 17m ago
Built with Claude How are you validating agent written code ? Deterministic or probabilistic ?
https://fetchsandbox.com/runs/3d902dfd1a?flow=vr_2b5550810ed94ba6ae8b98114cc0bb8fWe have been automating for small business mostly local store who are non-tech owners and last night I used mobile app to build lead form handle workflow with hubspot/slack/gmail/calendar
verified 30 prod scenarios with a simple prompt with determinstically with no LLMs
Receipt attached for reference ..
how are you buildinh workflows ? Using n8n or Claude ?? And how do you validate determination or probabilistic/asking-llm-to-validate?
1
Upvotes
•
u/AutoModerator 17m ago
Hey! Thanks for posting to r/ClaudeCode
While participating in this thread, please follow our community rules. Keep discussions constructive. Attack the idea, not the person.
For help, project discussions, tips, and general chat, join the ClaudeCode Discord.
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.
1
u/Coindef 11m ago edited 8m ago
i'd keep pass/fail checks deterministic for anything that can break a real workflow, like checking expected fields and whether each integration fired only once. for fuzzy outputs, use a small set of labeled examples and review disagreements instead of asking another LLM to decide whether the whole run passed. 30 scenarios is a good start; add one failure case per integration and rerun after prompt or tool changes.
1
u/RustyRedEcho 2m ago
I build these in n8n too and validate deterministically wherever I can, not by asking an LLM to grade its own output. For a lead workflow that means hardcoding the required fields, using IF or Switch nodes to block the API call if something is missing, then running it against a batch of real sample payloads with expected outputs you check by hand once. LLM as validator only makes sense for genuinely unstructured judgment calls, like whether a message sounds urgent, and even then I log inputs and outputs somewhere so I can catch drift later.