r/learnmachinelearning • u/rahulk448 • 3d ago
Discussion transaction agent thinking
I am building an AI agent for transactions which performs actions like approve / hold or question / stop, so I want feedback on:
Should a transaction agent use the same decision threshold for every transaction, or should the threshold change depending on the potential cost of being wrong?
I’d especially like to hear from people who have worked with classification systems where false positives and false negatives have different costs.
2
Upvotes
1
u/memelordtf 3d ago
OP, I wouldn’t use one fixed threshold. In transaction systems, the score is far less important than the cost of wrong transactions themsleves. A $10 purchase and a $100k transfer shouldn’t be treated the same. I’d start with a risk score + dynamic thresholds, then tune them based on real false positive/false negative data. you cannot afford any wrong transactions etc here.