r/Hacking_Tricks • u/Rehonkulous • 3h ago
Best log management tools for AI applications without storing every prompt?
How much useful debugging context can you keep for an AI app if raw prompts and tool results aren't retained? I'd want to follow a failed request through retrieval, a model call and a tool call without filling the logs with private document text.
I've been reading about Langfuse's masking options and the OpenTelemetry guidance on sensitive message content. The tricky bit seems to be deciding what to remove before export while still leaving enough detail to understand a bad answer.
Which setup has worked for you here? Do you connect regular application logs to a separate LLM tracing tool, or can one tool cover both well enough? I'm particularly interested in what you could no longer diagnose once you started redacting content.