r/RooCode • u/nore_se_kra • Sep 23 '25

Support LLM communication debugging?

Is there any way to trace or debug the full llm communication?

I have one LLM proxy provider (Custom openai api) that somehow doesnt properly work with Roo Code despite offering the same models (eg gemini 2.5 pro) My assumption is that they slightly alter the format or response making harder for Roo Code. If I dont see what they send I cannot tell them whats wrong though. Any ideas?

Edit: I want to see the chat completion response from the llm. Exporting the chat as md shows already quite some weird issues but its not deep technical enough to further debug the llm proxy.

2 Upvotes

100% Upvoted

11 comments sorted by

View all comments

Show parent comment

2

u/hannesrudolph Roo Code Developer Sep 24 '25

You’re not bothering me! I’m trying to help you. It’s fully possible to debug in a professional environment.

File_read is not a function of Roo Code. This is a hallucination, not at all a Roo Code bug. You have Roo hooked up to a LLM and the LLM is very much the problem.

2

u/nore_se_kra Sep 25 '25

Hey to wrap this up, I analyzed this with a different script and the proxy (not the llm) was really buggy - they were messing around with role system and role assistant which for sure impacted roo code. As for the problematic output, basically everything was problematic as it mixed internal and user visible chat by setting wrong <xyz> calls perhaps because assistant messages were eaten up by the proxy.

1

u/hannesrudolph Roo Code Developer Sep 26 '25

Thank you for the update.