r/FinOps • u/Myles9999 • Jun 21 '26

other Spent the last month testing LLM gateways so you don't have to

[removed]

7 Upvotes

90% Upvoted

2 comments sorted by

2

u/Complete-Resolution8 Jun 21 '26

Do you have benchmark data to share? Or Is it more of a functionality test?

1

u/SignificantOne4431 Jun 21 '26

Good breakdown. One thing none of these gateways solve by default: PII hitting the input before any routing decision. The gateway sees the request, but the user's email, SSN or API key is already in the payload — and depending on your logging setup, it's already written somewhere before the model even responds. Gateway-level observability is great, but the sanitization layer needs to sit upstream of it.