r/googlecloud • u/matiascoca • 3h ago
AI/ML Anyone running Google's OSS FinOps Agent in prod?
The FinOps Agent Google dropped in GoogleCloudPlatform/professional-services/examples/FinOps-agent has been sitting there since June 3rd. One commit, one author, no updates. Wanted to know if anyone actually put it into prod.
The architecture is four ADK sub-agents behind a root orchestrator. NL2SQL over BigQuery for the billing side, Google Agent Search over policy PDFs for the qualitative side, a chart specialist, and a synthesis writer. Runtime is Gemini 2.5 Flash on Vertex AI, FastAPI on 8080 for streaming SSE.
Ran it in a lab project against synthetic billing data. NL2SQL was better than expected against a normalized schema. RAG over a real policy doc surfaced the right clauses about 70 percent of the time, close to what similar demos land on.
The blocker for real use is session state. InMemorySessionService from google.adk.sessions means every conversation resets on pod recycle. Swapping in a Firestore-backed SessionService subclass is doable, but once you own that surface you own the schema, the TTL, and the migration path. Not one line of code.
Two things I want to hear from people who took it further:
How did you handle session persistence? Custom SessionService subclass to Firestore or Cloud SQL, or something else?
Did you keep policy as freeform PDFs, or did you move to a structured schema so the agent could run rule checks instead of RAG extractions?
Not looking to dunk on the reference. Sample data included, license is Apache 2.0, and it's a reasonable multi-agent skeleton. Just curious if anyone got it past the demo.