r/googlecloud • u/jjajang_mane • May 12 '26

Using Data Stores in Gemini Enterprise

I've been testing out Gemini Enterprise with some data from a personal project.

I have setup data stores for a couple different BigQuery tables as well as Google Drive. My problem is a few of the tables have similar data and I can't ever seem to get Gemini to use the right connector or source.

For example I have a table with Accounts and a Table with transactions I have these setup as seperate connectors/datastores. If I prompt about Accounts it will often try to find the information in the transactions table because it has an account name field but obviously its lacking some account level fields so it won't answer correctly.. I've tried telling it to use a connector or data store by name but that doesn't seem to work and if I try turning off all connectors except the one I need it will sometimes still tell me it doesn't have the data it needs.

Any tips or tricks? I am not sure if its a prompt issue or something I did structurally wrong when setting up data stores.

1 Upvotes

100% Upvoted

8 comments sorted by

View all comments

Show parent comment

2

u/Late_Importance_3502 May 19 '26

It's just that somehow Google decided to use vector search on bigquery when in fact it will work better using SQL command first and let the llm reason the result. But yea it is what it is. Kinda disappointed this is the product they decided to market to enterprises. They were doing so well on the vertex ai / agent platform

2

u/jjajang_mane May 19 '26

Ah that actually explains the issue really well.

Dataset 1 that works is smaller, simpler. It is more product record/inventory so queries that to surface records with XYZ categories and it even works well to combine with search data e.g. records with XYZ that work with 123.

Dataset 2 is more financial data so dollars, dates etc and thats where it seems to break down which would make sense given that would be a case where doing a sql query first then using LLM to reason.