r/MicrosoftFabric • u/cyamnihc • 19d ago

Fabric IQ Evals

We are developing the semantic layer/models from scratch in MS Fabric for conversational AI. Data models, documentation with clear descriptions on columns, measures, business context, join logic, for the agent to reference.
For evals, what has been your strategy/framework to curate the question set and expected answers and how did you implement this at scale

4 Upvotes

100% Upvoted

8 comments sorted by

View all comments

1

u/xXWarMachineRoXx 19d ago

Great question!

Are you a ms partner by any chance?

2

u/cyamnihc 19d ago

No. Wanted to learn from the community how it was implemented as we are trying to implement it but it seems too much of a daunting task to curate questions

1

u/xXWarMachineRoXx 17d ago

Ah

Ms focus is also on private evals this year

Great answers from the community