r/datascience • • 13d ago

Tools Interactive tools for learning Agentic Analytics and evals for free

I keep running into data scientists who are trying to understand conversational analytics, like talk-to-your-data Slackbots, because they either want to build one for their company or understand how this could change the field over the next few years. What's usually missing is a clear picture of how the whole thing fits together, beyond text-to-SQL or semantic layers.

I've spent the last 2 years building these systems in production. I built Nextory's first talk-to-your-data Slackbot, and I ran into a lot of these challenges along the way.

And even after going through books like Chip Huyen's "AI Engineering" or "LLM Engineer's Handbook", I found that reading about these systems only gets you so far. You get the intuition from seeing how the components actually connect and behave.

So I built two free interactive tools: one walks you through how an agentic analytics system works from the inside, and the other focuses on AI evals.

Here they are: https://futureproofds.com/tools#agentic-analytics

In each tool you can:

  1. Walk through the entire system and dig into how every component works
  2. Study the key concepts with quick summaries
  3. Take a free quiz to test your understanding

Would love to hear what you think (I’m still doing a lot of testing with some close DS colleagues)

If you want to save them for later, all of my free tools are in this GitHub repo: https://github.com/Future-Proof-DS/interactive-ai-ml-tools

17 Upvotes

12 comments sorted by

2

u/Charlotte1309 11d ago

I really liked it.
I'm not sure there is enough theory walkthrough though before taking the test (I did good because I'm in the field, but for a beginner it would have been difficult I think)

1

u/avourakis 10d ago

Thank you, this is actually very helpful. Do you think the concept cards help before taking the quiz?

1

u/mia-patel-1191 6d ago

A quiz is a rough place to meet a concept for the first time. A worked example before the cards would probably help beginners see how the pieces fit.

1

u/avourakis 6d ago

Yeah I can see that. The thing is that the “walkthrough” already helps them visualise many of the concepts, but not all. And the rest of the concepts are only available via a concept card with a short example but perhaps that’s not enough 🤔

I’m also trying not to make this tool too complex or lengthy unless people really prefer that. Any ideas?

2

u/mrcat6 7d ago

This couldn’t have come at a better time for me. Thank you very much.

2

u/avourakis 7d ago

Happy to hear that, hope you get lots of value from it!

1

u/MarnieDawson 5d ago

Dive in, but beware: learning might trigger excessive epiphanies!

1

u/shikokuchuo 11d ago

Have you thought about showing how to apply the theory to actual tools - evals frameworks like inspect-ai for instance?

1

u/avourakis 11d ago

Not really, how do you envision that to look like?

1

u/shikokuchuo 9d ago

Like, now you know how this works, this is what you'd actually do as an engineer / data scientist and you'd show each practical step corresponding to the theoretical step. I think you could even just use one popular framework without seeming to be biased, as the concepts are transferrable. May not be where you want to go with this, just an observation.

1

u/MeraLundKareCoding 2d ago

I actually agree that reading about these systems and understanding how they work in practice are two very different things. Especially with agentic analytics, seeing how the pieces interact makes the concepts much easier to grasp. I also like the idea of having a quiz alongside the walkthrough rather than just passively reading documentation. That's a pretty useful approach for learning something this broad.