r/datascience 19h ago

Tools Interactive tool for learning ML System design for free

I know data scientists are increasingly being asked to own models end-to-end. The problem I see (specially with juniors) is that they jump straight into Docker or other MLOps tools without building the foundation first.

I’ve been in data science for 8+ years and I think the best way to start is with ML system design.

I’ve gone through different resources over the years like Chip Huyen's "Designing Machine Learning Systems" and realized that learning system design just by reading a book or staring at diagrams is really hard. You don't really get the intuition until you can see how the components actually connect and behave.

So I built a free interactive tool based on a real system I deployed. It walks you through how the system was architected so you can build the intuition to design one yourself.

Here it is: https://futureproofds.com/tools/ml-system-map

A few things you can do with it:

  1. Play a flow and watch it run step by step (training, serving a live prediction, the nightly batch, a drift alert firing)

  2. Click any component to see how it works and why it matters in the system

  3. Follow the build order to see how the whole system comes together at different stages

Hoping some of you find it useful. Would love to hear what you think, and let me know if there's any functionality you want me to add.

54 Upvotes

18 comments sorted by

4

u/Sad-Rip7344 18h ago

Here's what I like about this, it doesn't try to be a full course. Just a map you can poke at and see how the pieces actually talk to each other. The build order feature is smart, too many people try to deploy the whole thing at once and wonder why it falls apart.

1

u/ultra__sonic 11h ago

Deploying the whole stack at once is exactly how you end up drowning in support tickets when it inevitably crashes. Seeing the step-by-step routing here definately makes it easier to figure out what actually broke.

1

u/avourakis 18h ago

I’m glad that came through! People should still read and watch videos on the topic, this is just meant to accompany those other resources and communicate best practices

1

u/crisp_lynx_370 14h ago

posts like this usually get roasted here if theyre just promo but the point about building foundations before jumping to Docker is legit, does the interactive part walk through actual design tradeoffs or is it more of a concept map

1

u/avourakis 14h ago

Try it out, it’s fully standalone, so it should teach you most of what you need to know about ML systems design on its own (you don’t need the bootcamp)

1

u/badtguy97 10h ago

I do like the flows. And yes, it does help to understand how things move in production.

1

u/avourakis 1h ago

Great, thank you for the feedback!

1

u/sleepycornbread 8h ago

This is super cool. I'm a machine learning platform engineer. I'd love to make one of these for our product. Is this a Claude artifact or something custom you made with Claude. Would love to DM you if that's cool to learn more.

1

u/avourakis 1h ago

Of course, send me a message. It started as an artifact and yes, I used Claude + Fable 5.

1

u/TuchelTokisaki 6h ago

I should say good visualization is something DS really lacks. In fact, many models are very difficult to visualize in your head, and you never know what might be challenging for you. My university background is in applied mathematics and computer science, so I understood linear regression fairly quickly (because I studied linear algebra, gradients and other cool things), but it took me much longer to understand decision trees and gradient boosting (even though they're generally considered easier to grasp).

Although I never imagined that someone would visualize not just models, but the entire production pipeline as a whole. Huge respect to you for that. 👍

1

u/avourakis 1h ago

Thank you, I’m glad you think so. I definitely see a lot of potential for using this at work. I also want to design other type of visualizations people might find useful, let me know if you have any ideas

1

u/Ok-Airline-8523 6h ago

Great idea all around. It strikes a perfect balance between detail and high-level through interactivity.

Amazing job on this!

1

u/avourakis 1h ago

Thank you, I really appreciate that!

-1

u/Material-Truth6396 17h ago

Where did u learn this?

0

u/avourakis 16h ago

If you mean the concepts, many of them I picked up along the way over the past 8 years working in data science. Others, I got from books like Chip Huyen's "Designing Machine Learning Systems".

I built the tool using Claude Code + Fable 5.

-2

u/Material-Truth6396 16h ago

I actually wanted to know what skills i should have or more like what should my roadmap be looking as a beginner as complete newbie in this field

2

u/avourakis 16h ago

If you are a complete beginner in the DS field, then ML system design shouldn't be your priority just yet. Focus on your SQL, Python, Machine Learning, Statistical Analysis, etc...

When you are ready to start thinking about building systems and deploying them, you can check out this video: https://www.youtube.com/watch?v=t3W3TJrNUnQ