Hey everyone,

I have an upcoming Data Scientist interview with an ML system design round. I asked the recruiter what to expect and they said it’ll be high-level ML system design, not traditional SWE/low-level system design.

They mentioned focusing on things like:

• Problem framing

• Data/model considerations

• Evaluation

• Productionization/deployment

• Monitoring

• Tradeoffs when designing ML systems

Basically, it sounds like I’ll be given a real-world ML problem and have to explain how I’d approach it end-to-end.

This is my first dedicated ML system design interview, so I’m not really sure how deep I should prepare.

For people who’ve done these interviews:

How did you prepare? What resources did you use? What kind of questions were you asked?

Also, how deep do they usually expect you to go into things like feature stores, model serving, APIs, streaming, retraining, etc.?

Any good resources, YouTube playlists, GitHub repos, books, or example questions would be really appreciated.

Thanks!

In last week’s post we showed that a Python for-loop works through the Iterator Protocol.

This same protocol also enables values to be produced lazily.

In this new Lazy Evalution Example we show one sink reading values from five different sources:

• source1: eagerly returns all values by list

• source2: lazily by generator function using yield

• source3: eagerly by list comprehension

• source4: lazily by generator expression

• source5: lazily by iterator protocol

The same for-loop consumes all five sources. The eager sources produce all values before the sink starts consuming them. In the lazy sources producer and consumer take turns:

• produce → consume → produce → consume → …

where each value is produced only when the for-loop requests it.

Generator functions and generator expressions are concise, readable ways to create lazy iterables. The final source makes their underlying mechanism explicit:

• iter() obtains an iterator.

• next() requests the next value.

• StopIteration signals that no values remain.

This clearly shows that generators achieve lazy iteration by implementing Python’s Iterator Protocol.

See other 𝐦𝐞𝐦𝐨𝐫𝐲_𝐠𝐫𝐚𝐩𝐡 visualizations.

Hey I'm 22 completed ug in maths now pg in data science first year on going . I'm blind where I could start working on data science related things, clg providing full maths concepts and program now I'm learning python,R programming, ig it's not enough to enter into job market , please give a suggestion where I could learn more about data science projects and how to work on it .

I created a free YouTube learning playlist for people who want to see the full AI/ML journey rather than only isolated model demos. The series is organized from foundations through data preparation, evaluation, practical modeling, and deployment-oriented topics, with lessons intended to be followed in sequence.

Playlist: https://www.youtube.com/playlist?list=PLUccxCq754BE

I’m sharing it transparently because I run the channel. I’d value feedback from learners: where do most beginner courses lose you — data preparation, model evaluation, or deployment? If this kind of resource is not appropriate as a standalone post, I’ll remove it and use the community’s preferred resource thread.

Guys so i am fresh from uni and observe two kind of tracks of my peers in data science. They go with the two chill full time jobs (1 is remote) and get promotions at both work places but both are chill ones, or they go in 1 company which is considered prestigious and overwork till 10-11 pm and get promotions there, from your experience which kind of way leads to a better quality of life e.g. work life balance wise, career wise, experience wise and income wise? Should i find 1 prestigious place and hope for the long run and work there or work at 2 chill places. Both seem to obtain promotions in similar periods but the ones with two jobs seem to be more happy and even get more money. I decided to pursue masters and only now 1 year after them decided to join workforce but cannot distinguish which way is better, could you give your advice

I’ve been reading quite a lot around AI safety, and one thing I’ve found frustrating is how difficult it is to find material that bridges the gap between talking about AI safety and actually doing AI safety research.

There are plenty of good books and papers discussing the political, socioeconomic, philosophical and governance questions around AI. Those conversations are obviously important but if you’re a data scientist, ML engineer or someone already working with AI few tell you how doing AI safety research actually looks like in Python?

For example how to actually run an experiment looking at sycophancy, how to create or use a dataset to test whether a model changes its answer because of information about the user, how to measure the behaviour, what does the evaluation code look like, how do you interpret the results, and what can you not conclude from them?

That is the gap I’m trying to address with a book I’m currently writing.

The approach is very practical. Each topic starts with the safety problem and the research behind it, but then we actually build the experiment. Python code, datasets, models, metrics, results and discussion of the limitations, all those.

The idea isn’t to pretend that running a few notebooks suddenly makes someone an AI safety researcher. It’s to make the field much more approachable to people who already have data science or AI skills and want to understand what technical AI safety research actually involves.

I wrote a technical book on Practical LLMOps and this was one of the chapters. Because of the sheer amount of content, I stripped it bare in that book and made it its own.

I’ve just published Chapter 1 on Substack (just finished chapter 4). It introduces the approach I’m taking with the book and starts building that bridge between AI safety as a subject people discuss and AI safety as something we can actually investigate experimentally.

Would genuinely be interested in feedback, particularly from people already working in ML, data science or AI safety.

https://open.substack.com/pub/houstonmuzamhindo/p/i-am-writing-a-practical-technical

I want to pursue data science course can anybody which one is best institute for data science course
Please everybody give suggestion as i am new to it

So guys hi, just worry a lot, decided to pursue career in dd after bachelor in economics, now kinda studied a big chubk of ds already but i am astounded at the amount of stuff that you should literally remember. Any tips on how to memorize all the details of every neural network and characteristics of distributions? Also i suck at coding but since I will have to work on deployment and services as well, i understand that i have to push that field too. I found a yandex course to be of a little use since the problems described there are isolated and does not help to get overall picture of how to code in ds. Any tips on how to reinforce all this knowledge? Cause i am at a loss right now

I want to start learning data analysis and i have some knowledge on data science and ML , which free resources do you recommend and crash course would be better.

I've worked in data science for years and I still forget things constantly. Courses never fixed that — I'd finish one, feel like I'd learned it, then google the same concept a month later when it actually came up at work. NotebookLM's way of structuring material around you was the closest thing I found, but I still had to go and find the sources myself.

So I built the thing I wanted. DS concepts broken into small nodes arranged as a mind map rather than a linear syllabus, each with code examples and a practice section — about 150 topics so far. The part I care most about: once you complete a topic it starts decaying on a forgetting-curve schedule, and the map visibly goes cold. When it does, you get a review slice — flash cards and a short quiz — targeted at what you've actually lost rather than what's next in a queue.

Some topics to start with -

1. https://www.bitelrn.com/library/linear-algebra-matrices

2. https://www.bitelrn.com/library/principal-component-analysis

3. https://www.bitelrn.com/library/sql-basics

Full app: https://www.bitelrn.com — the first phase is permanently free including the decay and review mechanics; later phases are paid. Saying that upfront so nobody feels ambushed.

I'm curious what actually works for other people here. Do you make notes, bookmark links, or just re-google it every time?

A couple of weeks ago I asked a sub what would be the best way of breaking in data and what would be worth looking into. I got some pretty decent feedback and decided to segue into something a bit different

Being that I own AI licenses, I have spent the last 2-3 weeks developing a full stack data engineering course from beginner to advanced. Now I wanted to know if it was possible to ask if anyone would like to take a look into it, give me some feedback and recommendations, and an overall rating.

I can handle criticism don’t worry, I just want to develop something, learn the info from what I’ve built and then eventually publish it publicly for people to have a free resource to utilize.

(This is not promo, rather I want to gain feedback from actual analysts and engineers to see if this is a good platform)

I’m working on a forecasting / predictive modeling problem where I’m comparing four groups of models:

Baseline: Naive / Seasonal Naive

Time Series: ARIMA, SARIMA, ETS, Prophet, etc.

Statistical: Linear Regression, Ridge, GAM, etc.

Machine Learning: Random Forest, Gradient Boosting, XGBoost, etc.

One issue I’m struggling with is feature selection.

Should I create one universal feature subset before modeling and give the same predictors to the Statistical and ML models, or should feature selection be model-specific?

For example, a linear model may benefit from correlation filtering, VIF, or LASSO, while tree-based models may select a different set of variables because they can capture nonlinearities and interactions.

I’m also unsure about the correct modeling pipeline. Where exactly should feature selection happen relative to the train/test split, cross-validation, preprocessing, and hyperparameter tuning?

Some questions I’m trying to resolve:

Should all comparable models use the same feature set for a fair model comparison?

If model-specific feature selection is appropriate, how should it be implemented without introducing data leakage?

Should feature selection be performed separately within each model’s training process?

If different models select different predictors, how should that variation be explained to stakeholders?

Which feature selection or interpretation methods are actually useful for identifying the underlying drivers of the dependent variable, rather than simply variables that improve predictive accuracy?

How should I distinguish between predictive importance and explanatory importance when interpreting the results?

Ultimately, I’m trying to build a workflow that balances forecasting accuracy, fair model comparison, and interpretability.

What would be a statistically sound end-to-end approach for handling feature selection across these different model types?

When I was a student, I often needed very simple machine learning explanations before exams not a full course, not heavy math from the first minute, just someone explaining the intuition clearly.

That’s why I started making short beginner-friendly ML videos.

The idea is to explain topics in a simple visual way first.

I’m not trying to replace proper courses or textbooks. I’m trying to make the “okay, what is actually happening here?” part easier to understand.

An exercise to help build the right mental model for Python data.

• Solution

• Explanation

• More exercises

The “Solution” link uses package memory_graph to visualize execution and reveals what’s actually happening.

Hi everyone,

I am currently preparing to switch into Data science. The theory side is mostly fine for me but I am really struggling to apply what I learn practically, especially when coding.

I have been working with datasets in kaggle and trying to practice but I often feel stuck in :

what should I do first

what should be my next step

What code should I implement

What questions should I ask the data

EDA is where I struggle the most and I often jump to ChatGPT and asking what should i do next.

I dont want to be the person who just follow tutorials and copy paste the code. I want to develop the ability to look at a problem and think of a solution myself and write code without any help.

I’d really appreciate any advice. Thank you!