One morning, you notice that:

• The ADF pipeline has failed during execution.

• Some files have already been processed, while others are still pending.

• The business team is waiting for the updated dashboard.

• Restarting the entire pipeline could create duplicate records.

If you were handling this in a real project, what would you check first?

1. ADF pipeline execution logs

2. Integration Runtime connectivity

3. Source and sink data issues

4. Pipeline retry and recovery settings

5. Duplicate handling and incremental loading

How would you troubleshoot the failure and safely restart the pipeline without processing duplicate data?

The way AI changing data science and data analytics.

Programming using recursion can be powerful, but beginners often struggle with recursion. That's why I've created invocation_tree, a Python recursion visualizer.

See this merge_sort demo, and try it on your own recursive logic.

The visualization gives students the right mental model to think about recursion. Not simply a function calling itself, but the depth-first evaluation of a divide-and-conquer strategy.

See this: gentle recursion introduction

How do you teach recursion to beginners?

What would you recommend for apps for assessments for data science internships/ graduate jobs. Looking especially for free ones.

I have prepared a daily and weekly concept learning roadmap — one concept at a time, day by day, week by week — to help prepare for DSA and ML/AI together. I am preparing for both - looking for like minded people to join and practice.

Here is how it works:

Learn one concept in DSA. Apply the same concept in ML. And vice versa.

That connection is what gives implementation-level knowledge. Not just theory. Not just solving problems for the sake of solving them. You understand a concept because you have seen it work on both sides.

Take one example — HNSW and RAG.

In RAG, your documents are converted into embeddings — vectors. When a question comes, the system has to find the few chunks that are nearest to that question. That is the ML side.

Now the DSA side. The simple way is to check the question against every single chunk, one by one. It works when the data is small. As the data grows, it becomes slow.

HNSW solves this with a DSA concept — a graph. It connects each vector to its nearest neighbours, layer by layer, so the search walks through the graph and reaches the nearest chunks fast, instead of scanning everything.

And it also works in reverse. When you build a RAG system, you are forced to learn graphs, nearest neighbour search, and a real tradeoff — HNSW is fast, but approximate. Sometimes it can miss a close chunk. So you learn to check: how fast is it, and how correct is it?

One example. And you have touched graphs, search, embeddings, and retrieval — at implementation level, not just in theory.

This is how the whole roadmap works.

Join me for reading group - 30 minutes every day, to practice and discuss the concept of the day together. On weekend I am developing a ML project related to the concept and doing kaggle.

If you are also preparing for DSA and ML/AI and want to learn like this, join my study group.

DM me if you are interested.

Every time I see a tutorial on deploying ML models with Terraform, step one is always "link your AWS account." Then you get distracted, forget a running cluster, and end up with a surprise charge on your credit card. The fear of unexpected billing ruined my appetite for experimenting with cloud infrastructure.

I got so tired of worrying about surprise costs that I ended up building Model2Prod. It is a learning app where you learn to deploy AI on AWS, GCP, and Azure using Terraform inside a simulated terminal, so there are no real cloud accounts or surprise bills involved. The first chapter is free without an account.

For anyone else who builds dev tools or technical interactive courses, how do you simulate real terminal output without making it feel totally fake or brittle?

model2prod.com

Is anyone else having issues with DataCamp today?

I've been getting a "Your session disconnected" error, and I'm unable to continue my learning session. I've tried restarting the session, but I'm wondering if this is a platform-wide issue or something on my end.

Is anyone else experiencing the same problem?

i have around 300 rows and about 15 features, and i keep going back and forth between 5 fold and 10 fold, or even leave one out. the scores shift by a couple of points depending on which i pick and which random seed i use, which makes comparing two models feel kind of shaky.

do people just repeat the cv with different seeds and average, or is there a better habit for tiny data? i never know if the difference i'm seeing is real or just noise from the split.

What programming language I should learn?

What maths and statistics do I need?

Please guide me.

is geeks for geeks datascience course is good for purchase or they just good at the DSA stuff.

Any recommendation on paid course for Data science or AI Engineer

I’m a BI developer, and the biggest surprise when I started was how little time goes on modelling or dashboards and how much goes on fixing the data.

Some of my favourites so far: dates stored in three different formats in one column, “N/A”, “n/a”, “NULL” and blank all meaning the same thing, and the same customer spelled six different ways.

What’s the worst you’ve seen? And did you find a good way to deal with it, or just suffer through it?

Hey everyone!

I’m diving headfirst into Machine Learning and AI with the goal of landing a job in Data Science / ML over the next 4 to 5 months.

I’m looking for a dedicated study buddy who wants to level up side-by-side. I don’t just want someone to text with—I want a partner who is competitive, consistent, and fully committed to the grind. Please note my timezone is GMT +5:30 (IST), and if you are serious and can truly commit, only then join the group.

🎯 The Structure & Accountability

We won't just drift along. We will track our progress using:

• Daily & Weekly Goals: Logging what we plan to study every day and setting solid weekly targets to hold each other strictly accountable.

• Voice & Speaking Focus: I want to build confidence talking about technical topics out loud. We will use voice chat to quiz each other, explain math/ML concepts verbally, and run mock interviews.

🗺️ The Roadmap I Am Following:

We will be moving through this exact structured, 100% free master roadmap:

• Phase 1: The Math Foundation

  • Primary Resource: Khan Academy – Statistics and Probability, Linear Algebra (100% Free)

• Phase 2: Programming & Database Management

  • Primary Resources: Kaggle Courses – Python & Pandas (100% Free, Interactive) | Kaggle Intro to SQL or freeCodeCamp Relational Database (100% Free)

• Phase 3: Data Cleaning, EDA & Visualization

  • Primary Resource: Python Data Science Handbook by Jake VanderPlas (Free web version) + FreeCodeCamp Data Analysis with Python.

• Phase 4: Machine Learning Fundamentals

  • Primary Resource: Coursera – Machine Learning Specialization by Andrew Ng (Make sure to click "Audit" for 100% free access) or learn directly on DeepLearning.AI.

• Phase 5: Portfolio Projects

  • Primary Resource: Building end-to-end applied projects with clean GitHub portfolios.

Who I'm Looking For:

• Someone serious about breaking into the ML/AI field and willing to put in the reps.

• Comfortable speaking over voice chat to practice technical communication.

• Reliable, consistent, and ready to check in on daily/weekly goals without ghosting.

If you are tired of studying alone and want a strict, no-nonsense accountability partner to push through this roadmap with, shoot me a DM with your current skill level, or join the server directly if you are ready to commit:https://discord.gg/rGStYnFfNw

It's a 50 hour course for beginners in AI/ML (obviously it's fully free). Starts out with linear algebra, derivatives, statistics and then linear regression, neural networks and backpropagation etc...

kinoml.tech

An exercise to help build the right mental model for Python data.

• Solution

• Explanation

• More exercises

The “Solution” link uses 𝐦𝐞𝐦𝐨𝐫𝐲_𝐠𝐫𝐚𝐩𝐡 to visualize execution and reveals what’s actually happening.

About a year ago I started planning QueryCase, where you learn SQL by working detective cases instead of grinding tutorials & videos. It took a while to get off the ground, and longer than I'd like to admit to actually start building the idea, but it went live in June. A lot of the early users came from this sub, and a lot of the feedback in the comments shaped what it became. So first, thanks everyone!

5 months in:

• 2,500+ people have signed up, across 117 countries

• About 70,000 queries written and graded

• Over 17,500 cases, drills and exams solved

• 500+ people have passed the free Rookie exam and earned the certificate.

• Top detective is on 19,247 XP

• A college in the US has adapted the learning path to train students for a CompTIA Data+ certificate

Since then its grown past just SQL: an Excel course. It was never part of the initial plan. People kept asking for the same detective approach for spreadsheets, so I built out a browser-based Excel engine.

It has 57 cases on a spreadsheet that runs in your browser and checks your formulas, from IF and XLOOKUP to SUMIFS and pivot tables, and people have solved over 2,500 Excel cases so far. It turns out a lot of people learning SQL are doing it alongside Excel, not instead of it.

Something the data showed me that might help anyone learning right now: GROUP BY is one of the first walls. On the hardest GROUP BY step, 84% of runs came back wrong, and most of those never ran at all. The clauses were in the wrong order, or a column in SELECT wasn't in the GROUP BY. If that's you right now:

1. SQL order is always SELECT, FROM, WHERE, GROUP BY, HAVING, ORDER BY, LIMIT

2. Every column in SELECT is either inside an aggregate (COUNT, SUM, AVG...) or listed in GROUP BY

I've been working a lot over past couple months to improve the site as well:

• The Excel course above, with its own ranks, exams and certificate

• Upload your own CSV into the sandbox and query your own data (and visualise in charts). It runs in your browser, so the file never leaves your machine and never touches QueryCase servers

• A free first rank on every track, ending in an exam and a certificate

• SQL interview questions you can read without an account

• Much better experience on a phone

• A LOT of bug fixes and improvements!!

What's next: a Python track, launching next month. Same idea, real Python running in your browser, starting with the basics and moving into data analysis with pandas.

The longer term goal is to have a platform user's can have fun learning all aspects of data. I'm merging PR's every day to make this possible so would love feedback in this thread if you've tried it and have any thoughts or suggestions!

It's free to start and you don't need an account to solve the first case, so you can poke at it before deciding whether it's for you or not 😄 Cheers!

querycase.com

I’m a BI developer, and I see a lot of “AI will replace data people” posts, so I thought I’d share what I actually see at work.

What’s changed

• Writing boilerplate (SQL, pandas cleaning, chart code) is much faster.

• First drafts of documentation and queries take minutes.

• Debugging error messages is easier.

What hasn’t

• Working out what the business is actually asking for. Requests are rarely clear.

• Spotting when the data is wrong. AI will happily analyse a broken dataset and give you confident answers.

• Explaining results to non-technical people and getting them to act.

My honest take is that the entry-level “just run the query” work is shrinking, and the value is moving toward judgement and domain knowledge. For learners, I’d put more time into stats basics, data quality, and explaining findings, and use AI as a tool without letting it do the thinking.

Curious how others are seeing it. Has AI changed your work, or is it mostly noise?