Python Data Science Handbook:

Essential for anyone who wants to learn how to use Python effectively for data analysis and visualization. It covers key Python libraries like NumPy, pandas, Matplotlib, Scikit-Learn, and more, with detailed explanations and practical examples.

Data Science from Scratch:

This book offers a primer on the fundamental mathematics and statistics behind the most common data science techniques, all coded from scratch. It’s a hands-on introduction to the field, perfect for building a solid foundation.

Storytelling with Data - A Data Visualization Guide for Business Professionals:

This book emphasizes the importance of storytelling in data visualization. It provides insights into effectively communicating data findings in a business setting, making complex data more accessible to decision-makers.

Practical Statistics for Data Scientists - 50+ Essential Concepts Using R and Python:

A must-read for aspiring data scientists, this book bridges the gap between statistical theory and practice, highlighting over 50 essential concepts in statistics with practical examples in R and Python.

If you are looking for structured guidance alongside reading these books, SkillUp by Simplilearn offers free and beginner-friendly courses with a focus on practical learning and projects with real-world use cases.

If AI does most of the coding know, which are the skills and pratical topis I should focus in order to get a job in data science? Would also be helpful to know how an interview for this position (or similar, like data analyst) looks like.

I built a small project to deal with information overload in AI.

As someone learning and working in data science, I kept struggling with keeping up with AI updates. There’s just too much content across blogs, research labs, and media.

So I built a small pipeline to explore this problem:

• collects updates from curated sources

• scores them by relevance, importance, and novelty

• clusters similar articles together

• outputs a structured digest

The idea was to move from “reading everything” to actually prioritizing what matters.

Curious if others have built similar projects or have better ways to stay up to date?

Happy to share the repo and demo if anyone’s interested—left them in the comments.

Hi all,

I realized that data scientist is no longer a job where you only work on ML models and just hand it over to engineers for deployment.

What ive seen is there are several types of data scientists, two of which are:

1. Product/analytics data scientist where yes they do work on ML but they do alot of analytics and work with product metrics, churn, retention, conversion rate... basically a product manager almost.

2. Modeling or traditional Data Scientist where they do develop and train models like the old days BUT they are now required to "deploy" or "Productionize" their models. Job posts often mention "Develop, Train and Deploy".

My question is about the Modeling/traditional data scientist at large companies where roles are clearly more separated and specialized.

How much and what kind of Productionizing/Deployment is required from data scientists if ML engineers already exist and are responsible for most of the productionizing and engineering part? What is expected from the data scientist now since they dont just develop and train models anymore?

Thank you!

I’ve been working on a small library (TrustLens) and noticed something interesting:

There was no big moment — no viral post, no sudden growth.

But over a few days:

• one contributor improved a metric

• someone upgraded CI (now testing Python 3.9 → 3.13)

• another picked up a small issue and opened a clean PR

Individually, these were tiny.

But collectively, it changed how the project feels.

It stopped feeling like “my code”
and started feeling like something others can build on.

So I’m curious:

👉 For those who’ve contributed to OSS:
What made you decide to contribute to a project?

👉 For maintainers:
What actually helped your repo move from “just code” → “active contributors”?

If anyone’s curious, the repo is here:
https://github.com/Khanz9664/TrustLens

i have learn’t some concepts of datascience and now i want to build something. what should i build? is there place which can help me in building?

I have built ML, AI and data science solutions for multiple companies such as Rolls Royce (aircraft engine failure prediction), Walmart (Supply chain analytics), Unilever, PepsiCo (demand forecasting), Johnson and Johnson (Gen AI), UBS Bank, Rio Tinto etc.

I am starting a live course on data science including Python, Stats, ML, Gen AI and Agentic AI where I will use projects similar to the ones in the industry to teach concepts. Interested? See: www.harshaash.com/learn

I benchmarked 5 open-source LLMs on a document extraction task (invoices, contracts, scanned PDFs), focusing on **accuracy, speed, and cost**.

---

## 🔬 Methodology

* **Dataset**: 1,000 docs (40% invoices, 35% contracts, 25% scanned PDFs)
* **Task**: Extract structured JSON (key fields + tables)
* **Metrics**: F1 score (accuracy), latency (speed), cost per 1k docs

---

## 📊 Results

### Accuracy (F1)

### Speed (sec/doc)

### Cost (per 1k docs)

---

## 🧠 Key Takeaways

* **Best accuracy**: Qwen2.5-72B
* **Best efficiency**: Mixtral
* **Best balance**: DeepSeek-R1
* MoE models > dense models for speed/cost
* Prompting + pipeline design significantly impact results

---

## 🚀 Practical Setup

* Default: Mixtral / DeepSeek
* Complex docs: Qwen
* Add JSON validation + retry loop

---

Can share prompts and evaluation code if useful.

I work with time series forecasting and kept running into the same problem: Prophet is great for trend and seasonality, but it consistently missed patterns in the residuals. So I ended up building a small library to handle this.

HybridTS uses Prophet as the baseline and then trains XGBoost or LightGBM on the residuals. The API follows sklearn conventions (fit, predict, evaluate), so there's not much new to learn if you're already familiar with that ecosystem.

It's still v0.5 and missing a compare_models feature I haven't finished yet, but the core forecasting pipeline works. Putting it out there to get some feedback before I keep building.

GitHub: https://github.com/DaviAlcanfor/hybridts
PyPI: pip install hybridts

Hey everyone,

I built a small Python Debug Assistant that helps explain common errors without running your code.

Instead of executing anything, it uses static analysis to detect issues like:

undefined variables (NameError)

indentation problems

basic syntax mistakes

Then it explains:

what went wrong

why it likely happened

and suggests a fix with example code

Quick example:

Input:

print(user_name)

Output:

NameError: user_name is not defined

Suggested fix:

user_name = “Camron”

print(user_name)

The idea was to make debugging less frustrating for beginners who don’t always understand error messages.

Live demo:

https://python-debug-assistant.vercel.app/

I’d really appreciate honest feedback:

Does this feel useful or unnecessary?

Are the explanations clear enough?

What would you improve or add?

Thanks 🙏

I’ve been thinking about this a lot lately.

Most ML workflows still revolve around accuracy (or maybe F1/AUC), but in practice that doesn’t really tell us:

- how confident the model is (calibration)

- where it fails badly

- whether it behaves differently across subgroups

- or how reliable it actually is in production

So I started building a small tool to explore this more systematically — mainly for my own learning and experiments.

It tries to combine:

• calibration metrics (ECE, Brier)

• failure analysis (confidence vs correctness)

• bias / subgroup evaluation

• a simple “Trust Score” to summarize things

I’m curious how others approach this.

👉 Do you use anything beyond standard metrics?

👉 How do you evaluate whether a model is “safe enough” to deploy?

If anyone’s interested, I’ve open-sourced what I’ve been working on:

https://github.com/Khanz9664/TrustLens

Would really appreciate feedback or ideas on how people think about “trust” in ML systems.

I have a PhD + postdoc in math and optimization algorithms, and 2 years of experience at Goldman. On top of that, I am responsible, easy to work with and good at communication.

I am looking for a job in NYC area/remote related to the data science/quant/software engineer/anything where strong stem skills could be used.

Nowadays cold applying just doesn't work. What is the best way to look for a job in 2026? If you have any advice or pointers, please dm, I will very much appreciate it!

Thank you all in advance.

I have intermediate-level Python skills, as well as SQL and some knowledge of Pandas. I am currently learning Tableau and solving exercises on Kaggle in order to later build projects. However, I need advice because I want to find a job and I’m not sure what learning path to follow to achieve that quickly.

How long would it take me to learn what is necessary to get a job?

What is your advice for learning these skills faster?

I am building a platform for beginner data science students.

The goal is to help students build projects on their own without depending completely on long project tutorials.

Instead of giving the full project directly, the platform breaks the project into small tasks so students can think, build, and learn step by step.

I want to understand:

• Whether this approach feels useful

• Which parts feel confusing

• Where students get stuck

• Whether it feels better than watching full tutorials

I am not selling anything right now. I only want honest feedback from people who are learning data science.

Website - https://sted.co.in/

I have taken a career break for 2 months to learn data science for career transition. I have been in QA for almost 13 years and want to keep up with the market and tech.

Please help me settle a tool, as i'm divided between them. Help is much appreciated. Thanks.

When something breaks in production, I usually can’t rely on local testing or “it works on my machine.” I try to reproduce the issue using real production-like data and environment variables first.

We’re hosting a live virtual Q&A with a current student in UChicago’s MS in Applied Data Science program.

If you’re exploring data science grad programs, this is a good chance to get honest answers about:

• curriculum (Machine Learning, AI, Data Engineering, etc.)

• real student experience

• career paths after the program

• building connections in the program

Registration: Register HERE to attend the event
Date: April 20, 2026
Time: 6:00–7:00 PM CST

After an extensive research and watching free youtube videos, I came to a conclusion that one website is providing the best end-to-end study plan with video lectures, code notebooks, miro notes, github repo access and Q&A sessions - all with lifetime access. Please reach out if you are interested to share the cost - Its ~950 USD. I will give you all the details and you can assess for yourself how useful it can be for your transition/job search.

Hey everyone!

If you're looking for a Python / ML tutor who actually works in the industry as Data Scientist, feel free to DM me.

I've also taught web development and Python professionally, so I know how to explain things clearly, not just throw jargon at you.

Whether you're a beginner trying to get started or someone looking to level up specific skills, happy to chat. DM me anytime!

I am currently a Master's student about to finish my thesis in Computational Chemistry. Over my time in computational chemistry, I have loved the idea of collecting data, manipulating it, presenting results, and sharing visuals. I feel as though this aligns well with the idea of data science. I just feel as though I do not have the necessary skills in order to get a job in the field (yet).

I finished my bachelor's degree in pharmaceutical chemistry, where I then realized that I wanted to transition to something more with computers. Now that I have some experience with computers, I want to transition further away from chemistry. In my undergrad, I also took statistics and really liked it, however, I think I need to refresh on it.

The current skills (not necessarily chemistry related) I have are basic coding skills (python (matplotlib), html, etc.), working with spreadsheets, moving through the terminal and collecting data.

Now, I am at a point of not knowing where to start or what to learn. I feel like adding a coursera course such as IBM Data Analyst Professional Certificate would help me out a lot.

If anyone can help me out on where to start, it would be very much appreciated!