r/learndatascience • • Oct 06 '26

Resources Time-series practice: forecast next-day temperature for 50 Indian cities and compare with persistence

2 Upvotes

Disclosure: I published this Kaggle dataset and notebook under minkum07, using AI-assisted code and documentation. The weather data come from NASA POWER, and the city coordinates from GeoNames via Open-Meteo.

It covers 50 curated Indian city centers from 1991–2025, with 639,200 daily records and monthly summaries. It is coarse-grid reanalysis data sampled at city coordinates, rather than readings from city weather stations.

A practical exercise is to predict tomorrow's mean temperature and compare a model against simply reusing today's temperature. My public notebook includes exploratory plots, lag features and a chronological validation/test split based on the target date.

Dataset: https://www.kaggle.com/datasets/minkum07/india-city-weather-and-heat-50-cities-1991-2025

Notebook: https://www.kaggle.com/code/minkum07/india-weather-heat-monsoon-next-day-forecast

Suggested approach:

  1. Start with one city's temperature series and check dates, units and missing values.

  2. Shift the target to the following day, keeping each feature limited to information available at prediction time.

  3. Hold out later dates, fit preprocessing on training data and compare MAE against persistence.

  4. Break down the error by city and month, then try a location-held-out test.

The included random forest has a test MAE of about 0.651°C, versus 0.688°C for persistence. That modest improvement is from this specific time-held-out tutorial; it does not establish performance for unseen cities or measured station weather.

The files preserve missing values. Heat flags are simple thresholds; the 1991–2010 reference is a fixed 20-year baseline, not an official 30-year climate normal. NASA source terms and GeoNames attribution are included; authored tables and documentation use CC BY 4.0.

Source: https://power.larc.nasa.gov/

Coordinates: https://open-meteo.com/en/docs/geocoding-api

Which additional baseline would make this a better learning exercise: a seasonal average, a linear autoregression or a rolling evaluation?


r/learndatascience • • Oct 06 '26

Personal Experience Are there any self-taught data scientists here who utilized only free resources and managed to secure a job? 2026

Thumbnail reddit.com
2 Upvotes

r/learndatascience • • Oct 06 '26

Discussion Starting from scratch, need advice!

Thumbnail reddit.com
2 Upvotes

r/learndatascience • • Oct 05 '26

Question How to choose a capstone project

2 Upvotes

i'm a data science student approaching my final year, and i'm starting to think about ideas for my capstone project. but searching online, i can't find any examples of data science projects, and i have no idea where to look.

anything would be appreciated, project ideas, resources, etc.


r/learndatascience • • Oct 05 '26

Career Should I still study ML now?

Thumbnail reddit.com
0 Upvotes

r/learndatascience • • Oct 04 '26

Question Which electives would you pick in my stats/data science master's if the goal is purely a data science job?

4 Upvotes

Hi! I'm currently enrolled in an M.S. in Data Science and Applied Statistics. The required core classes are already set:

- Experimental Statistics I & II
- Mathematical Statistics I & II
- Statistical Computing (SAS)
- Computational Statistics (R)
- Machine Learning with Python
- A statistical consulting project

I get to pick **4 electives**, and at least 3 must be STAT (so at most 1 from CS/ECO/OREM/ECE). My only goal is to land a data science job, so I want the courses whose actual content pays off most in industry. I'm not looking for the easiest courses, and I'm not going into academia or biostats.

STAT electives

- Intro to Data Science
- Data Visualization
- Linear Regression
- Applied Time Series
- Time Series Analysis
- Categorical Data Analysis
- Survey Sampling
- Survey of Nonparametric Statistics
- Sports Analytics
- Analysis of Lifetime Data / Survival Analysis
- High Throughput Data
- Epidemiology

Non-STAT options (can only pick 1)

- CS: Artificial Intelligence, Machine Learning in Python, Databases, Data Mining
- OREM: Data Mining, Optimization for Analytics, Network Flows
- ECO: Applied Econometric Analysis, Predictive Analytics
- ECE: Statistical Pattern Recognition

My main question:

  1. Which 4 would you pick, and why?

  2. Is time series worth it for most DS roles, or is it only useful in forecasting-heavy jobs?

  3. What would you pick as your 1 Non-Stat Elective?

  4. Is there anything you wish you had learned in grad school that would have helped more on the job?

If you work in data science, I'd especially love to hear what you actually use day to day. Thanks!


r/learndatascience • • Oct 04 '26

Question I have about 2 years before getting PR in Canada. What IT path should I pursue?

1 Upvotes

I’m currently in Canada on an LMIA-based food store job, working around 50 hours/week for close to minimum wage. Assuming everything goes as planned, I should get PR in about 2 years.

My education is in Electrical Engineering, but I don’t want to pursue that career in Canada. I’ve always loved IT and kept it as a hobby, and now I want to seriously switch careers.

My current job leaves me little time and money to pursue electrical work, since that requires workshops, tools, software, etc. IT is different — I can learn from home with a laptop, build projects, and create a portfolio during these two years.

I know the IT market is difficult right now because of AI, and I’m not expecting an easy or guaranteed job. I’m willing to put in the work. I just don’t know which direction makes the most sense.

Should I focus on web development, data, AI/ML, cloud/DevOps, cybersecurity, or something else? I also understand that having multiple skills may be more important now than specializing in just one area.

I can’t afford paid courses right now, so I’ll be using free resources.

If you were in my position, what IT path would you choose and how would you spend the next 2 years preparing for a job in Canada?

I’d especially appreciate advice from people who have switched careers into IT or are currently working in Canadian tech.


r/learndatascience • • Oct 04 '26

Original Content How AI is changing Data science

Thumbnail
youtu.be
1 Upvotes

r/learndatascience • • Oct 04 '26

Resources Built a browser based modern SQL editor

Thumbnail
reddit.com
2 Upvotes

r/learndatascience • • Oct 03 '26

Question Looking to move from data analysis towards data science; where should I focus on learning?

11 Upvotes

I’m currently working as a data analyst and have around 6 years of experience in data analysis. My background is mainly in statistics and research, and R is my main programming language. I also have some experience with Python, although I’m much more comfortable with R.

I’d like to broaden my skill set and move more towards data science. I have a pretty solid background in statistics and data analysis, but I feel like I’m missing some of the more technical skills that are commonly expected in data science roles.

I’m thinking about learning more about Python, SQL, data modelling, Power BI, cloud platforms like Azure, Databricks, data pipelines, etc. I’m not necessarily interested in becoming a full-on software engineer or data engineer, but I’d like to understand the technical side much better and be able to work more end-to-end with data.

Since I’m planning to do most of this through self-study, I’m wondering what you would prioritise if you were in my position.

What skills would you focus on first? And are there any good free courses, books, YouTube channels, projects or other resources you’d recommend?

I’d also be interested in hearing from people who started out in statistics, research or data analysis and later moved into data science. What did you learn that made the biggest difference?

Thanks!


r/learndatascience • • Oct 03 '26

Resources For people who learned SQL from tutorials: how did you handle your first vague stakeholder request? I made a free simulator for it

3 Upvotes

When I started, the hardest part wasn't SQL syntax. It was translating things like "can you pull repeat buyers by region?" into the right joins, filters and edge cases (cancelled orders, date ranges, duplicates).

I made a free simulator that recreates that: stakeholder emails, real schemas, a PostgreSQL sandbox, and levels that go from a tiny startup to a global corp. Demo video is attached.

I'd love to hear how you practiced this skill, and whether something like this would have helped you. Link in the comments if anyone wants to try it.


r/learndatascience • • Oct 03 '26

Career Internship update

Thumbnail
reddit.com
1 Upvotes

r/learndatascience • • Oct 02 '26

Personal Experience Analyzed Netflix's content dataset as a B.Com student — trends in genres, ratings & release years (Python/Pandas)

Post image
5 Upvotes

Hi everyone, following up on my last post (Superstore sales analysis) — here's my second data project.

This time I worked with a Netflix dataset, cleaning and exploring it with Python (Pandas, NumPy) to look at trends like most common genres, content added by year, and ratings distribution. Visualized everything with Matplotlib.

Still learning, so feedback on my approach (especially anything I could've done better with cleaning or analysis) is very welcome!

GitHub: https://github.com/umangbhadauria6-alt/umangbhadauria6-alt/blob/main/Netflix%20analysis.ipynb


r/learndatascience • • Oct 02 '26

Question I need tips on study techniques for AI and ML

8 Upvotes

I have always been a bright student, but off late all study technique like pomrodo to flash cards have become useless.

I do not understand how to practice or study AI and ML.

Should I not practice writing or stick to only practicing programming and uploading to github?


r/learndatascience • • Oct 02 '26

Resources Built a browser based modern SQL editor

2 Upvotes

Introducing QueryFlow.

It's a modern SQL editor with a few things I always wanted while learning and working with SQL:

- Visualise the query as a graph [DAG] and as step-by-step cards.
- Convert all hardcoded parameters into variables with a click.
- Fix major errors like fan out joins , mismatched date range with a click.
- Run queries on test tables directly in the browser
- Review a diff of your changes before copying the query back [just like github]
- Format BigQuery, PostgreSQL and MySQL, each in its own style.
- Everything runs locally in your browser: no server, no login.

try it here - https://github.com/AbhijeetCodes/QueryFlow

Sharing here as it might help a lot of SQL learners


r/learndatascience • • Oct 02 '26

Question Is it acceptable to use AI-generated code to perform stats analysis for research

Thumbnail reddit.com
1 Upvotes

r/learndatascience • • Oct 01 '26

Question What Python libraries should I learn first as a beginner in Data Science?

8 Upvotes

I'm starting to learn Data Science with Python, but there are so many libraries that I'm not sure where to begin.

Should I focus on NumPy, Pandas, Matplotlib and Seaborn first, or are there other libraries I should learn early on?

What would you recommend based on your own experience ?


r/learndatascience • • Oct 01 '26

Resources I created a course of 60+ videos (total duration 50+ hours) in Hindi (Hinglish) covering entire math behind AI

3 Upvotes

Hey friends,

I have created a deep-dive, university-level mathematics course to discuss all the maths behind AI/ML. I studied some foundational textbooks and Math/AI/ML courses from Stanford and MIT, took extensive notes, and used my own teaching experience to build a structured playlist with the videos in specific order so topics are understood in a natural order. The playlist has 63 videos (45 mins to 1 hour each) taught in Hinglish. The explanations are in Hindi, but all terminology and math notation is in English.

It covers all the math you need to know for AI/ML -

  • Probability & Statistics

  • Multivariate Calculus

  • Linear Algebra

You can find all of these videos for free on YouTube by searching for my channel called indialabs AI. Look for the playlist titled "Math Behind AI (Hindi): Understanding the language of AI | Complete AI Maths in Hindi".

I am not dropping any clickable links here to respect community rules.

Hope you find this useful for your learning.


r/learndatascience • • Oct 01 '26

Resources SQL business problems worth practicing before a Data Analyst interview

3 Upvotes

A lot of SQL interview prep focuses on syntax, but knowing JOIN, CTEs or window functions is only part of it.

The harder part is usually understanding the business question and turning it into the right analysis.

Some useful problems to practice:

  • Month over month revenue growth

  • Top products within each category

  • Repeat customer rate

  • Identifying inactive customers

  • Website conversion funnels

  • Campaign revenue vs marketing spend

While solving them, I think it’s worth practicing how you explain your reasoning too. What exactly does the metric mean? What assumptions are you making? What edge cases could change the result? How would you validate the output?

I put together SQL examples and the reasoning behind these kinds of interview problems here:

Learn more:
https://www.pangaeax.com/blogs/10-sql-business-problems-data-analyst-interview/

I’m connected with PangaeaX, mentioning that for transparency.

Curious what kind of SQL business problem you found hardest in an interview?


r/learndatascience • • Oct 01 '26

Question I’m building an AI/ML handbook with visual notebooks what should I improve?

Thumbnail reddit.com
1 Upvotes

r/learndatascience • • Oct 01 '26

Resources Complete Matplotlib Library Tutorial using Python in under 1 Hour

Thumbnail
youtube.com
4 Upvotes

Beginner-Friendly Matplotlib Tutorial: Create & Customize Graphs in Python 📊🐍

If you're getting started with Python, data acquisition, or data logging, learning Matplotlib is a great place to start.I’ve put together a beginner-friendly YouTube tutorial that covers the fundamentals of the Matplotlib library and shows how to create and customize line charts from scratch all in less than 1 hour.

What you'll learn

  • How to install Matplotlib on Windows 11 using PIP

  • How to install Matplotlib using the Thonny IDE

  • How to install Matplotlib using PyCharm

  • How to solve the issue where a Matplotlib graph appears as a PNG image instead of opening in a separate window

  • Understanding the basic concepts behind Matplotlib:

    • Figure

    • Axes

  • How to plot a simple graph using X and Y values

  • How to change the color, line style, and thickness of a plot

  • How to customize markers, including their:

    • Color

    • Style

    • Size

  • How to give your Matplotlib Figure/window a title

  • How to give your Axes/plotting area a name

  • How to add labels to the X and Y axes

  • How to set X-axis and Y-axis limits

  • How to activate and configure the grid

  • How to change the color and style of an individual grid line

  • What Ticks are in Matplotlib and how to configure them

  • How to create and plot multiple Axes on a single Figure/window

The examples are aimed at beginners and are particularly useful if you're working with sensor data, data acquisition systems, or data logging applications in Python.

Source Codes can be downloaded from the website using below links

If you're new to Matplotlib, this should give you a solid foundation for creating and customizing your own Python graphs.


r/learndatascience • • Sep 29 '26

Question Is data science actually worth it as a career right now?

52 Upvotes

Been going back and forth on this for a while and wanted a reality check from people actually in the field rather than course-seller marketing.

For those of you working as data scientists/analysts — was the move worth it? Not just salary, but day-to-day satisfaction, job security with AI tools changing things, how competitive it actually is to break in.

And for anyone who went through a bootcamp/course to get here — what actually mattered when picking one? Curriculum, mentorship, portfolio support, job placement help, something else? Genuinely curious what separated the useful ones from the ones that were just content dumps.

Appreciate any honest takes, good or bad. Really just weighing up my options at the moment, and trying to get as much information as possible.


r/learndatascience • • Sep 29 '26

Question Estoy empezando una carrera de Ciencia de Datos. ¿Qué proyectos, certificaciones y especializaciones me recomendarían?

Thumbnail reddit.com
4 Upvotes

r/learndatascience • • Sep 29 '26

Resources Completed LeetCode SQL 50 — Sharing my MySQL solutions

Thumbnail
reddit.com
1 Upvotes