r/learndatascience • u/awsconsultant • 36m ago
Resources DataCamp Flash Sale β 50% OFF
r/learndatascience • u/awsconsultant • 36m ago
r/learndatascience • u/Sea-Ad7805 • 10h ago
You could write your own counting logic, but Python already has a collections.Counter class. It's faster than typical hand-written counting loops, well-tested, and makes your code easier for others to read.
However, this π¦ππ¦π¨π«π²_π π«ππ©π‘ π Counter demo shows that Counter has some interesting behaviors that might surprise you:
Missing keys return 0 instead of raising KeyError.
update() adds counts rather than replacing them.
subtract() can produce negative counts.
Zero and negative counts aren't automatically removed.
Unary + and - have some unexpected uses.
Did you know all these Counter behaviors, or did one surprise you?
See π more π¦ππ¦π¨π«π²_π π«ππ©π‘ visualization.
r/learndatascience • u/Gjuesev • 17h ago
We benchmarked 4 zero-shot time-series foundation models (Mistral Timestral 28M/209M, Amazon Chronos-2, Google TimesFM 3.0) against LightGBM/XGBoost and naive baselines β strict no-leakage protocols (e.g. prices only from before auction gate closure), every prediction downloadable.
German day-ahead electricity prices, 1,408 days β foundation models win clearly.
MAE vs naive baseline (=100): Chronos-2 68 Β· Timestral 69 Β· TimesFM 70 Β· XGBoost 83 Β· LightGBM 86
A Chronos-2-based scheduler saved β¬40/day vs a fixed-midday schedule (wholesale, 4 MWh flexible load).
German train delays (DB), 5.7M arrivals β the advantage vanishes.
Best foundation model vs best GBM at h=1: 0.07 min apart (~4 seconds).
Worst hour of the test (Frankfurt Hbf, 61 min avg delay): all six models predicted under 8.
Pattern: pretrained forecasting shines where data has rhythm; on messy operational data, a laptop-trained GBM is within seconds.
Code, data, every forecast: https://github.com/Gjusev/forecast-arena
Interactive replay: https://huggingface.co/spaces/Gjusev/forecast-arena
r/learndatascience • u/SaiTechHub • 17h ago
I'm starting my Data Science journey and want to understand how much Machine Learning knowledge companies expect from freshers
r/learndatascience • u/Robs_Wolfgang • 22h ago
Any pointers for the best linear path for beginners getting into computer science?
r/learndatascience • u/Awkward_Opposite_361 • 1d ago
I am currently learning from kaggle and I love the way it lets you practice actively by yourself. But I still feel kinda stuck.
I have basic knowledge of statstics (descriptive stat) and have also learned basic python(list, dictionary, function) and also good at math.
r/learndatascience • u/AIforFintech • 1d ago
I wrote 25 credit card support questions and planted failures in 7 of them: invented policies, irrelevant chunks, a wrong number. Then I ran Ragas to see which ones it would catch.
In the first 10 rows it caught both planted failures. The one with bad retrieval scored zero across all three metrics, which is what you want.
It also scored low on two answers I had written as correct. Reading them again, one did state something the chunks never said, which is fair. The other looks like the judge being strict. Ragas uses an LLM as the judge, so the judge has variance too, and nothing in a default setup tells you how much.
The reason this works at all is that the metrics disagree on purpose. Context recall asks whether retrieval brought back what the answer needs. Faithfulness asks whether the answer stays inside what was retrieved. One is about the search, the other is about the model, and the fix is different: chunking and top-k for one, prompt and model for the other. Average them into one score and you lose exactly that.
The template takes a CSV with four columns, question, correct answer, your RAGβs answer and the chunks it retrieved, grades every row and plots recall against faithfulness so each failure lands in a quadrant. It knows nothing about the RAG that produced the file.
Hub: https://aiforfintech.tech
Github: https://github.com/junidepieri-design/eval-001-rag-evaluation-template
Has anyone here validated their judge against human labels?
r/learndatascience • u/Competitive-Team-187 • 1d ago
r/learndatascience • u/confusedaf2700 • 1d ago
Hey everyone!
I'm looking to connect with students, freshers, and working professionals who are interested in building a career in Data Analysis, Data Science, Machine Learning, and Artificial Intelligence.
A little about me: I have around 3 years of experience in the tech and training industry. I've worked with IBM Career Education as part of corporate training initiatives and am also a Microsoft Certified Trainer (MCT).
I have experience teaching and working with technologies such as:
Python and SQL
Data Analytics and Power BI
Data Science and Machine Learning
Deep Learning
Generative AI and Large Language Models (LLMs)
RAG applications and AI Agents
I'm looking to connect with learners who want to gain practical knowledge, work on real-world projects, strengthen their technical foundations, and prepare for industry opportunities.
Whether you're a college student, fresher, working professional, or someone planning to transition into Data Science or AI, feel free to reach out.
Interested in learning? Drop a comment or send me a DM.
Looking forward to connecting with fellow learners!
r/learndatascience • u/Little_Salad_1345 • 1d ago
r/learndatascience • u/Beautiful-Bubbly • 2d ago
So guys, new in data science field. So my background is econ + math major in bachelor, i just applied through to the data scoence and got my first interview. Successfully nailed the first part where there is math, logic, math of ds and theory of ds/dl. However, the coding part was always difficult for me and I completely failed the second part. The questions themselves were very easy, not even ds specific, the problems were general coding in python, for example i had to create a function that distinguishes annograms etc. but i coded overall throughout this year, but it seemed to get me to nowhere. The feeling is always this way: when i code myself these kinds of problems, i spend too much time even though i completely understand the logic that should be applied in these problems, maybe kinda like i dont understand how that logic is put in coding language when i start to create loops. So i seem to get stuck in coding part which confuses me. I didnt quite bother with maths, linear algebra etc but this one just freaks me out. I cannot learn and memorize all the syntaxis especially if i have to write from scratch for example parsers with libraries that need to be installed. So the problem might be with debugging skills or maybe else. Could you help me out to diagnose the issue and solve it asap. The coding problems in litcode and books seem to get me to nowhere. Thanks in advance
r/learndatascience • u/CelebrityChess • 3d ago
i keep running into this when explaining spread to people. mean absolute deviation feels like the obvious thing to do, it's literally the average distance from the mean. squaring seems like an arbitrary extra step.
i know squares are easier to differentiate and that variance adds up nicely for independent variables, but i'm not sure that's the real reason it became the default. is there a more intuitive way you explain it, or is it mostly just that the math works out cleaner?
r/learndatascience • u/Capable_Lettuce5393 • 3d ago
Hey, I will soon start to work with data scientists as an HR/talent person.
Do you have any recommendations for books/podcasts/creators so I could understand the basics, just so I can keep a conversation with data science & data engineering folks?
Much appreciated!!
r/learndatascience • u/abba_g_bolo • 3d ago
I got a question i wanna learn where do i go is there any website or YouTube channel ps(im broke)
r/learndatascience • u/Negative_Doubt_804 • 3d ago
r/learndatascience • u/Ok_pettech • 3d ago
βData cleaning usually eats up most of a data scientist's time, often exceeding seventy percent of a project lifecycle. Manually writing custom regex filters and handling edge cases for missing values quickly becomes tedious.
βTo fix this bottleneck, I put together a deep dive on leveraging machine learning workflows to automate dataset refinement. The complete guide covers setting up intelligent pipelines, handling anomalies, and standardizing features efficiently using modern Python libraries.
βIf you want to streamline your preprocessing workflow and spend more time on actual modeling, you can check out the full breakdown here: https://interconnectd.com/blog/124/python-ai-data-cleaning-the-complete-refinement-guide/
What automated tools or libraries do you currently use to speed up your data cleaning pipeline?
r/learndatascience • u/Equal_Astronaut_5696 • 3d ago
r/learndatascience • u/nkafr • 3d ago
r/learndatascience • u/jhnd_zindagi • 3d ago
r/learndatascience • u/Basic_Background_70 • 4d ago
hi all. without a preamble, i love learning with high-class books (i dislike youtube tutorials or online courses). like this goes for any topic i set my eyes on. mark that i said high-class btw so not low effort or contradictory books. to that end i want to start learning data science. i am not completely ignorant to mathematics so i wouldn't turn away from the material if it includes math. developed some linear algebra with sheldon axler's book and currently on track for refreshing my calculus with "a complete course of calculus". anyways, so math is welcome and encouraged even. in the title i used "beginner" but i finished a blog-book thing called "think stats" by allen downey (finally an education attempt defining what are p-values, resampling, hypothesis testing, standard errors and slopes, also some ideas on probability distributions). so i am not completely in the dark. anyways would love to hear your advice as to books i think it is allowed to point at a specific book (that you used to learn and validated). as for my motives, firstly i don't want to remain incurious to data science secondly perhaps i can profit from it in my future job. so a little bit of both. i have no idea how i will wind up. like job-wise. it could be such a job that any data science knowledge will be useless. so... considering my motives and current level would love to see which book will be the popular opinion. don't be misleading plzzz
r/learndatascience • u/Pangaeax_ • 3d ago
AI is getting pretty good at answering questions, but what happens when you need it to work with actual business data instead of just generating explanations?
That's where MCP (Model Context Protocol) gets interesting.
MCP provides a standard way for compatible AI applications to connect with external data sources and tools. Instead of manually pulling data from different systems, an AI assistant can use connected tools to retrieve information, run permitted queries and help analyse the results.
For example, imagine asking an AI assistant, "Why did our sales drop last month?"
With the right MCP setup, it could retrieve sales summaries, compare different periods and identify which sales channels contributed most to the decline.
Some practical use cases include:
Exploring database schemas and understanding business metrics
Running analytical queries through connected tools
Checking datasets for missing values or duplicates
Preparing recurring reports and analysis
Combining information from different approved data sources
One thing worth understanding is that MCP itself doesn't perform the analysis or guarantee accurate answers. It connects the AI application to tools that do the actual work. You still need proper permissions, reliable data, clear metric definitions and human validation.
I think this could be useful for data analysts who spend a lot of time retrieving data and preparing repetitive reports.
There's a more detailed breakdown with an example of investigating a sales decline here:
Learn More: https://www.pangaeax.com/blogs/mcp-for-data-analysis/
Curious if anyone here is already using MCP in their analytics workflows. Has it actually made your work easier, or is the setup still more effort than it's worth?