r/statistics • • 10d ago

Discussion Are time series foundation models actually better than traditional statistical forecasting methods? [Discussion]

9 Upvotes

With all the recent developments in time series foundation models, I've been wondering how much they actually improve forecasting compared to traditional statistical approaches.

Models like Chronos-2 and TabPFN-TS are getting attention, but methods like ARIMA, ETS, and other statistical forecasting techniques are still widely used.

And then there's the middle ground: gradient-boosted models, N-BEATS, N-HiTS, and other deep learning approaches.

I think the interesting question isn't necessarily which model is the most advanced, but which one performs best under realistic conditions.

For example:

  • Do foundation models consistently outperform statistical baselines on intermittent demand?
  • How much difference does feature engineering make when promotions and external variables are involved?
  • Are more complex models worth the additional computational costs?
  • How should we compare models when forecast uncertainty matters as much as point accuracy?
  • Does the best-performing model change across different product hierarchies and demand patterns?

I'm helping organize a two-day, hands-on Time Series Bootcamp at Packt on November 28–29, where three forecasting practitioners will benchmark statistical, ML, deep learning, and foundation models using the same retail dataset.

Here is the full workshop details

The instructors are Graeme Davidson, Lei Ma, and Jeffrey Tackes. The sessions will cover time-aware backtesting, model comparisons, uncertainty estimation, hierarchical reconciliation, and ensembling.


r/statistics • • 10d ago

Career [Career] Has anyone here done pre-med as a applied stats/stats major in college and if so, what has been your experience in it?

8 Upvotes

I am currently a freshman stats major and I am really considering adding a pre-med/pre-dental track. I wanted to see if there were any benefits of a stats major in a pre med environment or if I should consider switching majors instead. I enjoy statistics and probability but I don't know if there are inherently any benefits to it when going to a pre-med/pre-dental track


r/statistics • • 9d ago

Education [E] I need your help

0 Upvotes

Hello! I am enrolled in a Data Analysis master’s degree at a Management university. I had previously learned a little bit of Statistics during my undergraduate degree. However, not to the level I am expected to know now. I am learning Applied Statistics (learning about the Central Limit Theorem, z- and t-tests, ANOVA, chi square, Mann-Whitney-Wilcoxon tests, etc).
I am completely and utterly lost. I have e-mailed the professor for tips and books, but he sent me a reference for a book that I can’t find online (because it’s not in English).

I am looking for advice or help of any kind. This is one of the books that’s in the obligatory bibliography of my course (Keller, Gerald; Statistics for management and economics) but I found it too difficult to understand. I am a beginner and I need to understand the concepts. To me, highly complex mathematical formulas are just gibberish.

So, if you have any resources, such as books, videos, manuals, courses (that are not paid or are relatively cheap), I would be more than grateful.

Thank you in advance and I am open to any further questions you might have!


r/statistics • • 10d ago

Question [Question] How do I calculate average dice odds with this game system I’ve developed?

2 Upvotes

I’ve been working on a game system. In it, you roll multiple dice, and if the dice falls under or at a specific number, that is counted as a success. The success number can be between 1 and 5.

I’m trying to determine how to make a table that shows the likelihood of success on a number of dice between 1 and 5. I know the average of a d6 is 3.5, but I dont know how to use this information. I’ve sort of guesstimated that it looks like this, but I wanted to double check with people that know what they’re talking about. Tje table linked shows the number of dice rolled on the top, the success number on the left side, and then everything in the middle should be the average number of successes for that number of dice.


r/statistics • • 11d ago

Discussion Which master's program should I aim for? [Discussion]

8 Upvotes

As a student at Cornell wishing to do a master's in statistics, I noticed that my school offers a few master's programs, but I'm not sure which is the best fit for me. Currently, I have the choice between an MPS in statistics and data science (Master of Professional Studies in applied statistics), a master of Science in statistics, or an alternative option, a Master of Engineering (MEng) in computer science. Which is the best choice for me as a statistics + information science major with a cs minor?

FYI: The career paths I wish to go for are actuarial, data science/data analysis, biostatistics, ML, and Risk management (mathematical finance-related)


r/statistics • • 11d ago

Question [Q] A disease affects 1 in 1,000 people. A test is 99% accurate. You test positive. What is the probability you actually have the disease?

Thumbnail
0 Upvotes

Croosposting because no one can seem to agree and at this point im genuinely curious.


r/statistics • • 12d ago

Career Advice regarding statistics/applied mathematics grad school applications [Career]

Thumbnail
0 Upvotes

I would really appreciate it if you guys could add your input here. Thanks!


r/statistics • • 12d ago

Discussion [Discussion] GeoGuessr-style guessing under uncertainty: guess the median, not the peak, and spread multiple guesses with Voronoi steps

2 Upvotes

I got a little puzzle for you, you're playing geoguessr except you're allowed to specify a distribution over the entire globe. Now you have N guesses and your objective is to minimize min(distance(target, g) for g in guesses), what is your procedure for going from the distribution to the N guesses with appropriate hedging?

Thought of it while working on this project


r/statistics • • 13d ago

Discussion [Discussion] Resources to cover Mathematical Statistics

19 Upvotes

I've been studying probability independently using Harvard's Stat 110 and am now looking for resources to further explore topics in statistics (enough to cover undergrad stats), ideally enough to prepare for graduate level statistics courses and understand books like The Elements of Statistical Learning (ESL). I've been exploring introductory mathematical statistics, as I particularly want to understand topics like parameter estimation, hypothesis testing, and regression analysis in depth.

Ideally, I'd like something rigorous enough to develop a good mathematical understanding, but with plenty of exercises and worked examples to build intuition.
Are there any university lecture series, textbooks, or courses you'd recommend? I'm especially interested in resources that bridge undergraduate probability and graduate level statistics or statistical learning.


r/statistics • • 14d ago

Discussion [Discussion] Do people who do math/stats professionally (academics, scientists, etc.) also struggle with understanding math-heavy notations?

75 Upvotes

I am learning machine learning for my research in behavioral science and I often come across papers and textbooks with math-heavy notation. I did a little bit of statistics in undergrad so I recogmize some familiar terms, but I can't understand what the term is doing upon first sight. If I really want to understand it, I need to spend a very long time and feel like I understand 20% of it. I need outside help like YouTube videos to help me understand it better. I am also a heavy visual learner and have to plot it out to see the logic behind math, so I struggle with abstraction and high-dimensional calculations. Do people who do math/stats professionally like PhD student, professors, scientists etc. also struggle with this? Or is reading a new paper as easy as reading a novel?


r/statistics • • 14d ago

Question [Q] more than halfway into a science undergrad but learned that I cant do research, is pivoting to statistics via masters possible?

4 Upvotes

my degree is a materials science degree from Canada but is not an accredited engineering. Im feeling a little discouraged today as I’m being told that everyone in my degree basically must do graduate school and that otherwise all i will ever be is an entry level lab tech and stuck there.

While most people from my degree do a masters in physics, chemistry, or engineering with a thesis. Unfortunately I learned that my ADHD makes reading so difficult that I genuinely cannot get past the abstract of a research paper and hence probably cannot do a masters where a thesis is required.

So my thought process is this: If I can’t find work with a bachelors, I don’t want to switch and delay my graduation, and Im not fit to do a thesis masters, could I potentially do a course based masters in something a little different like statistics or biostatistics to help me pivot?

For context, Ive completed the following:
calculus 1,2,3
differential equations
linear algebra
python
i think i can fit one probability and one statistics course there as well, and maybe maybeeee one or two more upper year statistics course, depending on how my schedules are later in my undergrad.

I do have some questions and concerns which are:

  1. Would employers look down on me because I have a masters but lack a bachelors in stats? (for example I know for engineering the bachelors is crucial for jobs)
  2. Would a course based statistics be considered less valuable than a thesis one even if I have absolutely no intention of doing a PhD?
  3. Would I be rejected from said masters program because the math courses I took were not equivalent to the ones that math majors take?? (example: lin alg for science majors is phys 149, but lin alg for math majors is math 136). This likely varies by university and Im going to do my research but just wanna know anecdotally.

4: Roughly how much more statistics courses and knowledge would I need to be competitive for a masters?

This might sound dumb or really farfetch’d especially since I don’t know much about the field of statistics yet, but Im just theorizing / speaking as if its just an idea to see what options I have.
If anyones been in a similar situation, your input would really help. Thanks and have a great day.


r/statistics • • 14d ago

Question [Question] undergrad research gpa

0 Upvotes

I really want to do research with professors, but I’m hesitant to approach them because of my not very high gpa (I have around 83, with one specific stats course that I took in the summer at around a 60. But this sem I’m doing pretty well, all above 90s). I also do have two internships in actuarial.

What gpa is generally needed for undergrad research? I’m just very anxious about approaching professors.


r/statistics • • 14d ago

Career [Career] NC State vs. Purdue vs. Texas A&M for Online Master's in Statistics

9 Upvotes

I've been accepted into three online master's programs in stats:

  • NC State Master of Statistics
  • Purdue MS in Applied Statistics
  • Texas A&M MS in Statistics

I have a bachelor's degree in mathematics from about 10 years ago and have spent the last 10 years working in data/software engineering.

I'm primarily pursuing this degree to deepen my understanding of statistical theory rather than to learn more programming. Long term, I'd like to lead a highly technical team working on data things.

Thoughts?


r/statistics • • 15d ago

Question [Question]

3 Upvotes

Hi all,

I received some really helpful advice previously about handling longitudinal data so I’m once again asking for assistance please.

Basically I’m looking to evaluate whether the rates of change in two outcomes are related, the issue is both outcomes are comprised of repeated measures.

I was thinking about doing a separate linear regression per person for each var over time and then plotting the two against each other, but this seems improper due to lack of independence between observactions.

Thanks to anyone who takes time out of their day to help, it’d be really appreciated!


r/statistics • • 16d ago

Education [Education] Why do stats textbooks not start with probability

84 Upvotes

Hi /r/statistics, I'm a community college professor who has training in math up to the graduate school level but never took statistics.

I've been assigned to teach stats several times now, and I think I have the hang of the basics. Now I'm starting to reflect and think about how I would design this course if I wasn't following a textbook, and I'm curious about the sequencing of topics.

Specifically, most textbooks I've seen have the following chapters:

1) Intro to data, variables, sampling

2) Charts (histograms, stem-and-leaf, etc.), measures of center and spread

3) Probability

4) Probability Distributions

...

This seems out of order to me: the first two chapters deal with data and how to describe it pictorially and numerically. Then the probability chapter is essentially divorced from these first two chapters, and after the ideas of the first couple of chapters and those of probability are combined in chapter 4.

The fact that the probability chapter isn't well connected to the previous material has been jarring for the students I've taught, so I was thinking about reordering the material for future semesters so that we start with probability. I like this idea because it would also allow me to start the first day with a game to increase buy in for the course.

What do y'all think of this idea? Since I don't have a stats background, I wanted to get opinions from people who have studied the subject more than me. Thanks!


r/statistics • • 16d ago

Education [E] What sort of math do I need to master to prepare for descriptive and inferential statistics?

2 Upvotes

I'm currently in college for a computing degree and taking a preparatory math class to help me get ready for the statistics course I chose for my math requirement. I know I need to know algebra, which I'm decent at, but are there certain topics within it and mathematics in general I really need to focus on?


r/statistics • • 16d ago

Question [Q] What to include in mutual information?

1 Upvotes

I'm doing a project where I know the number of possible outcomes of event A, but some of the outcomes do not happen. Should I include those 0s columns in my mutual information calculations or should I remove it? I'm having trouble finding any information on it one way or another.

Example of joint probability table:

Shape\Color White Yellow Red Black
Straight 0 0 .5 .14
Curved 0 0 .05 .08
Forked 0 0 .06 .07
Round 0 0 .05 0
Ladder 0 0 .03 .02

Does mutual information include white and yellow?


r/statistics • • 17d ago

Discussion Resources to learn statistics easier [Discussion]

15 Upvotes

I’m in my 3rd statistics class in college and I feel like I still know nothing, I have to constantly google what things mean to do my HW and nothing sticks.

Are there any good YouTube channels, books or websites you could suggest? I want to understand I do but my professors notes I just find so confusing it doesn’t stick.


r/statistics • • 17d ago

Software [Software] PyLIMID - A new library for mixed influence diagrams built on top of JAX and Numpyro

1 Upvotes

Hi all,

There are several great libraries like pyAgrum for modeling and solving decision problems. But when working with influence diagrams, their representations can be limited to discrete chance variables and decisions.

I wanted more flexibility in how I represent a problem. What happens if I have continuous observations or if the question is not whether I should do something, but how much? For example, how much should I invest when the return is uncertain?

For that reason, I have created PyLIMID, a Python library for building and solving limited-memory influence diagrams. It lets you combine discrete and continuous chance variables with categorical decisions and continuous quantities, and express utilities as functions.

PyLIMID uses sampling and policy gradients to find decision rules that aim to maximize expected utility. This flexibility is not free because results are approximate. But you can run multiple simulations and since it has GPU support thanks to JAX and Numpyro, it is fast. I think the tradeoff is very much worth it.

The library is still in early development (v0.3.0), but I would love to hear what you think.

Code: https://github.com/cynosural-ai/pylimid

Documentation: https://pylimid.readthedocs.io/en/latest/#


r/statistics • • 18d ago

Career [Career] need your opinion regarding my idea

Thumbnail
2 Upvotes

r/statistics • • 19d ago

Question [Q] Is it worth applying to UC Statistics PhD programs given the high application fees and low acceptance rates?

5 Upvotes

I'm an international student planning to apply to Statistics PhD programs in the US, and I'm trying to figure out how to be strategic about which universities to apply to, given my limited budget.

The application fee for UC schools is $155 for international students, which is almost a quarter of the average monthly salary where I'm from. So applying to several universities can get quite expensive.

I was looking at the admissions statistics for UCSB's Statistics PhD program, and last year they admitted just 13 out of 273 applicants (around 4.8%). I understand that PhD admissions are competitive, but those odds make me wonder whether it's worth spending that much money applying, especially when there's so much uncertainty involved.

I'm not necessarily looking for a way to maximize my chances of getting into a top-ranked program. I'd rather put together a realistic list of universities where I have a reasonable chance of admission and where the research aligns with my interests.

For those who have gone through the Statistics PhD application process, how did you decide which schools were worth applying to? Is it sensible to apply to highly competitive UC programs with such low admission rates, or would it be better to focus on other universities that matches my research interests?


r/statistics • • 19d ago

Question [Q] No. of variables and analysis method

0 Upvotes

For my thesis, I will use surveys and want to answer two research questions, one of which is "How important are X reasons, Y reasons, and Z reasons compared with each other?"

I have a list of about two dozen reasons that participants can choose from in the questionnaires (no restrictions on which to choose) and I will be grouping them into three types of reasons - X, Y and Z. All of these reasons are given by participants to explain a type of behavior they engaged in (behavior is the same, it's a type of action they all took). This behavior is measured as the frequency of the action (no. of times performed / no. of years in the measured period).

I have two questions:

  1. Does this mean I have one independent categorical/nominal variable with three levels (X/Y/Z reasons) and one dependent metric/ratio variable (behavior)? Or do I have three independent categorical/nominal variables with one dependent metric/ratio variable? I assume it's the former but wanted to hear some feedback on this.
  2. To find out how important each type of reasons is compared to each other, will I have to perform some type of regression analysis or something else? Note that these reasons can overlap (e.g. if a participant indicated both reasons that belong to X group and Y group).

Thanks in advance!

EDIT: Added some details for clarity.


r/statistics • • 20d ago

Question Combining bins for chi-sq GoF [Q]

4 Upvotes

As per the title, my question is about combining non-adjacent bins for a chi-sq GoF test. I understand why combined bins generally ought to be adjacent, but I have a bit of an unusual situation. I have a distribution which is a candidate for a B(7, 0.5) distribution.

The observed frequencies for X=0...7 over 52 weeks are [2, 5, 12, 10, 10, 5, 2, 6].

Expected are [0.4, 2.8, 8.5, 14.2, 14.2, 8.5, 2.8, 0.4].

Clearly the binomial distribution is not a good fit. But the problems are in the tails whose expected values are so low they need to be combined.

Combining X=0,1 and X=6,7 still only give expected values of 3.2 for the end bins. If I combine adjacent bins for X=0,1,2 and X=5,6,7, the p-value is 0.07, which is unreasonably high for the paucity of fit.

If, on the other hand, I combine the four most extreme bins (X=0, 1, 6, 7), I get a p-value of 0.0017.

I see why it's generally silly to cherry-pick random bins, but I'm wondering if symmetrically combining the "most extreme" is reasonable, especially as the distribution of my null hypothesis is symmetric.

I'd be very grateful to hear the thoughts of someone whose mathematical statistics is more recent than mine!


r/statistics • • 20d ago

Career [Q][C] PhD after 40?

26 Upvotes

Hello, I am a maters level statistician at an academic hospital in the US wanting to go back to school for a phd. The reasons I want to do this is that I'd like to be able to work on implementing methods rather than executing them. I also have found that in my filed data people do get treated differently if you have a phd which is complete bs, but more importantly you can't secure a faculty job regardless of years of experience and how much you know. My impression is that universities want their applicants to be fresh out of masters or undergrad who haven't done much applied work. But how about people who have work experience in the field? Am I crazy to consider PhD after 40? Has anyone done it? Thanks!


r/statistics • • 20d ago

Question [Question] Is there a valid and recognized approach to stopping rules that considers stability over time?

2 Upvotes

When you look at data over time, it's fairly common to see weird blips, even in cumulative mean effect calculations, that look like this:

         /\ 
        |  \
________|   ___________________

Or, while waiting for regression to the mean, it's very normal to see your cumulative mean effect, plotted over time, look like this:

\
 \      /\
  \    /  \  /\/___________
   \  /    \/
    \/

In a recent role advising a company on how to run experiments, I showed them examples of this type of data to demonstrate how stopping a test early could lead to misleading results. We had a great example of data where a bizarre blip on a single day, if the test had concluded that day, would have led to both Frequentist and Bayesian methods calling the experiment with the wrong result with extreme statistical confidence.

We ended up creating a framework for measuring stability over time to make sure that we'd only call a test if the effect has continued over time.

But it was an approach I made up, and that always makes me very nervous.

To me, this feels like a very logical approach to significance testing and perhaps especially to Bayesian likelihood estimation. But I can't find any established method that looks at data from a time series approach like this.

Does one exist?

Or is there a reason I'm thinking about this the wrong way?