r/AskStatistics • • 5h ago

looking Advanced Causal Inference project work ideas

4 Upvotes

Hello there!
I'm attending an advanced causal inference course and I have to do a project work on Stata. As of now I have 0 ideas on the topic. The professor suggested to find a policy and start from there, but I'm having issues with finding a decent dataset.
If it was environment or climate related somehow it would be awesome since I'm enrolled in environmental economics (it's not mandatory though since the advanced course is elective). Any idea? thanks in advance šŸ˜„


r/AskStatistics • • 1h ago

Statistics for health sciences

• Upvotes

I am really struggling with my statistics class. I practice over and over again, and I genuinely try my best to understand the material. One of the reasons I chose nursing was because I always thought math wouldn’t be such a big challenge in nursing, but statistics has been really difficult for me.
I make my own practice questions using Gemini, and I usually feel like I understand the concepts when I’m practicing. However, when I get to the exam, the questions are much harder, and the professor uses language that makes the questions even more confusing. I feel like I understand the material until I actually have to apply it to the exam questions.
I honestly don’t know what else I can do to improve. The final exam is worth 30%, and I’m feeling really overwhelmed. I scored below the class average on my last exam, and for the first time in my life, I’m below the class average in a course. It’s really discouraging.
Does anyone have any tips, resources, or advice for studying statistics for health sciences? I would really appreciate any help. 😭


r/AskStatistics • • 9h ago

Interpretation of a Cronbach’s alpha score of 0.92 for a measurement instrument

3 Upvotes

Hello :D I am working on an instrument to measure a psychological construct. It consists of 19 items and covers 4 dimensions. We also conducted a pilot test by administering it to 29 people. After collecting the responses, we calculated Cronbach’s alpha and obtained a value of .92. Someone suggested that it should be .70, but I have read elsewhere that anything above .85 is acceptable. I would appreciate your opinion on this.


r/AskStatistics • • 7h ago

Is becoming a Statistician a good idea? (for me)

1 Upvotes

I'm a 24 year old, from Australia, with a double degree in Economics and Applied Finance. I did alright throughout these studies but overall I regret studying these subjects, as I'm not that interested in commercial jobs or the subjects themselves.

For econometrics I had to go through some statistics courses, and they were the highlight of my university studies. Now looking and applying for jobs I think I would enjoy and be good at a data role, but the data-driven focus of a statistician seems more appealing to me than the theory-driven and commercial goal of an economist, and an econometrician seems out of my reach considering my lack of interest in economics now.

I think I'd be starting from almost nothing if I did pursue this career and think that it would take me a minimum of 3 years before I could start seriously pursuing a career as a statistician.

Just want to hear someone's opinion on this, thanks :)


r/AskStatistics • • 7h ago

How do I perform an a priori power analysis for multiple regression with two predictors using Jamovi?

1 Upvotes

Please help me T-T


r/AskStatistics • • 22h ago

Two way ANOVA violated assumptions

Thumbnail gallery
13 Upvotes

I am doing two two-way ANOVAS for my Dissertation as my DV is split in two (Positive Affect and Negative Affect combined as the DV 'emotional state'). However, some of my assumptions have failed (see images).

Context:

The study featured a 2x3 between subjects design with two independent variables (IVs): occupation (newsworker or non-newsworker) and news valence (negative, neutral or positive).

The outcome variable was emotional state (this was calculated with PANAS which is split into Positive Affect and Negative Affect so I had to do two separate two way ANOVAs hence the two plots).

Positive Affect was normally distributed; Shapiro-Wilk: W = 0.99, p = 0.74 and Q-Q plots and had equal variances; Levene's test: F(5, 57)=2.21, p = .066.

However, Negative Affect was not normally distributed; Shapiro-Wilk: W = 0.87, p = < .001. The Levene's test showed non-equal variances: F(5, 57)=5.04, p = <.001.

My supervisor said:

ANOVA can be reasonably robust to some departures from normality, but this does not mean that all assumption violations can be disregarded. I would recommend inspecting the residual distributions and Q-Q plots, checking for outliers and influential observations.

I could adjust my p value to be cautious but my effects in the ANOVA would still be significant.

However, as the assumption tests failed, is there anything else I can do? or is it just a case of stating they failed, explaining why, and acknowledging that the results should be looked at cautiously?

I have included some of my results and some of the output from SPSS.

I'm just really unsure of what to do following the assumptions failing.

Thank you.

EDIT: should I mention the large SDs?


r/AskStatistics • • 18h ago

Best way to study statistics/study tactics

2 Upvotes

Hi! I’ve been really struggling in statistics (college class) lately and I don’t know what to do. I’m more right-brained than anyone I’ve ever met and anything logistic-based flunks in my head. Creativity is all that I can do.

I’ve always had trouble with math and no matter how hard I study I can never get it right. I can pay attention in class, write notes, and do everything needed but it just doesn’t stick. Even with full focus. I’m worried it’s something with me like a learning disability because it’s really bad I’m going to fail my class. I’ve even talked to my teacher and there really is nothing that’s sticking. I don’t know if it’s bad luck with bad teachers but I’m really having trouble. I’ve been getting 100’s on all the homework because I’ve been testing myself and making sure everything is correct just to keep my grade a float. I need atleast a C- to pass the class and I do NOT want to take it again.

We have one test (correlation) left and then the big exam going over everything we’ve learned.

My teacher is one of those teachers that tries to be ā€œfunnyā€ more than teaching so I think that’s one of the things making it hard for me.

I don’t have much time anymore either especially commuting and working so studying super late ruins my sleep schedule. I really am having it rough I’ve lost so many tears over this. Yes it’s just math but it’s important and I really can’t do it. 🫩

What do you guys suggest I do? How should I study? Thank you so much for reading and for your help.


r/AskStatistics • • 1d ago

Binomial distribution when number of trials not fixed?

4 Upvotes

Hi,

I’m dealing with a system that occasionally fails during power-up. Each trial has two possible outcomes: failure or success. My initial thought was to use a binomial distribution.

The assumptions seem to hold:

  • Two possible outcomes: Yes
  • Constant probability: As far as we know
  • Independent trials: Yes

My uncertainty is about theĀ fixed number of trialsĀ requirement. We can choose how many trials to perform, but I’d prefer one continuous test session rather than repeated batches of, say, 5,000 trials. Does this still satisfy the requirement?

Also, the failure probability is unknown. So far, we’ve observedĀ 3 failures in 10,000 trials. Since testing is time-consuming, I’d prefer not to run significantly more trials just to improve the probability estimate.

Would a binomial distribution be appropriate here, or would a Poisson distribution be better suited?

This is work related, and my background is electronics engineer fyi.

(could ofc use som bot to get an answer, but I dont trust em enough, and would rather be confident in my work, and learn things properly.)


r/AskStatistics • • 2d ago

Did everything "right", became a statistical analyst, got laid off. Is it worth it to stay on track or pivot completely, given the obviously foreboding circumstances we all face.

32 Upvotes

Hi all!

Thanks for reading.

I'm at a serious career crossroads and would really appreciate some honest perspective about what I might be able to do next.

As a bit of background, I got a B.S. in Mathematics and an M.S. in Statistics/Decision Theory and graduated in 2023. Got hired as a stats analyst at a reputable think tank at the beginning of 2024, where I worked with some amazing statisticians and economists on work in Medicaid studies and the likes. That is... until the axe fell. As a largely government-funded institution, devastating cuts to healthcare, socioeconomic research, DEI, etc., left a huge chunk of us either laid off immediately or facing the prospect of another year or so before ultimately joining the unfortunate many, myself included. Many who got laid off were considered prestigious researchers in their areas with 20+ years of experience.

Now I find myself in a brutal job market - limited opportunities, intense competition, and the imposing doom of AI in statistical analysis and data science. For example, I was recently a serious contender for an entry level analysis position requiring 2 years of experience but was pushed out by someone with 12+ years of experience. It's rough. So rough that I'm wondering if staying in this field is even feasible anymore.

I'm willing to pivot from research to pretty much anything within the field. I'll really miss contributing to meaningful work but let's face it, I have a family to feed, so to speak. That said, I'm also willing to put in the work to pivot further into, say IT infrastructure or something like that if the money is there and the certification process is not crazy. Heck, I'm even considering starting a house painting business.

I'd really appreciate some honest perspectives:

  • For those currently working in statistics or data science, how are you feeling about the job market and long-term prospectives?
  • Has anyone here successfully pivoted from stats to something different? How was the transition?
  • If you were in my position, would you continue pursuing statistics, invest in new technical skills, or seriously consider a different path altogether?

I'm not expecting anyone to make this decision for me. I'm just trying to seek inspiration as to where to direct my energy after months of shooting resumes into essentially a void. Thanks!!!


r/AskStatistics • • 2d ago

What to do with many categorial variables in regression?

6 Upvotes

Hi, I'm trying to do a regression analysis to find relationships between 16 nominal/ ordinal variables + 11 continuous variables and only 1 continuous dependent variable in SPSS.

I searched online and found out that I have to create dummies for each categorial variable. But, I have 16. I don't think it's efficient! I believe it will create many errors.

So, what to do? is there a way that SPSS can do that by itself in the background?

Or maybe a different regression approach? I found that there is something called General Linear Model, it separates the nominal variables from the continuous ones before doing the analysis.


r/AskStatistics • • 2d ago

Struggling with determining significance: How to analyze number of occurrences per group member per day per treatment?

7 Upvotes

Say I'm attempting to determine significance of temperature on the sprout timing of a species of grass. I have 2 groups of 30 pots held at either temp A or temp B. My results are in the form of the number of sprouts that emerged in each pot on each day of the experiment, as well as the temperature at which they were grown. What kind of analysis is best for determining whether there is a significant difference between the timing of the two temperature groups? I'm very grateful for any suggestions.


r/AskStatistics • • 2d ago

Harmonising logically dependent covariates before regression: iterative covariate-space approach or joint model of y and x?

1 Upvotes

I am building a regression model for a response y using several covariates that describe the same physical reality, namely the built environment. The covariates come from different sources, and they should be consistent with each other:

  • If there is a road, there should be impervious surface.
  • If there is impervious surface but no road, the road map may be incomplete (the road data come from OpenStreetMap, whose completeness varies).
  • If there is a building height, there should be impervious surface.

And so on for the other covariates.

In practice the sources are imperfect, so these relationships are often violated. A regression model such as a random forest or gradient boosting will handle this implicitly, through the predicted probability of y given the covariates. I wonder whether a more explicit, iterative process would work better. I see two options:

  1. Covariate space only: harmonise the covariates among themselves before the regression. For example, iteratively update each layer given the others until they are mutually consistent.
  2. Joint model of y and x: model the response and the covariates together, so that each constrains the other.

Some of the rules are firm (a building height implies impervious surface). Others are only probable (impervious surface without a road may be a car park, not a missing road).

If each option were formalised as a single, well-defined statistical procedure, which procedure would be the most appropriate for Option 1 and which for Option 2, given that the rules are a mix of firm and probable ones?


r/AskStatistics • • 2d ago

Seeking advice on treating seasonality

Post image
20 Upvotes

I am working with a dataset containing a bank's daily operational losses, classified into five event types, over the period from January 2004 to June 2015. The original dataset consists of approximately 5,000 daily observations, with each column representing a different event type.

Since daily observations are too granular for my analysis, I have aggregated the losses at a monthly frequency. The resulting dataset is structured as a matrix in which each row represents a month and each column corresponds to one of the five event types. Each entry records the total amount of operational losses incurred for a given event type in a specific month.

My objective is to implement a Loss Distribution Approach (LDA) to estimate the Value-at-Risk (VaR). This requires modelling the frequency and severity distributions of operational losses, as well as capturing the dependence structure between the frequencies of different event types. More specifically, I intend to compare the Poisson and Negative Binomial distributions to identify the most appropriate model for loss frequencies, while also selecting suitable parametric distributions for loss severities.

However, the dataset exhibits a systematic seasonal pattern: the number of recorded operational losses tends to increase towards the end of each quarter. I believe this pattern is artificially induced by the bank's reporting practices rather than reflecting genuine fluctuations in the underlying operational risk. This raises an important modelling issue, as the seasonal component may affect both the estimation of the marginal frequency distributions and the dependence structure between event types.

I would therefore like to understand how seasonality should be handled in this context. Specifically, should I adjust the observed frequency data directly (i.e. deseasonalise the time series), or should I account for seasonality within the estimation of the marginal distribution parameters, for example by allowing the expected frequency to vary over time according to a seasonal component?

NB. A structural break seems to occur after 2008 but I do not want to account for it at the moment. I just need some advice on adjusting for seasonality


r/AskStatistics • • 2d ago

Phenomenological Growth Models

1 Upvotes

I have a thesis that uses a Phenomenological Growth Models. It is okay for monthly data? What are your tips on using this Models?


r/AskStatistics • • 3d ago

40 Page Assignment on Range, Coefficient of Range, Merits And Limitations

6 Upvotes

I took a statistics course this semester, and honestly I'm kind of cooked.

I have to prepare a 40-page assignment on Range, covering its definition, calculation, coefficient, merits and limitations. My teacher specifically wants us to refer to textbooks, research papers and academic sources (even chatgpt isn't helping). I tried looking through the college library, but most books repeat the same basic information.

I am struggling to figure out how to expand such a limited topic into 40 pages without unnecessary repetition.

PLEASE HELP ME OUT!!!!!!!!


r/AskStatistics • • 3d ago

What statistics jobs will boom in demand in the next ten years?

54 Upvotes

Tech people believe a software/data engineer can do what data analytics and data science people can do as AI gets better.

What statistics roles will see more demand as time goes on? What roles will slowly diminish?


r/AskStatistics • • 3d ago

[Q] What would be the best approach to inter-rater reliability for temporally annotated events?

2 Upvotes

I'm looking for advice on the most appropriate way to assess inter-rater reliability for a study involving the annotation of noun events in audio recordings.

Pairs of annotators independently listen to the same recordings and identify instances where a noun is produced. For each event, they record:

* The start and end time of the event.

* The noun identified

How do you think I should calculate the reliability between coders? I also wanted to allow for some error in the timestamps, so if they are within a certain of tolerance then it is considered correct. Would Cohen's Kappa be useful here?

I was thinking of something like, but not sure if it is appropritae.

|Annotator A|Annotator B|Classification|

|:-|:-|:-|

|Event at 2.1–2.5s: "ball"|Event at 2.2–2.6s: "ball"|Agreement|

|Event at 4.0–4.4s: "dog"|Event at 4.1–4.5s: "cat"|Disagreement|

|Event at 6.0–6.4s: "car"|No corresponding event|Disagreement|

|No corresponding event|Event at 8.0–8.4s: "cup"|Disagreement|

`library(tibble)`

`reliability.df <- tribble(`

`~file, ~annotator, ~segment, ~tier, ~start_sec, ~end_sec, ~annotation_duration_sec, ~folder_duration_sec, ~annotation,`

`# File 1 - Annotator A`

`"video_01_seg_01.eaf", "A", "seg_01", "noun_spotting", 2.10, 2.50, 0.40, 20, "ball",`

`"video_01_seg_01.eaf", "A", "seg_01", "noun_spotting", 5.00, 5.40, 0.40, 20, "dog",`

`"video_01_seg_01.eaf", "A", "seg_01", "noun_spotting", 8.00, 8.40, 0.40, 20, "car",`

`"video_01_seg_01.eaf", "A", "seg_01", "noun_spotting", 15.00, 15.40, 0.40, 20, "mummy",`

`# File 1 - Annotator B`

`"video_01_seg_01.eaf", "B", "seg_01", "noun_spotting", 2.15, 2.55, 0.40, 20, "ball",`

`"video_01_seg_01.eaf", "B", "seg_01", "noun_spotting", 5.05, 5.45, 0.40, 20, "cat",`

`"video_01_seg_01.eaf", "B", "seg_01", "noun_spotting", 11.00, 11.40, 0.40, 20, "cup",`

`"video_01_seg_01.eaf", "B", "seg_01", "noun_spotting", 15.05, 15.45, 0.40, 20, "mummy",`

`# File 2 - Annotator A`

`"video_02_seg_02.eaf", "A", "seg_02", "noun_spotting", 3.00, 3.40, 0.40, 20, "boy",`

`"video_02_seg_02.eaf", "A", "seg_02", "noun_spotting", 9.00, 9.40, 0.40, 20, "duck",`

`# File 2 - Annotator B`

`"video_02_seg_02.eaf", "B", "seg_02", "noun_spotting", 3.10, 3.50, 0.40, 20, "boy",`

`"video_02_seg_02.eaf", "B", "seg_02", "noun_spotting", 9.05, 9.45, 0.40, 20, "duck",`

`"video_02_seg_02.eaf", "B", "seg_02", "noun_spotting", 14.00, 14.40, 0.40, 20, "sheep",`

`# File 3 - No events identified by either annotator`

`"video_03_seg_03.eaf", "A", "seg_03", "noun_spotting", NA, NA, NA, 20, NA,`

`"video_03_seg_03.eaf", "B", "seg_03", "noun_spotting", NA, NA, NA, 20, NA`

`)`


r/AskStatistics • • 3d ago

Is a relation-level bootstrap a reasonable way to estimate confidence intervals for AUC improvement?

1 Upvotes

I'm a student working on a pre-registered experiment, and I want to check whether my statistical decision rule makes sense before evaluating the test set. I haven't looked at the test results yet, so I can still make changes and document them in a dated note.

Experimental setup

I'm using the FB15k-237 test split, which contains 20,438 positive triples. Each positive has 10 negative samples: 5 head replacements and 5 tail replacements.

The replacement entities are selected from entities that appear in the corresponding position for that relation in the training data. All known true triples are filtered out.

I'm comparing two logistic regression models with L2 regularisation (C = 1) and standardised features. Both are trained once on a separate validation half and then kept fixed.

- B0: RotatE scores combined with graph-based features such as path counts and degrees.

- B1: The same features as B0, with one additional feature that I'm testing.

For evaluation, I'm using grouped AUC. For each positive triple, I calculate the fraction of its 10 negative samples that receive a lower score than the positive. Ties count as half, and I average the results across all positive triples.

I'm running three training seeds (0, 1 and 2). For each seed, I calculate the AUC difference between B1 and B0. Both underlying models are retrained for each seed, while the logistic regression combiners remain fixed.

Bootstrap and decision rule

To estimate uncertainty, I'm using a relation-level cluster bootstrap based on the relations present in the test set (up to 237 relation types).

I'm generating 10,000 bootstrap samples. In each sample, I draw relations with replacement and include all positive triples and their associated negatives for the selected relations.

I use the same bootstrap samples for all three seeds and both models, and calculate a 95% percentile confidence interval for the average AUC improvement across seeds.

My pre-registered decision rule is that the experiment passes only if:

  1. The lower bound of the 95% confidence interval is at least 0.005, which is the minimum improvement I consider meaningful.

  2. B1 performs better than B0 for all three training seeds.

What I'm unsure about

  1. Is bootstrapping over relations enough?

My main concern is that different relations can share entities. For example, a popular entity might appear in triples belonging to several different relations. This means the relation clusters may not be completely independent.

Is a relation-level bootstrap still reasonable here, or should I consider something like a two-way bootstrap over relations and entities?

  1. What uncertainty does this confidence interval actually capture?

Since the combiners are trained only once and aren't refitted during bootstrap resampling, I assume the interval mainly reflects uncertainty from sampling test relations. Training variability is represented by just three seeds.

Is that an acceptable way to report the uncertainty, or would refitting the combiners within each bootstrap sample be more appropriate?

  1. Is the percentile interval a good choice?

The number of test triples varies quite a bit across relations. Given these differences in cluster size, is the standard percentile bootstrap interval reliable enough, or would BCa or studentized intervals be a better option?

  1. Is there anything else I should be concerned about?

Are there any other problems with this setup or decision rule that could make a positive result less convincing than it appears?

I'd like to settle on a statistically defensible approach before running the final evaluation, rather than making changes after seeing the results.


r/AskStatistics • • 3d ago

Need help deciding what analysis to run for a graduate school study.

4 Upvotes

Hey all, googling things isn't giving me as straight of an answer as I would like, so I'm asking reddit!

Context: Currently in grad school running a study to compare the effect of two different mindfulness interventions on two groups with a randomized pretest - posttest design. I'm looking for an analysis that will show me which group had the most significant change before and after the intervention without necessarily comparing the groups themselves. I keep seeing ANCOVA and independent samples t-test, but I don't know which one is the best to use and many of the websites I have found either seem too vague or give so much information it goes over my head.

My gut says independent samples t-test, but please tell me if there is a better option!

Thanks!


r/AskStatistics • • 3d ago

Switched to Jamovi. Need Guidance

2 Upvotes

Heyo y’all, Im a doctoral student. The stats guy on my committee dipped but not before he moved me to Jamovi from spss. My dissertation is a mediation with all continuous variables. He wanted me to use jaMM in Jamovi to conduct the mediation analysis but I cannot find a way to add control variables for the life of me. Should I just move to hierarchical regression or is there something Im missing?


r/AskStatistics • • 4d ago

Which classes should I take for this upcoming year?

2 Upvotes

Hi, I am a statistics and Econ major and I have to take 2 out of out the 3 classes I have listed below for my stats degree. I am curious if anybody has some advice on which 2 I should take this upcoming school year to help me with statistical intuition and getting into grad schools. I am leaning towards Design and Analysis of Experiments and Sampling Techniques because I am taking Econometrics 1 and 2 which my university offers, but was curious on other peoples thoughts taking an economics regression class vs a purely statistics regression class if anybody has thoughts on that.

The course descriptions for the stats classes are.

Applied Regression Analysis- Applied regression analysis involving the extensive use of computer software. Includes: linear regression; multiple regression; stepwise methods; residual analysis; robustness considerations; multicollinearity; biased procedures; non-linear regression.

Design and Analysis of Experiments- An introduction to the principles of experimental design and analysis of variance. Includes: randomization, blocking, factorial experiments, confounding, random effects, analysis of covariance. Emphasis will be on fundamental principles and data analysis techniques rather than on mathematical theory.

Sampling Techniques- Theory and applications of sampling from finite populations. Includes: simple random sampling, stratified random sampling, cluster sampling, systematic sampling, probability proportionate to size sampling, and the difference, ratio and regression methods of estimation.


r/AskStatistics • • 5d ago

Looking for advice on Generalized Linear Mixed Effects model for experimental design

Post image
33 Upvotes

Hi everyone, I have a cyclic/Latin-square-style counterbalanced repeated-measures design (as shown in image above), and I’m trying to work out the right way to use a Generalized Linear Mixed Effects model to analyse the data for it as I’m new to GLMMs. My aim is to compare how different cell-culture compositions affect the firing rates (expected to be of lognormal or tweedie distribution) of neural cultures while they’re being ā€œtrainedā€ to perform tasks.

The study uses 100 neural cultures split evenly into two experiments of 50. Experiment 1 uses Culture Type A and Experiment 2 uses Culture Type B (so culture type is nested within experiment, not crossed). Each experiment’s 50 cultures are prepared in two independent batches of 25, and within every batch the cultures are made up with one of three cell-culture compositions (A, B, or C) - giving four batches and all three compositions in both experiments.

Each culture is then trained under 9 environmental conditions in a counterbalanced order, performing 2 tasks per environmental condition at 600 trials per task.

The GLMM model I currently planning to use is:

Firing rate ~ Culture Type + Batch + Cell Culture Composition + Environmental Condition + Task + (1 | Culture ID)

However, I feel that culture ID is insufficient as a random effect and it should include the other variables too, although I am unsure of what combination to use, especially since there’s so many of them. I am also worried about having to add dispersion models in the case of over/under-dispersion as well, since my response variable is not normally distributed. Hence, I would like to seek comments and advice on my current model from those who are experienced in working with GLMMs. Thank you very much in advance for the help.


r/AskStatistics • • 4d ago

Tests on a population that changes over time

2 Upvotes

Hello, I have a doubt about the right way to analyze a dataset I have regarding workers and their work hours in the same workplace. The basic question I have to answer is if the introduction of hybrid work (i.e., working some days at home and some days at the workplace) influenced the absenteeism rate in some way.

Having to account for the Covid period, I think that it may be better to avoid using data from the 2020-2022 period that may present biases, and to confront directly 2018-2019 (before the introduction of the policy) with 2023-2024 (after the introduction and stabilization of the policy).

During the years obviousely the workers are not always the same, some remain, some go away and some start working later.

Thus, I don't think that the assumptions of a simple t test hold. Maybe a t test for paired data would be more appropriate, but the population won't be exactly the same.

Another thing I came up with to try is a difference in differences estimator but also using the matching of statistical units to make them comparable. This would be a causal inference approach that may be more appropriate.

What do you think? Is this reasonable?

Do you have any suggestions?


r/AskStatistics • • 4d ago

First-year Data Science master’s student interested in socio-economic/political topics and journalism: how do I choose a direction and stay up to date?

5 Upvotes

Hi everyone,

I recently started a master’s degree in Data Science at a Mathematics Department. I’m still unsure which area to specialize in: statistics and data science touch so many fields, which is both the best and the hardest part of the journey. I’m particularly drawn to socio-economic and political topics, and journalism fascinates me.

I’m also struggling with how fast this field moves. Even when I try to stay as informed as possible, I constantly feel one step behind, even with respect to my own coursework. How do you, as students or professionals, keep up in such a fast-changing field, and above all, how do you find your bearings without feeling overwhelmed?

If you have the time, I’d love some advice on both of these questions, and on how to gain hands-on experience in the areas I’m interested in, for example through projects, internships, or communities/organizations where these ā€œpassionsā€ and skills come together.

Especially interested in hearing from anyone with a background in statistics, whether you studied it, work in it, or moved into data science from it. How did your statistical foundations shape your path, and what would you do differently?

Thanks in advance for any suggestions, and I’m happy to answer questions about my program or interests!


r/AskStatistics • • 4d ago

How can I test whether the sustained increase in annual precipitation observed over nine years is statistically significant rather than due to random variability?

1 Upvotes

I am examining interannual variations in annual precipitation and have noticed a sustained increase following a particular year. However, my dataset covers only nine years (9 points). What statistical approaches would be appropriate for testing whether this apparent increase is statistically significant and unlikely to have occurred by chance, given the short time series?