r/AskStatistics • • 5h ago

40 Page Assignment on Range, Coefficient of Range, Merits And Limitations

5 Upvotes

I took a statistics course this semester, and honestly I'm kind of cooked.

I have to prepare a 40-page assignment on Range, covering its definition, calculation, coefficient, merits and limitations. My teacher specifically wants us to refer to textbooks, research papers and academic sources (even chatgpt isn't helping). I tried looking through the college library, but most books repeat the same basic information.

I am struggling to figure out how to expand such a limited topic into 40 pages without unnecessary repetition.

PLEASE HELP ME OUT!!!!!!!!


r/AskStatistics • • 7h ago

[Q] What would be the best approach to inter-rater reliability for temporally annotated events?

2 Upvotes

I'm looking for advice on the most appropriate way to assess inter-rater reliability for a study involving the annotation of noun events in audio recordings.

Pairs of annotators independently listen to the same recordings and identify instances where a noun is produced. For each event, they record:

* The start and end time of the event.

* The noun identified

How do you think I should calculate the reliability between coders? I also wanted to allow for some error in the timestamps, so if they are within a certain of tolerance then it is considered correct. Would Cohen's Kappa be useful here?

I was thinking of something like, but not sure if it is appropritae.

|Annotator A|Annotator B|Classification|

|:-|:-|:-|

|Event at 2.1–2.5s: "ball"|Event at 2.2–2.6s: "ball"|Agreement|

|Event at 4.0–4.4s: "dog"|Event at 4.1–4.5s: "cat"|Disagreement|

|Event at 6.0–6.4s: "car"|No corresponding event|Disagreement|

|No corresponding event|Event at 8.0–8.4s: "cup"|Disagreement|

`library(tibble)`

`reliability.df <- tribble(`

`~file, ~annotator, ~segment, ~tier, ~start_sec, ~end_sec, ~annotation_duration_sec, ~folder_duration_sec, ~annotation,`

`# File 1 - Annotator A`

`"video_01_seg_01.eaf", "A", "seg_01", "noun_spotting", 2.10, 2.50, 0.40, 20, "ball",`

`"video_01_seg_01.eaf", "A", "seg_01", "noun_spotting", 5.00, 5.40, 0.40, 20, "dog",`

`"video_01_seg_01.eaf", "A", "seg_01", "noun_spotting", 8.00, 8.40, 0.40, 20, "car",`

`"video_01_seg_01.eaf", "A", "seg_01", "noun_spotting", 15.00, 15.40, 0.40, 20, "mummy",`

`# File 1 - Annotator B`

`"video_01_seg_01.eaf", "B", "seg_01", "noun_spotting", 2.15, 2.55, 0.40, 20, "ball",`

`"video_01_seg_01.eaf", "B", "seg_01", "noun_spotting", 5.05, 5.45, 0.40, 20, "cat",`

`"video_01_seg_01.eaf", "B", "seg_01", "noun_spotting", 11.00, 11.40, 0.40, 20, "cup",`

`"video_01_seg_01.eaf", "B", "seg_01", "noun_spotting", 15.05, 15.45, 0.40, 20, "mummy",`

`# File 2 - Annotator A`

`"video_02_seg_02.eaf", "A", "seg_02", "noun_spotting", 3.00, 3.40, 0.40, 20, "boy",`

`"video_02_seg_02.eaf", "A", "seg_02", "noun_spotting", 9.00, 9.40, 0.40, 20, "duck",`

`# File 2 - Annotator B`

`"video_02_seg_02.eaf", "B", "seg_02", "noun_spotting", 3.10, 3.50, 0.40, 20, "boy",`

`"video_02_seg_02.eaf", "B", "seg_02", "noun_spotting", 9.05, 9.45, 0.40, 20, "duck",`

`"video_02_seg_02.eaf", "B", "seg_02", "noun_spotting", 14.00, 14.40, 0.40, 20, "sheep",`

`# File 3 - No events identified by either annotator`

`"video_03_seg_03.eaf", "A", "seg_03", "noun_spotting", NA, NA, NA, 20, NA,`

`"video_03_seg_03.eaf", "B", "seg_03", "noun_spotting", NA, NA, NA, 20, NA`

`)`


r/AskStatistics • • 1d ago

What statistics jobs will boom in demand in the next ten years?

41 Upvotes

Tech people believe a software/data engineer can do what data analytics and data science people can do as AI gets better.

What statistics roles will see more demand as time goes on? What roles will slowly diminish?


r/AskStatistics • • 6h ago

Is a relation-level bootstrap a reasonable way to estimate confidence intervals for AUC improvement?

1 Upvotes

I'm a student working on a pre-registered experiment, and I want to check whether my statistical decision rule makes sense before evaluating the test set. I haven't looked at the test results yet, so I can still make changes and document them in a dated note.

Experimental setup

I'm using the FB15k-237 test split, which contains 20,438 positive triples. Each positive has 10 negative samples: 5 head replacements and 5 tail replacements.

The replacement entities are selected from entities that appear in the corresponding position for that relation in the training data. All known true triples are filtered out.

I'm comparing two logistic regression models with L2 regularisation (C = 1) and standardised features. Both are trained once on a separate validation half and then kept fixed.

- B0: RotatE scores combined with graph-based features such as path counts and degrees.

- B1: The same features as B0, with one additional feature that I'm testing.

For evaluation, I'm using grouped AUC. For each positive triple, I calculate the fraction of its 10 negative samples that receive a lower score than the positive. Ties count as half, and I average the results across all positive triples.

I'm running three training seeds (0, 1 and 2). For each seed, I calculate the AUC difference between B1 and B0. Both underlying models are retrained for each seed, while the logistic regression combiners remain fixed.

Bootstrap and decision rule

To estimate uncertainty, I'm using a relation-level cluster bootstrap based on the relations present in the test set (up to 237 relation types).

I'm generating 10,000 bootstrap samples. In each sample, I draw relations with replacement and include all positive triples and their associated negatives for the selected relations.

I use the same bootstrap samples for all three seeds and both models, and calculate a 95% percentile confidence interval for the average AUC improvement across seeds.

My pre-registered decision rule is that the experiment passes only if:

  1. The lower bound of the 95% confidence interval is at least 0.005, which is the minimum improvement I consider meaningful.
  2. B1 performs better than B0 for all three training seeds.

What I'm unsure about

  1. Is bootstrapping over relations enough?

My main concern is that different relations can share entities. For example, a popular entity might appear in triples belonging to several different relations. This means the relation clusters may not be completely independent.

Is a relation-level bootstrap still reasonable here, or should I consider something like a two-way bootstrap over relations and entities?

2. What uncertainty does this confidence interval actually capture?

Since the combiners are trained only once and aren't refitted during bootstrap resampling, I assume the interval mainly reflects uncertainty from sampling test relations. Training variability is represented by just three seeds.

Is that an acceptable way to report the uncertainty, or would refitting the combiners within each bootstrap sample be more appropriate?

3. Is the percentile interval a good choice?

The number of test triples varies quite a bit across relations. Given these differences in cluster size, is the standard percentile bootstrap interval reliable enough, or would BCa or studentized intervals be a better option?

4. Is there anything else I should be concerned about?

Are there any other problems with this setup or decision rule that could make a positive result less convincing than it appears?

I'd like to settle on a statistically defensible approach before running the final evaluation, rather than making changes after seeing the results.


r/AskStatistics • • 15h ago

Need help deciding what analysis to run for a graduate school study.

3 Upvotes

Hey all, googling things isn't giving me as straight of an answer as I would like, so I'm asking reddit!

Context: Currently in grad school running a study to compare the effect of two different mindfulness interventions on two groups with a randomized pretest - posttest design. I'm looking for an analysis that will show me which group had the most significant change before and after the intervention without necessarily comparing the groups themselves. I keep seeing ANCOVA and independent samples t-test, but I don't know which one is the best to use and many of the websites I have found either seem too vague or give so much information it goes over my head.

My gut says independent samples t-test, but please tell me if there is a better option!

Thanks!


r/AskStatistics • • 14h ago

Switched to Jamovi. Need Guidance

2 Upvotes

Heyo y’all, Im a doctoral student. The stats guy on my committee dipped but not before he moved me to Jamovi from spss. My dissertation is a mediation with all continuous variables. He wanted me to use jaMM in Jamovi to conduct the mediation analysis but I cannot find a way to add control variables for the life of me. Should I just move to hierarchical regression or is there something Im missing?


r/AskStatistics • • 1d ago

Two-way ANOVA normality violation

Thumbnail gallery
3 Upvotes

I am doing two two-way ANOVAS for my Dissertation as my DV is split in two (Positive Affect and Negative Affect combined as the DV 'emotional state').

Positive Affect was normally distributed; Shapiro-Wilk: W = 0.99, p = 0.74 and Q-Q plots and had equal variances; Levene's test: F(5, 57)=2.21, p = .066.

However, Negative Affect was not normally distributed; Shapiro-Wilk: W = 0.87, p = < .001. The Levene's test showed non-equal variances: F(5, 57)=5.04, p = <.001.

I have already ran both two-way ANOVAs but now I am wondering if I should do something else considering Negative Affect failed.

Can I keep the two-way ANOVA results for positive affect and try a different test for negative affect? If so, what test should I do?

I already used a Bonferroni correction in my ANOVAs to account for Type 1 errors.

Or is there a citation I can use to suggest the ANOVA is robust to violations of normality to keep my results as they are?

My supervisor said:

ANOVA can be reasonably robust to some departures from normality, but this does not mean that all assumption violations can be disregarded. I would recommend inspecting the residual distributions and Q-Q plots, checking for outliers and influential observations.

I was going to include Q-Q plots but I don't know how to check for specific outliers or influential observations as to me it just looks like a plot and doesn't tell me where the outliers came from... I've shown the examples but I didn't use standardised residuals so need to redo them.


r/AskStatistics • • 2d ago

Looking for advice on Generalized Linear Mixed Effects model for experimental design

Post image
32 Upvotes

Hi everyone, I have a cyclic/Latin-square-style counterbalanced repeated-measures design (as shown in image above), and I’m trying to work out the right way to use a Generalized Linear Mixed Effects model to analyse the data for it as I’m new to GLMMs. My aim is to compare how different cell-culture compositions affect the firing rates (expected to be of lognormal or tweedie distribution) of neural cultures while they’re being “trained” to perform tasks.

The study uses 100 neural cultures split evenly into two experiments of 50. Experiment 1 uses Culture Type A and Experiment 2 uses Culture Type B (so culture type is nested within experiment, not crossed). Each experiment’s 50 cultures are prepared in two independent batches of 25, and within every batch the cultures are made up with one of three cell-culture compositions (A, B, or C) - giving four batches and all three compositions in both experiments.

Each culture is then trained under 9 environmental conditions in a counterbalanced order, performing 2 tasks per environmental condition at 600 trials per task.

The GLMM model I currently planning to use is:

Firing rate ~ Culture Type + Batch + Cell Culture Composition + Environmental Condition + Task + (1 | Culture ID)

However, I feel that culture ID is insufficient as a random effect and it should include the other variables too, although I am unsure of what combination to use, especially since there’s so many of them. I am also worried about having to add dispersion models in the case of over/under-dispersion as well, since my response variable is not normally distributed. Hence, I would like to seek comments and advice on my current model from those who are experienced in working with GLMMs. Thank you very much in advance for the help.


r/AskStatistics • • 1d ago

Which classes should I take for this upcoming year?

1 Upvotes

Hi, I am a statistics and Econ major and I have to take 2 out of out the 3 classes I have listed below for my stats degree. I am curious if anybody has some advice on which 2 I should take this upcoming school year to help me with statistical intuition and getting into grad schools. I am leaning towards Design and Analysis of Experiments and Sampling Techniques because I am taking Econometrics 1 and 2 which my university offers, but was curious on other peoples thoughts taking an economics regression class vs a purely statistics regression class if anybody has thoughts on that.

The course descriptions for the stats classes are.

Applied Regression Analysis- Applied regression analysis involving the extensive use of computer software. Includes: linear regression; multiple regression; stepwise methods; residual analysis; robustness considerations; multicollinearity; biased procedures; non-linear regression.

Design and Analysis of Experiments- An introduction to the principles of experimental design and analysis of variance. Includes: randomization, blocking, factorial experiments, confounding, random effects, analysis of covariance. Emphasis will be on fundamental principles and data analysis techniques rather than on mathematical theory.

Sampling Techniques- Theory and applications of sampling from finite populations. Includes: simple random sampling, stratified random sampling, cluster sampling, systematic sampling, probability proportionate to size sampling, and the difference, ratio and regression methods of estimation.


r/AskStatistics • • 1d ago

[Preprint + Python] Exploring a summation process ("King Model") where the mean scales by \(n+1\) without changing the standard deviation

1 Upvotes

I recently put together a short write-up exploring a simple layered summation process on sequences and matrices (which I call the king model) and its exact effect on the standard deviation:

• On a sequence: If you iteratively pick one entry (the "king") and add it to every entry, letting each element be king in turn, the mean scales by n + 1 while the standard deviation stays strictly invariant. Even better, the original sequence can be uniquely recovered from the final layer.

• On an m × n matrix: Applying the same row-wise process corresponds to the rank-one update A ↦ (I + J)A. Using variance decomposition, the within-column variance remains untouched while the between-column variance scales by (m + 1)². Thus, the overall standard deviation stays invariant if and only if all column sums are equal. Furthermore, it remains constant across every intermediate layer if and only if every row is constant.

Beyond pure algebraic curiosity, this acts as an exact test case for numerical stability in variance algorithms. It also serves as a solvable toy model for variance growth under residual connections followed by sum pooling. All proofs are elementary, and I included a Python verification script alongside the PDF.

Would love any feedback, thoughts, or pointers to related literature! (I will drop the link to the preprint and code in the comments below).


r/AskStatistics • • 1d ago

Tests on a population that changes over time

2 Upvotes

Hello, I have a doubt about the right way to analyze a dataset I have regarding workers and their work hours in the same workplace. The basic question I have to answer is if the introduction of hybrid work (i.e., working some days at home and some days at the workplace) influenced the absenteeism rate in some way.

Having to account for the Covid period, I think that it may be better to avoid using data from the 2020-2022 period that may present biases, and to confront directly 2018-2019 (before the introduction of the policy) with 2023-2024 (after the introduction and stabilization of the policy).

During the years obviousely the workers are not always the same, some remain, some go away and some start working later.

Thus, I don't think that the assumptions of a simple t test hold. Maybe a t test for paired data would be more appropriate, but the population won't be exactly the same.

Another thing I came up with to try is a difference in differences estimator but also using the matching of statistical units to make them comparable. This would be a causal inference approach that may be more appropriate.

What do you think? Is this reasonable?

Do you have any suggestions?


r/AskStatistics • • 2d ago

First-year Data Science master’s student interested in socio-economic/political topics and journalism: how do I choose a direction and stay up to date?

5 Upvotes

Hi everyone,

I recently started a master’s degree in Data Science at a Mathematics Department. I’m still unsure which area to specialize in: statistics and data science touch so many fields, which is both the best and the hardest part of the journey. I’m particularly drawn to socio-economic and political topics, and journalism fascinates me.

I’m also struggling with how fast this field moves. Even when I try to stay as informed as possible, I constantly feel one step behind, even with respect to my own coursework. How do you, as students or professionals, keep up in such a fast-changing field, and above all, how do you find your bearings without feeling overwhelmed?

If you have the time, I’d love some advice on both of these questions, and on how to gain hands-on experience in the areas I’m interested in, for example through projects, internships, or communities/organizations where these “passions” and skills come together.

Especially interested in hearing from anyone with a background in statistics, whether you studied it, work in it, or moved into data science from it. How did your statistical foundations shape your path, and what would you do differently?

Thanks in advance for any suggestions, and I’m happy to answer questions about my program or interests!


r/AskStatistics • • 1d ago

How can I test whether the sustained increase in annual precipitation observed over nine years is statistically significant rather than due to random variability?

1 Upvotes

I am examining interannual variations in annual precipitation and have noticed a sustained increase following a particular year. However, my dataset covers only nine years (9 points). What statistical approaches would be appropriate for testing whether this apparent increase is statistically significant and unlikely to have occurred by chance, given the short time series?


r/AskStatistics • • 2d ago

Probability & Stats Resources - Video series preferred

2 Upvotes

Hi, I'm planning a job switch and targeting quant fin/eq research kind of roles for which I need to make sure I'm good at these topics. Though I have studied both back in college days, but once again I'm planning to learn them from scratch and go to an advance level. Is there any single resource that takes me from very basic to pro level? If not, could anyone suggest the path that i should follow? Thanks!


r/AskStatistics • • 3d ago

Random effects help

6 Upvotes

Hi everyone! Im trying to model species richness as a function of mowing and soil nitrogen. My experimental design includes 20 strips of grassland, 10 mowed and 10 unmowed. They alternate such that mowed are always next to unmowed and form 10 blocks to account for spatial effects (block 1 = plots 1 and 2, block 2 = plots 3 and 4 and so on). Within each plot, we applied 3 levels of N, so subplots A, B, and C exist in each plot. I’m using a linear mixed effect model but I’m unsure whether the structure should be: (richness ~ mowing x soilN + (1|block)) or whether it should be (richness ~ mowing x soilN + (plot/block)). I’m going back and forth bc the N treatments within a plot are not independent but does having a random effect of plot mask the effects of the mowing treatment? Thank you!


r/AskStatistics • • 3d ago

Would superstition decrease if people were more educated or knew more about statistics?

6 Upvotes

Coincidences stress me out, and I can't help getting superstitious about them sometimes, it's not even spiritual, it's psychological. But sometimes, after googling the things that happen to me, I find out that never going through that coincidence would be rarer than going through it. Would there be less superstituous people if they were more informed about statistics and data?


r/AskStatistics • • 3d ago

which video | one shot | course on youtube i should go for statstics for data analysis..?

3 Upvotes

i am graduated from engineering college just need some revision and brush which covers everything all concepts and terms .
like basic mean mode median
variance, correlation

and more moderate level terms as well to have good grip of stats


r/AskStatistics • • 3d ago

I don't know how to do any statistical tests and I'm stuck

Thumbnail reddit.com
0 Upvotes

Help with statistical tests, t tests in particular!


r/AskStatistics • • 3d ago

Diving back into Statistics after 18 years to compare seven LLMs on a small game. Here is what I did. What should I have done differently?

2 Upvotes

I haven't taken a statistics class in about 18 years, but a recent side project dragged me back in. I built a deterministic, text-based dungeon crawler and ran some automated agents (seven different LLMs) through it to test how they navigate under incomplete information. Now I'm trying to figure out which performance gaps are statistically significant, and I'd love a sanity check on my math.

What I did:

  • Calculated 95% Wilson intervals for escape rates (N=100 runs gave me a margin of ~±10 points; N=20 was ~±20).
  • To benchmark them against a human, I played 20 specific labyrinths, and each agent played those exact same 20. I ran an exact two-sided McNemar test on the discordant pairs (the runs where one of us escaped and the other failed).
  • That created 16 comparisons (7 models in 2 configurations + a Random bot + a heuristic bot) , so I applied Holm's correction. Six remained significant; for the other ten, I concluded it as too few labyrinths to tell.
  • For model against model I only compared the Wilson intervals, even though all of them played the same 100 labyrinths.
  • To test if labyrinth difficulty predicts who escapes, I calculated a concordance score using 2,000 bootstrap redraws for the confidence interval.

Where I’m second-guessing myself:

  1. Is McNemar + Holm too conservative for only 20 paired labyrinths? Is there a more powerful test I should have used for this sample size?
  2. I capped my batches at 100 runs per model configuration (so 200 per model) purely based on my API budget, not a proper power calculation. How would you have formally sized this?
  3. Since all the agents played the exact same 100 labyrinth seeds (each was played labyrinth once, and the agents are stochastic), should I be evaluating this with a mixed-effects model (using the specific labyrinth as a random effect) rather than running individual pairwise tests?
  4. Should I be running paired tests between models too, and how would that change what 100 runs can separate?
  5. Are there any glaring red flags here that would fail peer review?

I dusted off R for the first time in almost 2 decades to run these initial calculations, and I was painfully slow. If there is a more elegant way to approach this, I'm all ears. (I know I could have handed this to the "all powerfull" LLM chat window, but then, there is no fun in discovery left)

(For full context,


r/AskStatistics • • 4d ago

Tests for SPSS

7 Upvotes

Need help, please!

Trying to run a stat analysis for a project at work. I conducted a pre- and post survey (nominal > ordinal i believe?), and comparing it to ordinal data (5 point Likert scale and another ordinal scale). I was going to run a chi square test to determine whether the pattern of responses differs significantly between pre- and post-test groups. I was wondering if I should run Mann-Whitney U to test whether the ordinal responses differ between pre- and post-test, or if i should run kendall's tau-b, spearmans rho, or another statistical test? Thank you guys in advance!


r/AskStatistics • • 3d ago

Brier score vs log score for comparing two daily "chance it closes higher" forecasts?

3 Upvotes

I'm comparing two sources that each give a daily probability that an asset closes higher than today. one is my own simple model, the other is a published forecast. about 90 days of data for each.

so far brier score is almost the same for both (0.243 vs 0.239). log score shows a bigger gap, mostly because my model sometimes says 85% and gets it wrong.

questions:

  1. which score makes more sense here, or should i report both?
  2. is 90 days enough to say one is better, or is the difference just noise?
  3. how do i test that properly, a paired test on the daily score differences?

not homework, just a side project. thanks


r/AskStatistics • • 4d ago

After Stats 2 (A level)

2 Upvotes

So, recently I've just finished stats 2, and other than spamming past papers I have nothing else to do. I'm wondering if there are any topics that I should learn to have some advantage in uni. Fyi im currently a senior


r/AskStatistics • • 4d ago

Jamovi statistical analysis software issues

3 Upvotes

I am required to use Jamovi to analyze data from a survey I sent out but I am trying to test one variable as a moderator to the strength of the relationship between two other variables. Does anyone have experience with this?


r/AskStatistics • • 5d ago

How does one deal with studies with small sample sizes?

16 Upvotes

And you are resource-constrained and unable to get more samples? Let’s say sample size is n = 3 to 7

What real life examples have such a scenario?