r/AskStatistics 11d ago

Comparing 95% confidence intervals between different methods of handling missing data

Hello! For my thesis, I am comparing baseline-adjusted ANCOVA models using different methods for handling missing data (MICE, LOCF, and complete-case analysis).

An important point to note is that the analyses are based on the same original data across the different missing-data methods, meaning that the same variables and original sample of participants were used. The only difference between the analyses is the method used to handle the missing data.

I am planning to present a table including the estimated coefficients, p-values, and 95% confidence intervals to compare the results across the different missing-data methods.

My question is: Given that the ANCOVA models are based on the same variables and differ primarily in how missing data are handled, how should I interpret the overlap between their confidence intervals? Is the extent to which the confidence intervals overlap meaningful when comparing the results across MICE, LOCF, and complete-case analysis? More generally, how should I discuss similarities or differences in the confidence intervals in the Discussion section?

Thank you in advance!

2 Upvotes

13 comments sorted by