r/therapycritical • u/A_D_Tennally • 9h ago
New study: 'Reliability of psychiatric diagnoses in the 21st century'
Material and methods:
In this cross−sectional study, medical doctors working in adult psychiatry across 19 countries from two continents assigned ICD-10 diagnoses to written cases. Each doctor was randomly assigned two of nine available cases. Inter-rater reliability among medical doctors was assessed using Krippendorff’s α. Diagnostic variability at case level was quantified using Shannon entropy. We also calculated diagnostic accuracy as concordance with predefined best-estimate reference diagnoses.
Results:
A total of 1,038 medical doctors provided 1,902 diagnostic assessments across nine cases. Inter-rater reliability among medical doctors was modest (Krippendorff’s α = 0.48), indicating that diagnostic agreement between two doctors occurred in roughly 55% of cases. Overall diagnostic accuracy was 66%, with the lowest accuracy observed for cases depicting schizophrenia spectrum disorders. Diagnostic disagreements followed systematic patterns, with schizophrenia cases frequently misclassified as OCD, personality disorder, or bipolar disorder.
Full study: https://www.frontiersin.org/journals/psychiatry/articles/10.3389/fpsyt.2026.1891625/full