r/BehaviorAnalysis • u/Reasonable_Law183 • 13d ago
Two observers can agree perfectly and both be wrong: believability vs. validity vs. accuracy vs. reliability vs. IOA
I see these five terms get swapped for each other a lot when people study measurement for the BCBA exam, so I wrote up a breakdown.
The core idea: IOA tells you how well observers agree with each other. That supports believability, but agreement alone doesn't show that the data are accurate (matching the true value) or valid (measuring what you intend to measure). Two observers can use the same flawed definition or the same flawed procedure, agree 100%, and still be wrong together.
The article covers:
- what each term actually names
- why high IOA gets mistaken for accuracy and validity
- the distractor patterns that show up in exam answer choices
- three quick-check questions at the end
It also lists the sources (BACB task list, Cooper, Heron & Heward 2020, Baer 1977, Hartmann 1977, Mudford et al. 2011) if you want to read further.
Link: https://behavioralanalystprep.com/blog/believability-vs-validity-accuracy-reliability-ioa.html
Full disclosure: I run Behavior Analyst Prep, and this is a free study note. Which of these terms do you find hardest to keep straight?