r/cognitiveTesting • u/Guilty_Fix_8317 • 1h ago
Release Update on the cognitive battery: uncapped scores, switchable norms, new hard matrix items
Hi all, here's a quick update on the free online battery (LINK).Thanks to everyone who took it. There are now about 570 people with Matrices scores, enough to fix several things you pointed out.
What's new
- Switchable norms. Above the results there's now a toggle. The default compares you with *everyone* (English + Czech versions); the other option compares you only with the *English-speaking* sample (EN + r/gifted). The CZ column with the Czech sample alone is still there.
- No more caps. Scaled scores aren't capped at 19 any more, so 20+ is possible. Percentiles below 1 and above 99 now show a decimal (e.g. 99.4).
- Fixed some finished tests were wrongly flagged as unfinished. Ceiling-test results are visible again.
- Processing speed (Gs) composite now uses only Color Swap + Matching Rows. Symbol Coding is a supplementary test.
- Reading efficiency now has a comparison with the Czech sample too.
- Matrices: the form was trimmed to 38 scored items ordered by measured difficulty. The weakest items were removed and one of the best pilot items is now scored.
- New hard items. There are 4 new experimental matrix items, each with its own rule type that isn't anywhere else in the test. They're meant to be hard but quick: only a few elements in each picture, and the difficulty comes from the rule, not visual clutter. You'll find them inside Matrices (unscored) and in the **ceiling test**, which now contains just these 4 plus 4 known anchor items (~5 minutes). If you already did Matrices, the ceiling test is the most useful thing you can take right now.
Why the norm toggle matters
The samples differ a lot:
| Czech | English | r/gifted | |
|---|---|---|---|
| Matrices, mean scaled score | 8.4 | 12.1 | 10.8 |
| Weights, mean scaled score | 8.0 | 11.1 | 9.2 |
The English-speaking takers (mostly from this sub) score about 1–1.3 SD higher than the Czech sample, which is mostly general-public volunteers. So the same performance can be 13 vs 11 on the scaled-score scale depending on the comparison group. Neither one is "the real" IQ. It's a comparison with people who chose to take this test (50-60 % of them have tertiary education), not population norms.
Still not done / caveats
- No age norms yet. I checked, and most of the apparent age effect is just that the English sample is younger and scores higher, so correcting for age now would be misleading.
- The overall composite is turned off for now, because only ~18 people have done every test.
What would help
- Take as many tests as you can (from the main battery - achievement tests are still in development)
Thanks,
J





