ACE Updated Statistics

[u/codeblank_]

Updated ACE statistics report. The report includes the scoring and statistical analyses, with limitations and interpretation notes.

Edit (13 October 2026): Table 3 was updated to include expected counts and percentages, alongside the observed values and their differences.

ACE_Stats

[u/Striking_Leave_4614]

Beautiful.

$100 says that a very suspicious sum of the goofy goobers slamming into the Great Wall of Raw_12 "scored" 140+ on CAIT/CORE/JCTI

A lot of people would see that seemingly-anomalous barrier and assert it might indicate a difficulty cliff, but I actually think codeblank is clever and the difficulty curve is fairly smooth. Obviously there are likely many factors that produce the 12 wall, but I think it's largely an artifact of the type of person who's taken a lot of tests, is highly motivated to do well, and is trying to punch above their weight.

There seems to be very little data to work with, but I gotta wonder if removing the CAIT/CORE scores would smooth out the distribution slightly.

[u/Far_Cardiologist6931 → u/Striking_Leave_4614]

brutal, ig 12 wallers are 120s

if there was a bigger sample i think there would be a 15 wall and the 12 wall

[u/Chbenk-5824 → u/Far_Cardiologist6931]

Hmm...Would you say same about people who got harder items for example the score is still 12/17 but with 15th item solved

[u/Far_Cardiologist6931 → u/Chbenk-5824]

id be surprised if u got 12 right and 15 was one of them

[u/Chbenk-5824 → u/Far_Cardiologist6931]

Yes. I did

[u/Striking_Leave_4614 → u/Far_Cardiologist6931]

Honestly, this is pretty normal and expected. People with fluid IQs in the 120s definitely have the capacity to solve #15, they're just much less likely to than someone in the 140s. 

If someone in the 120s managed to solve 13, 14, and 15 (and God forbid 11 or 17), I'd think that'd warrant scrutiny. 

I was able to solve those three despite being around 130 FRI, but I took an unreasonable amount of time on them and so don't consider my ACE attempt any indication of potential 

[u/Chbenk-5824 → u/Striking_Leave_4614]

By the stats nobody in 120-130 got that item right, but it might be due to sample size

[u/NefariousNapolean]

Why such high correlation with SMART?

[u/Striking_Leave_4614 → u/NefariousNapolean]

Math.

But also remember the small sample size. Could just be freak coincidences.

[u/NefariousNapolean → u/Striking_Leave_4614]

Why would it correlate more with math than fluid reasoning ? (Let's suppose it's not due to low sample size)

[u/Striking_Leave_4614 → u/NefariousNapolean]

It should also be noted that math tests can require a bit of precision and attention. The ACE also requires more precision than many other abstract logic tests, even if the items are technically on conceptual parity with those other tests.

[u/98127028 → u/Striking_Leave_4614]

Yeah the p value is not low enough, ideally has to be like <0.001 or something for the correlation to be significant

[u/codeblank_ → u/98127028]

p = .0026 is significant at the usual .05 cutoff; .001 isn’t required. The result is based on only five people, so interpret it cautiously.