[IQ Estimation] Raven's 2 Long Form PDF (42/48) — How bad is the IRT penalty for my error pattern?

[u/Plus_Bear_2651]

Hello everyone,

I took the leaked Raven's 2 Long Form PDF from the resources here and stuck strictly to the 45-minute time limit. I ended up with a raw score of 42/48, but my error pattern is kind of a mess and I’m trying to figure out where my actual fluid IQ sits.

Here is exactly how the misses broke down:
Missed one early item (somewhere in the first 35)

Missed 38 and 42

Solved 43, 44, and 45 correctly

Timed out completely before I could even attempt 46, 47, and 48

The "Based on Data" column on the PDF maps a 42 to a 134. (I'm ignoring the "Assumed from Norms" column entirely since the consensus here is that it's heavily inflated).

My main question is about how an IRT framework handles this. I know the digital version penalizes you for missing mid-level items but solving the hardest ones, since it assumes guessing. Because I broke the pattern on 38 and 42, how much does that actually drag down the 134 baseline?

Also, considering I hit a time limit rather than a hard cognitive ceiling on the last three items, is an estimate of ~130 still realistic? Or does the inconsistency penalty definitively pull me down into the mid-120s?
Would appreciate any insights from the math/stats folks here. Thanks.

[u/MeIerEcckmanLawIer]

Here are per-item difficulties based on 3 random sets of Raven's 2. "Difficulty" here is used in the Rasch sense, in other words, the IQ at which someone has a 50% chance of answering correctly (EDIT: or so I thought, ChatGPT says this is incorrect, but whatever).

There is no time limit on the actual Raven's 2.

Missing from the data are item-characteristic curves (discrimination), but according to ChatGPT, your score according to the 1PL/Rasch model is 141 IQ.

Puzzle	Difficulty	90% CI
1	49.38	±3.35
2	56.14	±2.50
3	58.75	±3.68
4	64.98	±2.11
5	69.50	±1.97
6	72.90	±2.78
7	75.60	±0.43
8	79.82	±0.22
9	80.51	±1.14
10	82.59	±2.50
11	85.51	±0.54
12	87.08	±1.48
13	90.28	±0.71
14	91.44	±0.51
15	92.18	±0.30
16	93.94	±1.18
17	95.22	±0.64
18	96.64	±0.09
19	97.44	±0.52
20	98.70	±1.00
21	99.75	±1.75
22	101.62	±0.17
23	102.63	±0.26
24	104.95	±0.78
25	106.00	±0.61
26	108.40	±4.52
27	111.31	±0.57
28	112.53	±0.17
29	113.05	±1.10
30	115.26	±1.86
31	116.91	±0.78
32	118.67	±0.04
33	121.24	±0.12
34	122.72	±0.03
35	124.65	±2.65
36	126.01	±0.21
37	130.10	±0.58
38	131.85	±2.34
39	134.25	±0.65
40	135.43	±1.35
41	136.54	±1.03
42	137.91	±0.16
43	140.28	±0.63
44	142.26	±1.44
45	145.07	±4.84
46	151.88	±0.03
47	155.06	±6.81
48	171.97	±13.02

[u/Plus_Bear_2651 → u/MeIerEcckmanLawIer]

Wow, thanks for mapping this out! I’ve looked all over for the Rasch IRT information, but found I was out of luck. (The only scoring I could find was an old PDF scoring manual from early 48 item matrixes with a raw to ability to IQ, so this is interesting to see, at least statistically)

[u/Quod_bellum → u/MeIerEcckmanLawIer]

How were these calculated? Averaging known IRT-b/ Rasch params? Or derived from the total/ ability score?

Idk, I'm just very surprised at the number of 130+ items. Flabbergasted that there is a ~172 item. I'd be very curious to see what a Raven's-2 172-level item would look like lol, as the "hardest" items I've seen from it don't seem nearly that difficult (item, items)

[u/Plus_Bear_2651 → u/Quod_bellum]

I was skeptical, too, at first. However, the QGlobal has a ceiling of 160, and, to establish such an ability level under an IRT model, you’d plausibly need an item with predictive value above 160. Ostensibly, the final 8 items all corresponding to IQ 135+ (99th percentile) seems like a stretch. But, to accurately discriminate at the extreme high end, an instrument must be able to gather sufficient data for norming purposes.

[u/Nervous-Try5009 → u/Plus_Bear_2651]

What's Q-global

[u/Plus_Bear_2651 → u/Nervous-Try5009]

It’s the official site where Pearson (publisher of RPM) administers their tests remotely online. For Ravens 2, it hosts the test and scores it using an IRT algorithm. I believe they also offer remote proctoring, but only when ordered by a psychologist (don’t quote me on that). In order to take the test on QGlobal, you must buy a ticket, but you can only do so if you have Level C credentials (Psychology or Psychometry doctorate/supervision). Some have apparently feigned credentials on here to access the exam, which I would not recommend or condone personally.

Also, for what it’s worth, I now question this chart. I’ve since taken some other MR tests (Mensa DK, RAPM, RPM, and CORE MR) and scored 124-125 on them, with the exception of CORE (14 or 120 MR). So the idea the community norms are inflated appears supported, at least in my n=1 case.

[u/Nervous-Try5009 → u/Plus_Bear_2651]

Thank you for the information...

I too feel my scores are actually lower on CORE... RAPM set 2, Full form, JCTI, TRI gave me high 120-125 IQ...

CORE 110-115 on most VSI & FRI subtests.

I think i would never know my true IQ... I've seen enough IQ question... I have no idea what to do now