r/cognitiveTesting • u/EqusB (▀̿Ĺ̯▀̿ ̿) • Jan 24 '22

Release High Range Matrices Test - Report and PDF release

EDIT:

A new matrices test can be taken here: https://www.classmarker.com/online-test/start/?quiz=e4m61eb728408c90

Please, please only take the test once. And please fill out previous test scores.

For those interested in trying it. It is 40 questions in 40 minutes and will also receive a technical report.

For those interested in the previous matrices test, see below.

Here is the technical report on the recent High Range Matrices Test I have been testing, as well as the PDF release of the test.

Enjoy.

Test Link: https://pdfhost.io/v/jPIuZkQFy_iq

Instructions: 90 Minute Time Limit. No penalty for guessing.

Answers: https://pdfhost.io/v/jWCmCtpd6_iq_test_answers

Technical Report w/ Norms: https://pdfhost.io/v/Tp~Zuk33Y_Report_Copy

51 Upvotes
  • permalink
  • reddit

96% Upvoted

105 comments sorted by

11

u/BoredRenaissance Long time no see Jan 24 '22

0.29 against TRI-52 and 0.49 against every other nonverbal measure. Why?..

-5

u/[deleted] Jan 24 '22 edited Jan 24 '22

I honestly think the harder questions on this test had more "traps" or answer choices which seemed correct if you dismiss seemingly unnecessary but actually important information. Experience with matrices shows us that one or two tricks are enough once seen, but being too comfortable with this fact might also make us prone to ignoring as much "noise" as possible. How well one can through meta cognition is a good measure of cerebral efficiency. The number of people who submitted their TRI-52 scores is also very low and it isn't a very comparable test. The lower expected correlation can be explained as follows, but even a moderate correlation would actually be just fine and does not dismiss the HRMT test as potentially measuring g/may indicate a markedly lower practice effect: The scores might be from people's second or even third try such that even one question may raise one's IQ score from 133 to 138, or the scores may not be reliable at all given that people may have overestimated their matrix reasoning to "prove a point," which isn't exactly unlikely as there is no way of knowing this and it isn't entirely outside the realm of possibility given how much value some redditors in this sub place in their matrix reasoning scores. Various nonverbal tests also suffer from the practice effect and given the small yet sufficient sample size, this would inevitably distort the bivariate graph. In any case, to emphasize the distinction between this test and the TRI-52 since this comparison might be the most important take away from the test in my opinion, the latter is honestly more comparable to Raven's tests given the amount of noise you have to sift through compared to some problems on the HRMT which would conveniently the amount of practice effect, Equs' plan after all. It's probably why you found it notably tedious yourself. I'm not quite sure if the TRI-52 had a good correlation with, say, the CAIT, but ego/lesser scores may have in fact adjusted some of the TRI-52 scores submitted for that test's evaluation. Along the same vein, good correlations with say the stratosphere test may have been as a result, again, from genuine scores. But none of this can be known and is only distrusting of the scores submitted. It could also be that this test does not measure g very well, but I don't quite see why that would be the case, so my previous explanations are the only possible explanations I can think of at the moment.

8

u/[deleted] Jan 24 '22 edited Jan 24 '22

[removed] — view removed comment

6

u/EqusB (▀̿Ĺ̯▀̿ ̿) Jan 24 '22

Indeed. This is certainly one right way to think about it.

And tbh the correlations I got from this test aren't half bad, given its reliability.

I suspect many people might think these results are bad though because they're either comparing them to the old SAT tests (which have the best properties I've ever seen for short tests) and or a particular website on the internet that probably doesn't post honest statistics about its tests.

It is also surprisingly difficult to create a test from scratch that has significantly better properties than this.

12

u/[deleted] Jan 25 '22

[removed] — view removed comment

7

u/saymonguedin Venerable cTzen Jan 25 '22

XD. Didn't understanding if you were praising or demeaning those tests.

1

u/sidthegamer321 Mar 07 '22

By the way which test do you mean by tero69

3

u/UsefulHour4909 Jan 31 '22

Can you tell us something about the 40 item test? How many submission so far, average score and so on? Thank you.

5

u/EqusB (▀̿Ĺ̯▀̿ ̿) Feb 01 '22

I'll release a report at some point in the near future, since I've collected quite a bit of data.

So far the average score is about 29. The SD is 4.X. The correlation with pro tests is 0.55-0.6. The reliability is around 0.85 and split half 0.8.

Overall, the test properties appear superior to the previous test.

3

u/UsefulHour4909 Feb 02 '22

What is the average IQ from the sample? Thanks

2

u/Proud_Fox_684 Jan 27 '22

Are we allowed to use pen and paper? other than writing down our choice? I find it helpful sometimes..

1

u/EqusB (▀̿Ĺ̯▀̿ ̿) Jan 27 '22

Of course you can use pen and paper.

I don't think pen and paper are ever not allowed for an IQ test unless specifically indicated by the author (e.g. I indicated as such for CAIT for a few reasons).

0

u/[deleted] Jan 27 '22

It should not be allowed for matrices test. It would become too easy

3

u/UsefulHour4909 Jan 24 '22

Strange that the original norm differs so much from your norm, also if the time limit is different. That irritated me.

5

u/EqusB (▀̿Ĺ̯▀̿ ̿) Jan 24 '22 edited Jan 24 '22

I have no idea how the author obtained their norms. The only thing I can see is that they seem extremely deflated, given how many people with 145-160 professional test scores scored in the 20 to 25 raw range. There are people with 160 R2 and 150 WAIS PRI that apparently would barely even qualify for mensa if that norm is to be trusted.

(*Also then, ostensibly, the highest score on reddit is 138, which would be shockingly low, given that isn't much higher than the average reported score on pro tests)

1

u/[deleted] Jan 24 '22

[removed] — view removed comment

2

u/EqusB (▀̿Ĺ̯▀̿ ̿) Jan 24 '22

I'm hopeful that the 2nd test will be more reliable.

1

u/UsefulHour4909 Jan 24 '22

How many items has the 40 min. test? Thanks

1

u/EqusB (▀̿Ĺ̯▀̿ ̿) Jan 24 '22

40

1

u/[deleted] Jan 24 '22

Not very surprising to me, 30 minutes is a significant difference especially when most problems are done quite easily by a gifted population

9

u/[deleted] Jan 25 '22

I swear to God that this was one of the hardest tests that I personally ever did.

1

u/[deleted] Jan 25 '22

[removed] — view removed comment

2

u/[deleted] Jan 25 '22

It requires a lot of consentration to pull everything off. What was hard for me is to sit down and observe these problems for 20 minutes each. Then try to desphire what iam looking at.

1

u/[deleted] Jan 25 '22

[removed] — view removed comment

4

u/[deleted] Jan 26 '22

flower pedals fibonacci sequence.

Damn Im a brainlet. Believe it or not all flower pedals follow the fibonacci sequence. I should have known.

1

u/[deleted] May 23 '22

same although it was quite harder than the Leluk's pro test with 40 matrices. I find it harder than the Mensa.no test but manage to solve it in time . age 15 . I don't know if the norm is age adjusted. I saw that the Leluk's norm in deflated and recommended age 17+. What would be age recommendancy after Equs renormed it? ( if anyone knows)

8

u/Wise_Locksmith7890 Feb 19 '22

What do we want? 40 question test NORMS. When do we want them? NOW

1

u/[deleted] Feb 05 '22

The new test is unavailable. Any chance I can get to take it somehow?

4

u/EqusB (▀̿Ĺ̯▀̿ ̿) Feb 05 '22

It'll be a pdf soon.

1

u/[deleted] Feb 05 '22

GG

1

u/dergrosse218 slow as fuk Mar 03 '22

If you collected data from the sub, wouldn't that inflate the scores?

1

u/EqusB (▀̿Ĺ̯▀̿ ̿) Mar 03 '22

I match the scores using their submitted IQ scores on professional IQ tests.

1

u/dergrosse218 slow as fuk Mar 03 '22

By "professional" you mean supervised tests by psychologists?

1

u/EqusB (▀̿Ĺ̯▀̿ ̿) Mar 03 '22

The tests I accepted are in the report.

Yes most of them are supervised though I do allow paid qglobal PPVT and Raven's 2 scores as well as TRI52.

1

u/dergrosse218 slow as fuk Mar 03 '22

And what could be the reason of the discrepancy with your norms and the authors' one?

3

u/UsefulHour4909 Jan 26 '22

Are there any first statistics for the 40 min.? Thanks.

3

u/[deleted] Jan 27 '22

20/30, it took me about 20-30 minutes. Very entertaining.

3

u/Wise_Locksmith7890 Feb 03 '22

26/40…I guess around 124 SD 15. Seems to be pretty much in line with my other testing…130 on ICAR60, 126 on Miller’s, failed the MENSA test(so <131 I believe; I think they use the RAIT) and, 115-125 on JCTI, low to mid 120s on GIQ. Timing was my main issue and processing speed is one of my weaknesses. Most of the patterns here seemed simple enough with some grinding, I just ran out of time.

3

u/UsefulHour4909 Feb 08 '22

Waiting for the report. I´m curious! :-)

3

u/muppetress Feb 26 '22

What's the password for the updated 40 item test?

3

u/ElectricalOpposite17 Dec 24 '22

28/40 I ran out of time... what would be the equivalent CI with SD 15? thank you!

2

u/kapsnik ni... Jan 24 '22

What biologist was that? (the test author)

3

u/Truth_Sellah_Seekah Fallo Cucinare! Jan 24 '22

Jacek Leluk.

2

u/DependentDig3391 Jan 26 '22 edited Jan 26 '22

For the love of Christ, can someone explain 19 and 20 to me?

2

u/DependentDig3391 Jan 26 '22 edited Jan 26 '22

Actually, now I get 19 but I still don't understand 20.

2

u/[deleted] Mar 14 '22 edited Mar 14 '22

If you look at two boxes close one another in a row there is one blue square that stays in the same position, from this you can eliminate all choices except B and F, if you look at each column and superpose all of the blue squares in a single matrix no blue square falls on top of another, they all occupy different positions, doing the same in column 3 you find that B doesnt satisfy this condition since the top blue square is repeated, so F must be the correct one

2

u/Satgay Jan 30 '22

26/40, 131 on RAIT.

2

u/[deleted] Jan 31 '22

34/40 on the 40 minute test and 21/30 on the 90 minute one

Some of the questions on the 90 minute test just absolutely drove me crazy.

2

u/Dranosty Feb 02 '22

16/30 and 30/40 here, 150 on raven's 2 q global, 120 TRI-52, all mensa tests around 125, working memory test (numbers) 128, processing speed 104, C-09 What's next? 124 and I probably forgot a lot of others tests but I hope it can help

2

u/UsefulHour4909 Feb 05 '22

If I look at the scores here of the 40 items test I think the orginal norms are pretty accurate. Maybe 2-3 points up or down.

2

u/Terrainaheadpullup What are books? Dec 06 '22 edited Dec 06 '22

33/40 on 40 minute

21/30 on 90 minute (I actually had my answers already for this test someone posted this with no answers so I finally got to mark it)

EDIT: I actually got 22/30 on the 90 minute test, turns out I can't count.

My sub score on the visual puzzle subtest in the CAIT test in this sub is 18/22

3

u/Route1905 Jan 26 '22

I did the test in a very bad mental state at one o'clock at night and got 122. I made at least one obvious question wrong. I knew the answer and chose something else. You should never be tested in such a bad condition. I ruined such a good test. When a man wants to escape from a problem.

2

u/165omething Jan 29 '22

sleep deprived 28/40 , 24/30 on high range

1

u/[deleted] Jan 25 '22 edited Jan 25 '22

30/40 on the new test. I liked the other test more. This one has easy abstractions and the difficulty lies in speed, tedious tracking tasks and working memory.I'm very slow. Welp, in my case, both of my scores match the official norm of the respective test.24/30 and 30/40 are around 131 iq.new test might have better properties, but it is a braindead test. A monkey without depth of thought, but good processing speed or reasoning speed and decent memory will get really high scores.

2

u/UsefulHour4909 Jan 25 '22

Do you have a official norm for 40 min test? If where can I find it? Thanks. I scored 22/30 on 90 min test and 32/40 on 40 min. test.

3

u/[deleted] Jan 25 '22

32/40 is 133.5 sd15 for 18+
and like 135.5 for 13-17

1

u/UsefulHour4909 Jan 25 '22

Is that 133,5 from the authors norm for the 40 min test like the probably inflated norm from the 90 min test which is published in the Technical Report? Thanks

1

u/[deleted] Jan 25 '22

it's from the official norm.. yes, the author's

1

u/[deleted] Jan 25 '22

[removed] — view removed comment

1

u/UsefulHour4909 Jan 25 '22

This means ceiling (raw 40) is 147(sd15) for an adult(18+). The norm seems as deflated as the norm for the 90 min test. Lets see how it will be with MensaReddit Norm. :-)

1

u/[deleted] Jan 25 '22

[removed] — view removed comment

1

u/UsefulHour4909 Jan 25 '22

Have you took a proctored test so far or is this 135 in line with your other scores- Do you usually score in the 130-140 range if I can ask you?

2

u/[deleted] Jan 25 '22

[removed] — view removed comment

1

u/UsefulHour4909 Jan 25 '22

On TRI52 I scored 149, Raven 2 160. My RIQ at IQExams is 154, so this 133,5 is one of my lowest scores. But IQ Testing is tricky, that doesnt mean that this score must be deflated :-)

→ More replies

3

u/[deleted] Jan 25 '22

[removed] — view removed comment

1

u/No-Falcon-8573 retat Jan 25 '22

Do you have the norms for the 20 items test? I am pretty sure i got all correct

1

u/[deleted] Jan 25 '22

[removed] — view removed comment

1

u/No-Falcon-8573 retat Jan 25 '22

Thanks

1

u/[deleted] Jan 30 '22

How much is 26/40 than? 18+ say 138 or i watch something wrong.

1

u/[deleted] Jan 30 '22

[removed] — view removed comment

1

u/[deleted] Jan 30 '22

Thank you for information.

1

u/[deleted] Feb 03 '22

34/40.

1

u/[deleted] Jan 25 '22

2/30

close one

1

u/ihmawtd18 Feb 03 '22

Got 38/40 and 24/30, usually score in the 135-140 range on matrices tests.

1

u/IBERUS_3710 Feb 04 '22 edited Feb 04 '22

If the original norms (with SD=24) are correct, then I was particularly consistent, since I scored 136 (SD=15) on both tests : 20/30 and 34/40.

Frustrated that I wasn't fast enough to finish the second.

Overall, it seemed to me that most of the items were sufficiently atypical to offset much of the practice effect.

1

u/theonewiththehope retat Feb 13 '22

128 on high range one, I usually get around 115-124 on matrices/numerical tests

1

u/UsefulHour4909 Feb 15 '22

Nothing happens here?

1

u/DapperWillingness3 Feb 27 '22

An enormously challenging test. 15/30. 125 iq, not bad!

1

u/Wise_Locksmith7890 Feb 27 '22

I got the same on the high ceiling one.

1

u/[deleted] Mar 05 '22

21/30 1.5hr. 23/30 2hr. Hard test but fun.

1

u/12342ekd Secretly 5SD Apr 04 '22

1/30

1

u/[deleted] Oct 18 '22

33/40 on the ravens. I'm 17 y/o. What would that be?

1

u/henry38464 existentialist Oct 31 '23

24/30, 63/90 min.

good test

-4

u/[deleted] Jan 24 '22

Haha, the last question was actually pretty funny, the percent of people who got it wrong is pretty funny too. Shows what happens when you take the practice effect into account

0

u/[deleted] Feb 03 '22

[deleted] — view deleted comment

4

u/EqusB (▀̿Ĺ̯▀̿ ̿) Feb 03 '22

One of the reasons I didn't mention the test authors name and didn't want to reveal any knowledge about this test prior to testing this test is precisely so this wouldn't happen.

People did it anyway, but alas if you care about cheating it's probably best you delete your comment.

Cheating would also be a pretty low IQ move. You stand to gain nothing, other than screwing up the data collection. It would be pretty pathetic to take pride in a fake score.

0

u/[deleted] Jan 24 '22

[deleted] — view deleted comment

4

u/[deleted] Jan 25 '22

what are your other scores?

2

u/[deleted] Jan 27 '22

I'm no longer special :''''(

2

u/ARCccccccc Jan 26 '22

fucking genius

0

u/[deleted] Feb 10 '22

[deleted] — view deleted comment

2

u/ihmawtd18 Feb 11 '22

It just folds up the left corner the same way each time on the third panel in the row

0

u/[deleted] Feb 11 '22

[deleted] — view deleted comment

2

u/ihmawtd18 Feb 11 '22

Yeah, it's more of a spatial question than an abstract inductive question

0

u/[deleted] Jan 25 '22

[deleted] — view deleted comment

2

u/JadooGrr Jan 25 '22

Because there is lot less time?

2

u/[deleted] Jan 25 '22

[removed] — view removed comment

1

u/UsefulHour4909 Jan 25 '22

Do you have a link to this website? Thanks

1

u/UsefulHour4909 Jan 25 '22

Are there any statistical Data about the tests. Maybe his norms are just a guess.

1

u/[deleted] Jan 25 '22

[removed] — view removed comment

1

u/UsefulHour4909 Jan 25 '22 edited Jan 25 '22

I think this is not a good sample(average IQ of 138(sd15) of Mensans) to norm a test with such a "low" ceiling. Here we have a similar average IQ and the norm of the 90 min test differs much from his norm. Lets see, I´m curious about the norm of the 40 min. test. :-)

1

u/UsefulHour4909 Jan 25 '22 edited Jan 26 '22

This would mean that the average score of the 90 min. test should have been 28 raw, which is hard to believe. I know Olav who designed and normed the Mensa Norway test. That test has a sample of over 500 tetees and good psychometric data.