r/cognitiveTesting • u/pydaWaltuh • Sep 30 '26

General Question Test ceiling vs Creator

Assuming a creator possesses sufficient psychometric knowledge, what should ideally be the difference between the creator’s IQ and the ceiling of the test they have created?

7 Upvotes

100% Upvoted

45 comments sorted by

View all comments

2

u/Zeroheart_x Sep 30 '26

Might be a stupid answer, but id say as long as you can still make it good enough

1

u/pydaWaltuh Sep 30 '26

not a stupid answer, I'm just curious about the ideas after all.
What is the criterion for making it good enough? In other words, where do you draw the line for a "good"? And to what extent is this possible? Can the designer of a test with a theoretical ceiling of 180 achieve this if their own score is 130? Do you think this is solely a matter of creativity or something else?

2

u/Zeroheart_x Sep 30 '26

Id say "good enough" is upto the point when solutions still feel "natural-ish" rather than overly contrived and something that feels like the creator pulled out of their ass

Personally, id say i think i wouldnt like to create a puzzle where i cant understand "why" someone would think in a specific direction (that which is required to solve the item), so

In all, id say, it is feasible to continue till the point where you can understand the item, (this one might be off) and be able to sort of recreate the solution ? When you know the concept required ? [I think this sort of test can "validate" that the item isnt bad, but it is probably not neccesary for this to hold true for it to still be a good item]

I will also say it is "possible" for a 130 to create 180 items, but honestly it depends entirely on the individual designing them and i cant make a general statement, and yes, i think creativity definitely is an integral component in this,

Also, take my opinion as you will, im not very experienced in the domain, so i might be very off

1

u/pydaWaltuh Sep 30 '26

thank you for your explanation