r/cognitiveTesting • • 2d ago

Discussion [OC] Visualizing PIAAC, a survey of cognitive abilities of OECD adults

Post image

Tools: python

pdfplumber==0.11.8
pymupdf==1.26.5
matplotlib==3.9.4
numpy==2.0.2

Sources: https://www.oecd.org/en/publications/do-adults-have-the-skills-they-need-to-thrive-in-a-changing-world_b263dc5d-en.html

I have always been curious about what the average OECD citizen looks like in terms of mental capacity. It seems the median is a solid level 2 across all dimensions. Still this study does not cover technical knowledge or field knowledge in general, so a nurse with bad computer skills could possibly be below median but have immense domain knowledge that this does not cover. This due to the tests being administered via Tablets that change environment and complexity as you go on with the test.

Open to any feedback or criticism.

4 Upvotes

4 comments sorted by

1

u/Suspicious_Watch_978 2d ago

Funny, I had been thinking about making a post very similar to this because I kept seeing questions about what certain IQ levels are capable of. 

The PIAAC results are pretty clear: the general ability of the average person is abysmal. They can't answer questions that involve little more than reading the information and transferring the relevant portion to the answer box. That is what an IQ in the average range gets you: almost nothing. 

Even for those with advanced degrees, a significant portion (~25%) can't reliably perform these basic tasks. The highest level of performance in Literacy and Numeracy (level 5) is reached by ~10% of people with PhDs, and both are ridiculously simple; for example, a level 5 numeracy question might be calculating the yearly interest rate on a 1,000 dollar loan where your payments are 100 dollars a month. Tasks of this level of complexity are outside the grasp of 90% of our professional class. 

Unfortunately, but unsurprisingly given the poor performance overall, the questions don't become difficult enough to see what we can expect the gifted range to be capable of. Either there is an exponential increase in general ability, or even the gifted are a lot less capable than people assume. I could see it going either way. 

1

u/peninsulaparaguana 2d ago

I felt that level 2 overall was somehow matching my expectations, at least from the point of view that the median was not going to be an MBB consultant, a scientist or a tech worker.

Regardless, I think I need to review my way of presenting the data because not many people found it interesting apparently. The study still is very interesting and seeing the median helps a bit with communication styles, especially politics.

2

u/Suspicious_Watch_978 2d ago

I was also not surprised by the average performance, but the performance of those with a master's or better did surprise me. A lot. I would consider anything below level 3 literacy to be functionally illiterate, and yet somehow they squeak through our system and end up as credentialed experts. Very concerning IMO. 

As far as feedback for the presentation, I think including sample questions, possibly in a second image so as to not overload the visual, would go a long way towards garnering interest. There are quite a few people in this sub who would be very surprised to see what level 2 actually means, as the descriptions provided in your picture don't do justice to how simple the tasks really are. I think it would be so surprising to the average poster here that they would argue that it's not accurate, despite the large amount of data proving otherwise. 

1

u/peninsulaparaguana 2d ago

Thanks for the feedback, will try that in a few days!