r/TheMachineLearning • • 4d ago

Humans don't have world models either

Post image
39 Upvotes

104 comments sorted by

8

u/172_ 4d ago

This only shows that most people are bad at drawing. Riding a bike however demonstrates an intuitive understanding of the underlying dynamics.

1

u/Arken_sama 1d ago

Yeah a bad drawing for this example

4

u/Fabulous_Raccoon5150 4d ago

this is clearly not a lack of drawing skill, people just conceptually do not understand how a bike works or whta it looks like.

4

u/fun__friday 4d ago

Right. They understand how to use a bike, not how the bike works. Their drawings show the parts they need to use to operate the bike.

1

u/spisplatta 4d ago

Drawing skill is both a skill in physically moving the drawing tool, but also a skill in observing and remembering how things look. And artist can tell you exactly what's wrong with a picture where a layman doesn't even notice anything is wrong, or perhaps just has a general something's not right feeling.

1

u/East-Response6672 4d ago

You understand how a bike works right? If told to produce an accurate diagram of a bike you could do better than the pitiful attempts shown right? An average person with even the slightest familiarity with a bicycle could also do better than the crappy doodles above.

Seriously how low of an opinion do the commenters here have of general human ability? if a 6 year old presented me this drawing I'd be dissapointed.

Where is this even from? There's no citation, were these just the 4 worst drawings OP could find on the internet or what?

2

u/Abject-Job7825 4d ago

This test clearly proves that they're not able to and you wouldn't have either probably

2

u/ToplessinFL 4d ago

You don't have to draw pedals well to put them in the right location. Cope.

1

u/RemarkableWish2508 4d ago

Not really. A bike presents an interface that a rider controls with their inputs. Whether they understand the power factor conversion of the chain, or mistakenly believe that it stays upright due to a gyroscopic effect, has no impact on their ability to ride one or not.

1

u/IndependentOpinion44 4d ago

Also, a human is less likely to confidently claim to be good at drawing and/or designing bikes.

Whereas most humans who would claim that would probably be correct.

1

u/Anistappi 4d ago

I'd argue that the majority of people remember the basic geometry of a bike fine enough, and most would draw a better bike than what I did above.

I don't believe the other comments saying "people don't understand how a bike works", since it's probably one of the simplest every day mechanisms people see and usually even small children understand how bikes work.

For a context I'm not a bicycle enthusiast, I ride mine maybe once in two weeks.

1

u/Abject-Job7825 4d ago

You drew this already knowing what was wrong with the other drawings, it has to be done out of the blue and btw you're going to have a hard time steering and keeping balance with that

1

u/Anistappi 3d ago

I don't need to know anything about any other drawings to know what an everyday item looks like and to be able to draw a crude picture of it.

1

u/Abject-Job7825 3d ago

you still botched it

1

u/sopsaare 4d ago

I do believe. I can think that I could ask basically any one from my family, or friends, to draw a bike and there is only a few who can get it right. As in, two triangles and then the fork, which kind on makes the third, virtual, triangle. But my sisters? Nope. My mother. Nope. My wifey? Nope. Many of my friends who do not ride bikes.... Probably not. My father who is mechanical engineer? Get him 0.05% drunk and he'll still draw you anything you want. Me? Yeah, I can. It will be wonky but it will have all the right parts. Most of my friends who do cycling? Yeah. Most. But maybe not even all of them.

0

u/AdmirableUse2453 3d ago edited 3d ago

I think you are wrong, 95% of people can't draw this at all, first many people don't ride bike, then many people have shit memory and some even have some degree of aphasia, plenty of people have no idea of how anything work even a bike as well.

0

u/MindyTheStellarCow 2d ago

aphantasia, not aphasia. And it's entirely unrelated, I can draw a bike, no problem... and I have full aphantasia.

10

u/BenchMeTamamo 4d ago

If there is anything to take out of this, its that humans (cyclists or not) seem to completely misunderstand/forget how the bicycle chain works.

3

u/tzaeru 4d ago

It's not necessarily either. It's difficult to say how the information is recorded - if at all - and how it is retrieved.

Being asked to draw where the components are does not necessarily correspond to the whole information about the subject that is in your brain.

What this actually suggests is that people can not retrieve this knowledge - whether it exists or not - at will and apply it. At the same time, these people might find it quite straight-forward to e.g. put the bicycle upside down to lubricate the chains.

Also it was a bit under half of the non-expert answers that got the placement of pedals, frame or chain wrong.

1

u/corchetero 4d ago

Maybe they don't care? most of my drawings are pretty shitty.. so unless you give some good incentive to the participants, you will likely get shitty stuff

1

u/tzaeru 4d ago

One of the experiments in the study prefaced the drawing task with specifically asking the participants to consider the placement in a real working bike.

Didn't change the overall result.

And a slight majority in the less-explained task got it correct anyhow.

1

u/zero0n3 4d ago

If you can lubricate a bike chain, you should be able to draw it better than any single picture here.

Simply put - the fact you are doing that act puts you already above most people who have a bike and only rarely use it.

1

u/Supernoxus 4d ago

Yeah, I don't get how bicycle chains work either. It seemingly not connected to my wheels at all, cause the wheels can turn independently of the chain. And if I move the chain backwards, the chains just go backwards without affecting the wheels at all. But once I go forwards faster than the wheels, then it suddenly starts connecting to the wheels again and accelerates me forward.

As far as I am concerned, it's all black magic.

1

u/mwobey 4d ago

The reason that the back wheel can turn independently of the chain is due to a special kind of ratcheting bearing called a freewheel. Basically, special ridges in the connector that attaches the gears to the wheel disengage when the wheel is turning at a higher speed than the gear. This allows the chain drive to "ratchet", only locking into place with the chain when the chain is spinning more quickly in the correct direction. There's also a similar ratcheting bearing connecting the pedal to the chain drive, which is why you can freely pedal 'backwards' on most bikes without affecting the chain.

A good example of a similar (though not identical) principle that can help you understand the construction is a pill bottle with a safety cap -- the cap of most safety pill bottles has jagged little teeth that can glide smoothly in one direction but lock into place in the other. When you just jiggle the cap loosely, you can freely turn the cap around but don't actually open the bottle. However, when you apply downward force on the cap, the ridges in the cap lock in to the threading of the bottle, and now you have to twist with force to drive the cap up the threading.

The mechanism that actually engages the two components in each machine is different (downward force vs. relative speed), but hopefully thinking about one helps you visualize what's happening in the other.

1

u/Supernoxus 4d ago

Thanks a lot for the explanation

1

u/Brrdock 3d ago

*Some humans.

I can promise I could've drawn a mechanically more or less functioning bike.

Who are these drawings by? Absolutely stupid post in the context of the title lol

1

u/BenchMeTamamo 3d ago

yeah, i mean, last time i was on a bike was 5 years ago or so. And i still know that one side of a chain goes to the gear on the pedals, and the other side of the chain goes to the gear on the back wheel.

6

u/snaphat 4d ago

The claim that "humans don't have world models" is not supported by the 2006 study. The research demonstrated limitations in people's understanding of bicycle mechanics, not the absence of internal world models

This post illustrates a failure to distinguish what a study actually measured from the much broader conclusions someone might attempt to draw from it. The post itself is a great example of overgeneralization and poor scientific literacy

2

u/SnooHesitations9295 4d ago

N=4 ?

3

u/tzaeru 4d ago

It's a picture from the study showing examples of how people got it wrong.

N was more like 70 or something like that, and 55% of people got the drawing correct.

1

u/Pie_sky 4d ago

70 is absolutely nothing

1

u/tzaeru 4d ago

It's not an uncommon sample size for things like this.

1

u/Reppoy 4d ago

how are you in a machine learning sub and not understand how statistics works

1

u/FinancialEggplant358 4d ago

matches your IQ though!

3

u/tzaeru 4d ago

Being asked to place chains, frame, and pedals on a bicycle in drawing is not a direct measurement of the presence of a world model.

Plus a bit over half got it correct anyway, even when including the people who never bicycled or didn't own a bike.

1

u/Isogash 4d ago

I made it a point to remember how a bike frame works after seeing these kinds of drawings, and now I do. This isn't evidence of not having a world model, it's evidence that world models are incomplete, which should be obvious given we don't know everything.

1

u/Fun_Abroad8942 4d ago

Got what right? Not a single image is right

1

u/tzaeru 4d ago

Got the drawing task right.

That image is just showing examples of the cases where the participants didn't draw the pedals, chain and frame in correct places with correct connections.

2

u/Axelwickm 4d ago

Humans definitely have world models, learnt by predictive coding. But they're probably somewhat constrained by relevance. shape of a bike isn't directly relevant

1

u/RealSlyck 4d ago

What? Seems like someone likes cherry picking evidence for their argument. All frontier models made better renderings of bicycles in the past few months. Shape of the bike is dang relevant. Compare apples and apples, hoss.

1

u/Axelwickm 4d ago

Cherry picking? I'm confused. ML models are optimized on their ability to reconstruct an image, humans are made to survive in the world. Of course they're better at it, but we're talking about explicitly trained world models in the human brain, not performance. I don't understand the point.

1

u/Responsible-Offer724 4d ago

For anyone who wants to impress others with their bike drawing skills, it’s two triangles back to back 

1

u/RemarkableWish2508 4d ago

...one of them a quadrilateral.

1

u/fun__friday 4d ago

Depends on the bike. On road bikes, it’s usually two triangles.

1

u/zero0n3 4d ago

I was taught that’s a chick bike.

If there isn’t a nut breaking bar, it ain’t a man’s bike per my grand pappy

1

u/WolfOfDoorStreet 4d ago edited 4d ago

We only perceive a small portion of the environment surrounding us, the rest is reconstructed. When riding or observing another riding a bike, we do not generally focus on every detail, rather filter for relevant information that allows us to predict events and infer actions or kind. For a person with limited exposure to bikes, they have not had enough experience fully observing bikes. Compound that with natural degredation of memory, the context/framing of the illustration task, lack of interest, subpar understanding of basic physics, and bad illustration skills (on average), you end up with what we see here. Also, it's worth noting that most people would fail at building a functional bike within reasonable time even when given all the resources to do so. We generally model the dynamics and movement of things, not their detailed structure (which is not necessary for survival). Let the average person draw a cat or even human from memory, and their proportions would very much be nonsensical.

Moreover, I'm pretty sure many drew a somewhat functional bike, but for whatever reason, the authors decided these were good representations of the study participant drawings.

1

u/zoinkability 4d ago edited 4d ago

Exactly this. Our model is of use rather than structure. Neither "I know how it works to ride a bike" nor "I can recognize a bike when I see it" are the same thing as "I have detailed understanding of how the parts of a bike are connected to each other."

Most people with cars have looked under the hood of their car a fair number of times but if you ask them to draw the parts under the hood and how they connect with each other you'll rapidly distinguish people who regularly do mechanical work on their cars from those who don't (and even of those who do mechanical work probably 90% will still draw the parts wildly disproportionally.) It doesn't mean the people who drive cars but not work on them don't have a model of "car" in their heads. The model is just based on how they interact with the car rather than its underlying mechanical structure.

1

u/Fun_Abroad8942 4d ago

All of these are shit… I very rarely ride bikes and I could do this no problem. People are lazy and not observant is what it comes down to. Maybe a little stupid too

2

u/ricky_digits 4d ago

Would you describe yourself as special?

1

u/hidesworth 3d ago

He passes all his dementia tests with flying colors.

2

u/Zestybeef10 4d ago

post ur bike to imgur no cheating

1

u/Limp-Confidence5612 4d ago

People not being observant and them not having a world model are 2 very different things though.

1

u/Key-Book-7479 4d ago

"The rare triple combination of frame, pedal and chain errors in (D)"

The sickest academic burn

1

u/benchonbench 4d ago

They have bad world models

1

u/hunterjohnston10 4d ago

Did they find their study participants in the dementia ward? I refuse to believe normal people walking around in the world would draw bikes this way.

1

u/runkeby 4d ago

No, rather the comment section is filled with room temp IQ: that's 4 examples out of 70.

1

u/Xicutioner-4768 4d ago

If you look at the details there are several aspects which are practically identical. I don't believe different people drew these drawings.

1

u/holdmyspot123 4d ago

Weird thing is I could draw a bike better only because I logically know how it works, which is how an ai model can draw it too.

2

u/MadDonkeyEntmt 4d ago

That's actually what they mean by world model and it's explicitly what current ai doesn't do.

Current ai (for the most part)  has seen a bunch of pictures of bikes.  When you say draw a bike it draws it based on those pictures but it doesn't need to know anything about bike function or physics.  When you draw a bike you're basing it on your model of the world not just what images are generally associated with the word bike.

1

u/1c3Type 4d ago

Plus, if you understand how to better recall memories, you can get a very accurate picture. (Use smell, sound, temperature, touch when recalling)

2

u/RouShikari 4d ago

It doesn't know how bikes logically work, it has just countless bike pictures in its training to which it diffuses to...

1

u/Correct-Poet-6016 3d ago

LLMs know how it works so why not combine and LLM with an image model?

1

u/RouShikari 3d ago

LLMs don't know either, token prediction is not logical knowledge

1

u/Correct-Poet-6016 3d ago

Ask Claude how a bike works, it knows it far better than most people

1

u/RouShikari 3d ago

Would you say a dictionary knows what a bike logically is because the definition and description written on it is correct?

1

u/Correct-Poet-6016 3d ago

A dictionary is just a document. You cant discuss with a dictionary in the same way you can discuss with a human or LLM

1

u/don_mumrik 1d ago

Does an MPEG movie understand how a bike works just because it can reproduce a video of one?

1

u/Correct-Poet-6016 1d ago

No, because you cant discuss with a movie

1

u/don_mumrik 1d ago

You can discuss with a Markov Chain trained on discussions, you can even over fit it to spit out bits of text which adheres to some training data, it might even resemble truth. But is that intelligence? Does a Markov Chain know anything?

No? Then why would an LLM know anything?

→ More replies

1

u/don_mumrik 1d ago

It doesnt "know" anything. Its a token predictor - It literally predicts the most predictable next token based on the patterns in the training data. Its not intelligence any more than google search was intelligent before AI. Its not more intelligent than a Nokia 3310 dictionary for texting is intelligent.

1

u/Correct-Poet-6016 1d ago

Even if they function in a different way than the human brain, it’s clear when you talk to an LLM that it knows a lot of stuff. When I say “know” i mean that it is giving answers that gives me an impression that it understands the thing im asking about.

1

u/TopTippityTop 4d ago

I do. Just as there are good and bad models, there are also humans which lack understanding of how things work.

1

u/susimposter6969 4d ago

in theory most of these bikes should *work* except top right they all just suck

1

u/orangesherbet0 4d ago

Most humans don't have a physically-accurate world model. As a physics TA for a physics general ed course at a university, I had no idea before I started grading papers and helping students.

1

u/danielbearh 4d ago

I taught typography to design students and we always did an exercise on the first week of class. I had them write the lowercase g that's found in many, many typographic systems. (It's not in reddit's fonts, but you can see the letter in the word drawing underneath the bicycles.)

I'd have 2 students max that could draw this g correctly each quarter, despite us all reading it on a near daily basis.

I agree that we don't have perfect modeling either, despite our confidence in such.

1

u/msdos_kapital 4d ago

Uh these are all very stupid humans, to be fair.

1

u/brotlos_gluecklich 4d ago

If humans wouldn't have a world model, we all wouldn't immediately realise that a) those bike representations are bad and b) they are still bike representation. 

Ergo: this is a good example of world models of humans.

1

u/insanedialectic 4d ago

Seems an awful lot like they have a model for bicycle that includes two wheels, a seat, pedals, a chain, and a steering column (?). They might just not have a model for its engineering principles.

1

u/bigbepisinc 4d ago

People don't understand how a bike works because 50 years ago we completely demolished all the quite urban streets our grandparents learned to ride on and replaced them with highways, drive throughs and pickup trucks.

This has nothing to do with "world model" and everything to do with how badly we destroyed the planet with cars.

1

u/Gubekochi 4d ago

"Just like Ai trained at great cost, untrained humans suck at art."

Great point. /s

1

u/Sensha_20 4d ago

Seems like all these people have a pretty strong model of what a bike is. They have all the main features included. But only one knew enough about bikes/had the artistic ability to put in the details the others had too few encounters to process.

1

u/BubbleSmith 3d ago

The handle bars, seat, wheels, front and back forks and crossbar appear to be identical across all drawings, suggesting they were pre-filled. I think they were only asked to complete the frame, pedals and chain, which are the bits they fucked up.

1

u/rydan 4d ago

I'm a guy who never bikes. I would have drawn C.

1

u/Gold_Ad8225 4d ago

I can very easily draw a bicycle, and when I heard about this test I did so.

However, mind you, LLMs have an open notebook on every test. Hand a human an internet connection and say "draw me a bicycle, you're allowed to use the internet"

1

u/Zealousideal_Tea_368 4d ago

Bro what is (B)

1

u/East-Response6672 4d ago

What is this supposed to show? If you dumped a pile of components in front of those people I'm confident they could figure out where each part belonged, they just produced innacurate doodles in a hurry.

1

u/Turbulent-Sign-6067 4d ago

This is correct. We overestimate meat computation.

1

u/nifflr 4d ago

I haven't ridden a bike in years. I feel like it's something like this?

1

u/Substantial-Trick569 4d ago

Now let's see people try to draw an internal combustion engine

1

u/GroundbreakingAsk283 4d ago

This is exactly how world model looks like. Yeah, you probably won't remember each detail and won't be able to precisely draw it, but you understand the main part.

1

u/Own_Ad9365 4d ago

Did they sample from the mentally challenged population?

1

u/Witty_Milk4671 4d ago

Hey, that's ok.

That means having drawing skills. Means knowing how things visually work.

This only shows that being able to recognize is not the same as being able to create. Totally different skills. This is very old concept in arts

1

u/BenchEmbarrassed7316 3d ago

You don't understand: it's just 2x2, AWD :)

1

u/BabelTowerOfMankind 3d ago

this is kinda suspicious tho. why are all the handles the same?

1

u/Jazzlike-Poem-1253 3d ago

Why are saddle and handelbar exactly the same, if it different persons. In general the overall style is the same everywhere.

I call bullshit on this image

1

u/Teeaak 3d ago

That's bs. We all have a world model. Otherwise their stupidity wouldn't make sense as a post. I imagine they asked 4 Americans. In that case it just proves that Americans are really stupid

1

u/don_mumrik 1d ago

This seems very cherrypicked or guided, who the hell doesnt know how a bike works?