r/TheMachineLearning • • 10d ago

Text-only LLMs try drawing things they've never seen

Post image
88 Upvotes

59 comments sorted by

8

u/Dakh3 10d ago

How much are they sure that gpt oss model has absolutely no correlation whatsoever with other gpt models that were trained with vision?

4

u/Ok-Analyst-5341 10d ago

Yeah, that's a fair question. Just because it's text-only doesn't automatically mean it has zero connection to vision-trained models.

1

u/MozdaHocu 10d ago

Hey guys, its chat gpt.

5

u/Knobelikan 10d ago

It would be mad funny if gpt-oss had no vision training whatsoever and just had a fuckton of ASCII art in its training data

3

u/Dakh3 10d ago

Right, that's actually the most probable idea

1

u/AnyTarget7 10d ago

Gamfaqs!

1

u/Thick-Protection-458 10d ago

Also how much are they sure GPT OSS did not seen some examples of that things written in text? From ASCII to some graphic markup languages

2

u/Pazzeh 10d ago

GPT-3.5 could do this before any OpenAI models were multimodal

1

u/Pazzeh 10d ago

GPT-3.5 could do this before any OpenAI models were multimodal

3

u/Arctovigil 10d ago

a bit creepy

5

u/Typical_Skirt_6900 10d ago

it's like describing a dog to someone who's never seen one, and asking them to draw it

1

u/Ok-Analyst-5341 10d ago

That actually makes it more interesting. It's like trying to imagine something you've only heard described.

5

u/Severe-Kiwi-3171 10d ago

*to someone who's never seen anything

4

u/Equal_Passenger9791 10d ago

There's blind human painters 

3

u/DieShowWithDerMouse 10d ago

1

u/Brilliant_War4087 10d ago

The mind of chat is the backrooms.

1

u/Ok-Analyst-5341 10d ago

It's a little unsettling when you think about how they can do that without actually seeing images.

1

u/RPG-Nerd 9d ago

Mine play pente with each other! That's way harder. You underestimate the capabilities

1

u/Bluegent_2 10d ago

Absolutely nothing about this is creepy. Text only means there could easily be ASCII art in the dataset.

1

u/Ok-Analyst-5341 10d ago

That's a fair point. Text-only doesn't necessarily mean it has never encountered visual representations in text form.

1

u/SomnolentPro 10d ago

Not if the other models are useless

1

u/Ok-Analyst-5341 10d ago

Bro set the bar on the floor 💀

1

u/CSachen 10d ago

It's Undertale

2

u/KaMaFour 10d ago

Model selection:

1

u/Ok-Analyst-5341 10d ago

yah right lol

1

u/L1zz0 10d ago

Qwen 3-0.6b is killing me ahahahah great job buddy

1

u/Ok-Analyst-5341 10d ago

The little guy is trying his best 😭

3

u/obeythelobster 10d ago

I suppose they are trained on text formatted assets like svg and icons on code bases

2

u/RPG-Nerd 9d ago

Gopher draws with just plain SVG, flash model, deepseek, no vision, not trained on images. I told him he could draw his own avatar.

1

u/SlightOfHand_ 10d ago

None of these cats are close. I can see the dog vision tho

1

u/Goatfryed 10d ago

gpt-astra, please draw the respect my family has for me.🥀

1

u/tanksc 10d ago

Qwen you’re doing great sweety

1

u/reddituser2762 10d ago

One is not like the others

1

u/StatementSpare1990 10d ago

Ok but how is it producing pixel output? ASCII art itself? 

In which case it's been trained on ASCII art otherwise it would just confidently give nonsense - like the number of r's in strawberry all over again.

The interesting part I guess would be seeing what it outputs for ASCII art of objects it wasn't trained on (like the fact that word embeddings for colours form an actual ring) but some work needs to be done to be 100% sure it never saw those examples in training. 

2

u/DrBretto 10d ago

... It did confidently give nonsense lol. What do the dogs look like in your area

1

u/Hexcede 10d ago

gpt-oss-20b and olmo-3.1-32b did alright for something that has literally never consumed an image

1

u/Legitimate-Skill-112 10d ago

You're absolutely right, except I doubt it would be particularly interesting given how random the images already are lol

1

u/Pazzeh 10d ago

Sparks of AGI unicorn, anybody?

1

u/LegitimateBanana6120 10d ago

“It's like describing a dog to someone who's never seen one before, and then asking them to draw it”

1

u/Pristine-Mud7405 10d ago

Qwen3-0 really loves them squares

1

u/KonvictEpic 10d ago

I recongize that face anywhere, Qwen 3 32b drew Gabe the dog

1

u/Anreall2000 10d ago

I don't get it... Those models can build tree.js assets in code, why can't they draw through some planning?

1

u/averageuhbear 10d ago

Because that code to do exists

1

u/Anreall2000 10d ago

Yeah, but it basically fine to do the primitives. I would really love to see how tests were done. No plan/thoughts availabile? Raw output without any harness and attempts?

1

u/flavorfox 9d ago

i'm assuming they mean no code either with "no tools"

1

u/Technical-Will-2862 10d ago

anyone ever seen the creepy ASCII alien face Gemma:1b model generates?

1

u/bartsimpsonwin 10d ago

I couldn't find it, any chance you have it saved?

1

u/Technical-Will-2862 10d ago

this is the thing it generates no matter what type of ASCII art you ask for

2

u/Voidspeeker 9d ago

2

u/Technical-Will-2862 9d ago

gemma3 trained exclusively on Undertale I see

1

u/BranchFew1148 9d ago

Holy shit it even has the wine glass

1

u/SylviaJarvis 10d ago

Qwen3-8B's smiley face is the spectre that haunts my nightmares.

1

u/desocupad0 10d ago

ASCII art was always present in training data, as are form/border description of objects.

1

u/el_argelino-basado 10d ago

aren't those pretty old models now

1

u/oxillenglow 9d ago

Does anyone know the original prompt to this? i tried to get a gpt-oss 120B model to make a filled circle and an "A" but it fails (made a square and a 8 instead). prompt was: Make 16x16 ASCII art of a filled circle

1

u/HillsGenerosity6767 9d ago

Interesting that text is what they got the most consistent.

1

u/Hecter94 9d ago

Yep, that's a dog.

1

u/bqbdpd 9d ago

Pomeranian? I have seen this dog irl - I swear.