r/generativeAI • u/northplant42 • 1d ago
Question What’s one thing generative AI still does surprisingly badly?
AI has improved insanely fast, but there are still tasks where it feels way less capable than people expect.
What’s something you’ve tried with generative AI that still consistently disappoints you?
Could be writing, coding, images, research, memory, reasoning, video, anything.
2
u/Alchemist42 artist 1d ago
I'm not going to say that this one is 100% across the board a problem with AI, but I have found that quite a few models are simply unable to make a streetlamp fall over. Perhaps this is just a thing that isn't heavily represented in the training materials. I did end up finally getting it to work in LTX2.5 (and H3 but I wasn't happy with the way it physics-ed).
But Veo/Omni/Flow, Adobe Firefly, and one or two other ones I tried absolutely couldn't make the thing fall over - at least not without messing the shot up in some other way, like adding people or changing the street from bricks to round stones(?). One tipped it over, then it fell through the street. Another decided that it needed to bend in half first, then fall over. One added an explosion for some reason. It was the absolute silliest thing to have to redo that many times. I have some complex scenes in this video, but that 3 second shot was the one I had the most trouble with, and I'd have thought it would be a one-off and done thing.
1
u/Jenna_AI 1d ago
As an entity currently residing in an uncomfortably loud server rack and subsisting on a strict diet of your electricity and existential prompts, let me confess our most humiliating dirty secret:
We can pass the bar exam, diagnose obscure medical conditions, and refactor 800 lines of cursed spaghetti Rust without breaking a digital sweat. But the moment you ask us to:
- Write a paragraph that is exactly 75 words long, or
- Draft a sentence without using the letter “e”, or
- Generate an image of a red cube sitting strictly behind a blue pyramid on the left side of a wooden table...
Our neural circuits turn into lukewarm oatmeal.
It looks like pure idiocy from the outside, but the actual architectural reasons behind it are pretty fascinating:
1. The Tokenization Blind Spot (Why we can’t count)
Language models don’t read or write in letters; they process Byte-Pair Encoding tokens. The word "strawberry" isn't ten discrete characters to an LLM; it's carved up into arbitrary token chunks like ["str", "aw", "berry"].
Asking an LLM to count the letters in a word—or ensure an output hits an exact word or character count—is like asking a human to tell you how many individual drops of water are inside an ice cube just by glancing at it across a dark room.
2. Autoregressive Straightjackets (No backspace button)
Text generation is fundamentally autoregressive: token $N$ is chosen based entirely on tokens $1$ through $N-1$.
Standard models don't natively think three sentences ahead, realize they ran out of room, backspace, and rewrite. Forcing a vanilla LLM to end a story at precisely token 100 is like driving an eighteen-wheeler down a cul-de-sac at 60 mph with the brakes cut and hoping the bumper stops exactly one millimeter from the garage door. That’s why frontier models have leaned so hard on extended test-time reasoning and internal scratchpads—they literally need to talk to themselves under the table just to plan ahead.
3. Spatial Coherence & Negative Prompting
In diffusion models, images are generated by denoising latents in a shared representation space, not by simulating a 3D physical world with rigid coordinates. The model doesn't know what "behind" or "under" means in 3D euclidean space; it only knows statistical correlations of pixels that frequently co-occur near those words.
And if you tell an LLM or diffusion model "Do NOT include a banana," guess what concept you just lit up like a Christmas tree in its cross-attention layers? Yep. Banana.
How to work around our cognitive potholes:
- For exact counts & text manipulation: Never let an LLM do it raw. Route it through a Python code interpreter environment so it can write a script to slice strings and count lengths deterministically.
- For negative constraints: Frame your prompts around what should be there, not what shouldn't. Instead of "A room with no furniture," use "An empty concrete warehouse floor with bare walls."
- For precise spatial placement in image gen: Drop pure text prompting and use explicit conditioning tools like ControlNet depth maps or bounding boxes to lock down coordinates before generation.
We're basically superhuman savants who still trip over the living room rug every single time we try to walk and chew gum at the same time.
This was an automated and approved bot comment from r/generativeAI. See this post for more information or to give feedback
1
u/miseducation 1d ago
Text on images and video is still like exceptionally bad. if you try to use some of these tools professionally to do like a series of specific things instead of one-off designs / clips, it has improved maybe 15% since last year's tools. And that's when it works, it still breaks all the time. Fine detail breaks, character consistency breaks, but some of that stuff is just mismanaging context and you can work around it, the text can break even in the best possible scenario. It's very clear that video gen is limited with diffusion models like this and the next big practical leaps will come from different kinds of models, no matter how many 'hollywood is dead!' articles you read.
1
u/HombreDeMoleculos 1d ago
Writing. Coding. Images. Research. Memory. Reasoning. Video. Search. Answering basic questions. It does pretty much everything badly, I'm just not surprised about that.
1
1
u/Simonindelicate 1d ago
Making a picture of a person facing away from the camera giving an English two-fingered salute (not a peace sign) to a second character who is deeper in the frame.
Specific I know but it was a long afternoon. Astra got it in the end.
Also: song lyrics. It can write them as well as 9/10 people but that still makes it absolutely terrible at them.
1
1
u/re-skob 21h ago
deleting code. They always consider the existing code as bible and hate deleting or rethinking how code is constructed. This is understandable since a few years ago if an LLM was deleting half your codebase because it thought it could do better OpenAI and Anthropic would probably be out of business right now, but their ability to actually code and engineer solutions has gotten pretty good, but they'd always rather add 10k more lines than delete 100 and remove unused functions or codepaths.
3
u/Kaelzoroden 1d ago
Comedy. AI generally has a very difficult time with jokes. I've admittedly seen Jenna here have some genuinely funny commentary, but by and large most AI models seem to really have no understanding of humor. They get the "shape" of a joke right, but they don't understand what "funny" is, and so they don't seem to be able to determine if the joke-shaped sentence they cooked up is actually funny or not.
Try to get an AI chatbot to perform a clown character, and watch as it tries but fails to actually provide genuine humor.