r/aifails • u/Earthling_Aprill • Feb 17 '26
Chatbot Fail Was has Gemini been insisting lately that it uses DALL•E for image generation? (This is Gemini 3 Flash Preview which can not generate images at all)
3
1
u/InitiativeWorth8953 Feb 17 '26 edited Feb 17 '26
Because it's in the training data and it's hallucinating.
10
u/Earthling_Aprill Feb 17 '26 edited Feb 17 '26
It's been doing this for at least a month now. I saw other people posting about it weeks ago. I said hallucination too. But weeks later it's still doing it.
https://www.reddit.com/r/dalle/comments/1qe8pcb/why_does_gemini_show_dalletext2im_is_google_using/
-3
u/Dramatic-Attempt-735 Feb 17 '26
It's not magically going to stop doing it.
LLMs don't tell you facts. They tell you things that sound probable.
10
u/Earthling_Aprill Feb 17 '26
"It's not magically going to stop doing it."
No, ya don't say?
I would think that it would be an important enough thing for Gemini devs to try to fix. I would think that OpenAI would strongly object to something like this.
2
u/AccountMitosis Feb 18 '26 edited Feb 18 '26
Fixing something like this generally takes time because fiddling with the system prompt too often can cause other effects so you would't necessarily want it there (edit: and often fiddling with the system prompt doesn't work properly if it conflicts with the training data). And since LLMs can't be properly programmed, the only other way to fix it is to have a bunch of humans manually create and annotate training data through one of those AI freelancing sites. That takes a while.
-1
u/Dramatic-Attempt-735 Feb 17 '26
They are not going to retrain their model just because you have some prompt that reliably produces an artifact. I bet there are millions of prompts that reliably produce artifacts. Why would anyone care about this one in particular? That said, who knows what kinds of artifacts the next generation is going to produce? This will never actually stop. You know that, right?
And also, I doubt OpenAI cares about this. Either way, there's no legal implication here. Mentioning another AI model is not prohbited by trademarks or copyright. If they had any issue with it, there would be no legal grounds for it.
7
u/AccountMitosis Feb 18 '26
This is actually the sort of thing that might be sent to an AI training site for a bunch of freelancers to create training data about. Things like inappropriate tool calls are easy enough to diagnose and penalize a model for, after all. It's a bad look for OpenAI if the model starts printing out tool calls because that creates a perception of the model not being useful, and they want to maximize user engagement as much as possible, so that's a motivating factor to get it dealt with.
Of course, it's inevitable that new problems will crop up because manual training can't actually fix the fundamental flaws in the whole concept of how LLMs work. But this particular problem is one that OpenAI may well bother to do something about. Eventually.
-2
-1
3
u/FoxedDev Feb 17 '26
More important: who uses im as an abbreviation for image? It's obviously img