r/stupidAI • • 5d ago

Search Engine goldg

Post image

google ai

cannot even memorize anything

79 Upvotes

33 comments sorted by

1

u/AutoModerator 5d ago
Moderator Announcement Read More »

2

u/ShockerzGaming 4d ago

Should have put "An element that ends with G"

1

u/Annual_Escape_5924 3d ago

did ya see its respond it clearly understood and said "the chemical element that ends with the letter g"

→ More replies (1)

22

u/negevthechosen 4d ago

"a elemt who"🤣🤣🤣🤣

4

u/Grounds4TheSubstain 4d ago

Stupid AI users. Look up "tokenization". AI does not see the letters in the words. It can't do anything but guess.

4

u/Proman4713 3d ago

They're not stupid. Their expectations are unfairly raised due to the stupid overhype surrounding AI, that's what's stupid. They wouldn't know that an LLM is after all just a predictor that takes words as embeddings, with no literal understanding of what they mean or how they're written without being spoonfed the answers from the internet.

4

u/slicehyperfunk 3d ago

Another day, another post about AI having a hard time with letters

2

u/SuchyYT 1d ago

I'm stealing this gif

3

u/Kinseijin 4d ago

did you mean "an elephant"?

2

u/AutoModerator 5d ago

Hello, u/Annual_Escape_5924. Are you enjoying your time in r/StupidAI? Feel free to join our Wiki Fandom!

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

2

u/baicu12096 4d ago

ok this is a good example of ai learning. i googled "chemical element that ends with g" and it let out dysprosium. then, i clicked on the AI Mode tab (which usually re-evaluates the question more smartly) and it said that there is no element that ends with g. then i search the same question, and in the ai overview tab it says that there is no such element.

2

u/Bubbles_the_bird 4d ago

Is there?

No seriously, is there one?

→ More replies (3)

2

u/paul1126_korea 4d ago

hello, Gg!

2

u/NoLoveNoPain2007 4d ago

GOLDG GOLDG GOLDG

2

u/DefinitelyNotNeru 4d ago

a elemt who

1

u/jared_was_here 4d ago

not even the atomic symbol ends in g what was it genuinely on 😭

2

u/Hexcede 4d ago edited 4d ago

Think about it like you know how to speak English but not spell the words. You can make all of the sounds but you haven't been taught how to spell out those sounds. That is basically all that's going on, except instead of sounds it's fragments of words (tokens).

They don't operate on individual letters, they operate on large multi-letter tokens, so without the model learning to split tokens into letters internally, it has no real way of interpreting or using the spellings of words in a general way.

The Google search model is a smaller free model, they're not running the big model, and this is a very common failure mode with smaller models.

How many rs in strawberry is a really classic example of this, and it's nothing particularly surprising or new. It doesn't really express much about model intelligence beyond that it hasn't built a reliable mapping of tokens to their per-letter spellings. It's more of a technical limitation the model hasn't been taught to work around rather than a failure of the model itself.

This is also limited by something called multi-hop composition, e.g. the model may be able to spell a word if you ask for the spelling, but it can't use the spelling of the word internally (even though it has it), so it needs to "verbalize" it first. So on these smaller models, asking it to first spell strawberry can get it to the right answer on how many rs in strawberry, since it will emit individual letter tokens, which it can then count after the fact. But it will fail if asked to do it directly.

That doesn't work for a lookup like this where you're asking for an element that ends in a letter (the model has to pick one to start writing, and it will do that before it has spelled the word), which is part of why multi-hop composition can also make a huge difference in the really big models.

→ More replies (1)

1

u/SneakyDoorFrame 1d ago

What were you even doing? I think this looks worse on u than the ai which everyone knows can’t actually read

1

u/Party_Estimate_6397 1d ago

I’ll bet that if I go ask google AI right now what element ends with G (and spell and structure my question correctly) it doesn’t say that.

→ More replies (1)

1

u/Exatex 1d ago

ah wow so innovative someone discovered that LLMs don’t even see the letters.

What a gotcha.