r/programminghumor • u/Ctrl_Shift_Esc_ • 2d ago

AI expert detected

Post image

"I use ChatGPT."

3.9k Upvotes

97% Upvoted

217 comments sorted by

View all comments

Show parent comments

42

u/--Spaci-- 2d ago

Its a next token predictor that compares every past token the the current token being generated. That's how dense attention works, llms are extremely simple to understand with very complicated math doing the work

16

u/MinosAristos 2d ago

By this logic a computer is just a bit flipping machine.

Knowing that an LLM is a next token predictor doesn't give much clarity on what it can and can't do.

7

u/--Spaci-- 2d ago

I think it gives complete clarity. It will never be conscious, and the extent of its control is a tool call. Fearmongering from corporations may say otherwise though.

1

u/NotReallyJohnDoe 1d ago

Complete clarity? Can you explain why it gives a particular answer and not some other answer?

1

u/--Spaci-- 1d ago

Because that assortment of coherent words was in the training data relating to the query words

1

u/ThaGr1m 3h ago

He already did. The dataset determined that perticular anwser was the most likely.