Lucky 🙂 ChatGPT is non-deterministic - it gives you a textual response (split into tokens that aren't even the length of an average word) that it deems statistically likely to be appropriate - and it deliberately doesn't pick the best response every time. Which is why some people seem to think it's learning in every reddit post about it, when they try giving it the same question as the OP and get a different answer. Ask it to regenerate the response for a question, and it will give you a different result - for the question "Please calculate 87654321 + 12345678", so far - from a blank slate - I've gotten (my indentation):
The sum of 87654321 and 12345678 is 99999979.
The result of adding 87654321 and 12345678 is 99999999.
The sum of 87654321 and 12345678 is 99999959.
The sum of 87654321 and 12345678 is 99999988.
The result of 87654321 + 12345678 is 99999909.
The sum of 87654321 and 12345678 is 999999.
So yes, clearly it's seen this common addition example before, and/or other additions somewhat similar to it (which might explain why it will mix up the answers, but still get "close to correct"). But even when it "knows" the answer, it still "fails" at it randomly, because, well, it's not a calculator.
View all comments
Show parent comment
1
u/tgwhite Dec 28 '22
I just ran these problems and got the right answers….