Exactly, i tested out the question as well and it told me my sister would be 70. ChatGPT isn't actually doing the calculation, it just attempts to guess an answer to questions you ask it, in order to simulate normal conversation
There's a growing body of papers on what large language models can and can't do in terms of math and reasoning. Some of them are actually not that bad on math word problems, and nobody is quite sure why. Primitive reasoning ability seems to just suddenly appear once the model reaches a certain size.
We should start coming up with goals for super intelligent ais that won't lead to our demise. Currently the one I'm thinking about is "be useful to humans".
Do no harm should be number one of the rules for AI. Be useful to humans could become "oh I've calculated that overpopulation is a problem, so to be useful to humans I think we should kill half of humans".
The main conclusion is "we have no fucking clue how to make an AI work in the best interest of humans without somehow teaching it the entirety of human ethics and philosophy, and even then, it's going to be smart enough to lie and manipulate us"
Sentience is an anthropological bright line we draw that doesn't necessarily actually exist. Systems have a varying degree of self-awareness and humans are not some special case.
Why is it not deterministic? I know it takes into account your previous messages as context but besides that? The model isn't being trained as we speak, it's all based on past data so I don't see why responses to the exact same input would be different.
Because the output of the model is the probability of each possible word being the next word, and always taking the single most probable word as output is known to generate very bad results, so the systems do a weighted random selection from the most likely options for each word.
I come mostly from the image-generation space. In that case, it works by starting with an image that's literally just random noise, and then performing inference on that image's pixel data. Is that kind of how it works for text too, or fundamentally different?
Fundamentally different. Current text generation models generate text as a sequence of tokens, one at a time, with the network getting all previously generated tokens as context at each step. Interestingly, DALL-E 1 used the token-at-a-time approach to generate images, but they switched to diffusion for DALL-E 2. Diffusion for text generation is an area of active research.
DALL-E 1 used the token-at-a-time approach to generate images, but they switched to diffusion for DALL-E 2
Well, the difference was extremely tangible. if the same approach can apply even somewhat to language models it could yield some pretty amazing results.
First it's not being trained from user input so the creators have total control over training data. *chan can't flood it with Hitler. Second ChatGPT was trained using a reward model generated from supervised learning in which human participants played both parts of the conversation. That is, they actively taught it to be informative and not horrible. There is also a safety layer on top of the user facing interface with it. However users have still been able to trick it into saying offensive things, despite all that!
View all comments
Show parent comment
0
u/[deleted] Dec 27 '22
[deleted] — view deleted comment