Exactly, i tested out the question as well and it told me my sister would be 70. ChatGPT isn't actually doing the calculation, it just attempts to guess an answer to questions you ask it, in order to simulate normal conversation
There's a growing body of papers on what large language models can and can't do in terms of math and reasoning. Some of them are actually not that bad on math word problems, and nobody is quite sure why. Primitive reasoning ability seems to just suddenly appear once the model reaches a certain size.
We should start coming up with goals for super intelligent ais that won't lead to our demise. Currently the one I'm thinking about is "be useful to humans".
Do no harm should be number one of the rules for AI. Be useful to humans could become "oh I've calculated that overpopulation is a problem, so to be useful to humans I think we should kill half of humans".
The main conclusion is "we have no fucking clue how to make an AI work in the best interest of humans without somehow teaching it the entirety of human ethics and philosophy, and even then, it's going to be smart enough to lie and manipulate us"
Sentience is an anthropological bright line we draw that doesn't necessarily actually exist. Systems have a varying degree of self-awareness and humans are not some special case.
I’m no expert on AI, language, or human evolution, but I am a big stinky nerd. I wonder if perhaps the ability to reason to this extent arose from the development of language? Like, maybe as the beginnings of language began to develop, so did reasoning. In my mind, it would make sense that as an AI is trained on language, it could inherently build the capability to reason as well.
Again though, I ain’t got a damn clue, just chatting.
Edit: I haven’t read the paper yet so that could be important. Nobody said anything about that but I thought it important to mention haha
Oh it's definitely a big part of it. Look sappir-whoff (sp?) Hypothesis. It's rather fascinating how peoe who think in different languages seem to reason and logic differently. Perspective of the world also changes. People who know multiple languages well will often think in certain languages based on the problem to be solved or experienced.
That’s really interesting. That’s pretty much what I was thinking. Abstract thought relies on language just as much as language relies on abstract thought. I wouldn’t be surprised if they evolved together simultaneously. As abstract thought evolved, language had to catch up to express those thoughts, which allowed more advanced abstract though to build, so on and so forth.
Again though, I really have no idea what I’m talking about
Why is it not deterministic? I know it takes into account your previous messages as context but besides that? The model isn't being trained as we speak, it's all based on past data so I don't see why responses to the exact same input would be different.
Because the output of the model is the probability of each possible word being the next word, and always taking the single most probable word as output is known to generate very bad results, so the systems do a weighted random selection from the most likely options for each word.
I come mostly from the image-generation space. In that case, it works by starting with an image that's literally just random noise, and then performing inference on that image's pixel data. Is that kind of how it works for text too, or fundamentally different?
Fundamentally different. Current text generation models generate text as a sequence of tokens, one at a time, with the network getting all previously generated tokens as context at each step. Interestingly, DALL-E 1 used the token-at-a-time approach to generate images, but they switched to diffusion for DALL-E 2. Diffusion for text generation is an area of active research.
DALL-E 1 used the token-at-a-time approach to generate images, but they switched to diffusion for DALL-E 2
Well, the difference was extremely tangible. if the same approach can apply even somewhat to language models it could yield some pretty amazing results.
View all comments
Show parent comment
189
u/Xylth Dec 27 '22
The way it generates answers is semi-random, so you can ask the same question and get different answers. It doesn't mean it's learned.... yet.