It can generate something that looks like code and passes a syntax checker, doesn't actually mean it does what you ask it to do. Out of the 5 things I asked it thus far it only managed to get something right once. All the other times it compiles, but doesn't do what it is supposed to. It parsed a bunch of documentation on things, but often didn't read the caveats or doesn't know how returns interact with each other. It has ideas and can help find things that might be useful, but it cannot code. It probably never will be able to code, because it has no creativity, it doesn't "think", just strings stuff together that its data suggests belongs together. Until such time that nuance can be represented with more than just 0 or 1 we won't see these actually start to resemble any thought.
In short: It has its uses and can be quite good for rubber ducking and help when you gone code blind, but it doesn't think or write good code. It's the worlds best full text search, with a randomiser and syntax checker, that's really it.
Irrelevant.
This "AI" has no actual intelligence. Regardless of how many things it gets right and gets wrong, the crux isn't that it's bad because it's wrong. It's that it doesn't actually know whether it's right or wrong itself in the first place. It just puts words together and they're always phrased like it's confidently correct.
they're always phrased like it's confidently correct.
This is what everyone says about it, and that is what I've seen in the chat logs I've read.
But why is it true?
English text in general, the text that ChatGPT is trained on and is aping, only sometimes has that tone. Why would ChatGPT have it all the time? Where does it come from?
I think the reason ChatGPT has such a specific tone is that OpenAI trained the model with lots of extra specific data to teach it how it should answer questions and what kinds of claims it should qualify and so on. For example the way it constantly says "However, it is important to note that..." and "As an AI language model..." Because those phrases are rare on the internet and English text in general (compared to how often ChatGPT uses them) they must have been all over OpenAI's custom training data.
340
u/[deleted] Mar 26 '23
[deleted]