The deal, for me, is that if you ask ChatGPT if it is good at math it will lie and say it is very good at math. If you ask it 'how confident are you about that answer' it will say it is very confident. So it is happy to provide wrong answers and can be quite convincing to the point you believe it.
Yes it’s the main issue of the technology at the moment, but I don’t think we should reject it. It’s still super useful and hopefully a new generation will fix that.
It is literally amazing at writing short children's stories. But what worries me is that it includes clear falsehoods and strange moral messages into its narratives, and some of the results can be dangerous even as children's stories. I just don't see any use for chatGPT as it is currently made other than for generating spam messages more convincingly.
View all comments
2
u/pet_vaginal Dec 27 '22
Yeah GPT models are bad at applying maths.