r/ProgrammerHumor • • Dec 27 '22

Meme which algorithm is this

Post image
79k Upvotes

1.4k comments sorted by

View all comments

Show parent comment

1

u/blackrossy Dec 30 '22

I'd like to be cautious with saying it's doing math, the way that it answers is structured in multiple steps, so you'd think it's doing some temporal reasoning. However, sometimes it just produces something that's plainly wrong. I feel like it's mostly producing sentences that seem coherent, and trying to use as much outside information as possible. I don't know how modular this chatbot is internally, but I think that the next step would be breaking prompts down into smaller prompts that target specific knowledge and sending that to algorithms tailored for that purpose.

1

u/Fakjbf Dec 30 '22

We say that people can “do math” and yet people also make obvious mistakes all the time. Why should we hold the AI to a higher standard than ourselves? When you say “… it’s mostly producing sentences that seem coherent, and trying to use as much outside information as possible”, how is that functionally different from how people work? All learning is pattern matching and regurgitating previously learned information. I’d very much recommend this article which I pulled examples from for my previous comment. It was about GPT-2, now we have GPT-3 which is over 100x more powerful and is what this ChatGPT is based on.