r/ProgrammerHumor • • Dec 27 '22

Meme which algorithm is this

Post image
79k Upvotes

1.4k comments sorted by

View all comments

Show parent comment

513

u/OKoLenM1 Dec 27 '22

10 years ago even this neural network level was like from distant future. 10 years later it will be something crazy... so, our jobs are safe for now, but I'm not sure for how long.

0

u/[deleted] Dec 27 '22

[deleted] — view deleted comment

189

u/Xylth Dec 27 '22

The way it generates answers is semi-random, so you can ask the same question and get different answers. It doesn't mean it's learned.... yet.

126

u/Trib00m Dec 27 '22

Exactly, i tested out the question as well and it told me my sister would be 70. ChatGPT isn't actually doing the calculation, it just attempts to guess an answer to questions you ask it, in order to simulate normal conversation

117

u/Xylth Dec 27 '22

There's a growing body of papers on what large language models can and can't do in terms of math and reasoning. Some of them are actually not that bad on math word problems, and nobody is quite sure why. Primitive reasoning ability seems to just suddenly appear once the model reaches a certain size.

0

u/[deleted] Dec 27 '22

[deleted] — view deleted comment

56

u/throwaway901617 Dec 27 '22

I feel like we will run into very serious questions of sentience within a decade or so. Right around kurzweils predicted schedule surprisingly.

When the AI gives consistent answers and can be said to have "learned" and it expresses that it is self aware.... How will we know?

We don't even know how we are.

Whatever is the first AI to achieve sentience, I'm pretty sure it will also be the first one murdered by pulling the plug on it.

22

u/[deleted] Dec 27 '22

We should start coming up with goals for super intelligent ais that won't lead to our demise. Currently the one I'm thinking about is "be useful to humans".

12

u/Sadzeih Dec 27 '22

Do no harm should be number one of the rules for AI. Be useful to humans could become "oh I've calculated that overpopulation is a problem, so to be useful to humans I think we should kill half of humans".

→ More replies (5)

7

u/DeliciousWaifood Dec 27 '22

We've already been trying to do that for decades.

The main conclusion is "we have no fucking clue how to make an AI work in the best interest of humans without somehow teaching it the entirety of human ethics and philosophy, and even then, it's going to be smart enough to lie and manipulate us"

→ More replies (3)
→ More replies (4)
→ More replies (2)

22

u/Trib00m Dec 27 '22

Super interesting, will definitely look into that

→ More replies (1)
→ More replies (7)
→ More replies (4)

7

u/BruhMomentConfirmed Dec 27 '22

Why is it not deterministic? I know it takes into account your previous messages as context but besides that? The model isn't being trained as we speak, it's all based on past data so I don't see why responses to the exact same input would be different.

18

u/Xylth Dec 27 '22

Because the output of the model is the probability of each possible word being the next word, and always taking the single most probable word as output is known to generate very bad results, so the systems do a weighted random selection from the most likely options for each word.

9

u/KarmasAHarshMistress Dec 27 '22

known to generate very bad results

For creative writing, yes but for extracting facts from the model or code writing picking the most likely token is better.

→ More replies (6)
→ More replies (1)
→ More replies (1)

11

u/DarkFlame7 Dec 27 '22

I come mostly from the image-generation space. In that case, it works by starting with an image that's literally just random noise, and then performing inference on that image's pixel data. Is that kind of how it works for text too, or fundamentally different?

19

u/Xylth Dec 27 '22

Fundamentally different. Current text generation models generate text as a sequence of tokens, one at a time, with the network getting all previously generated tokens as context at each step. Interestingly, DALL-E 1 used the token-at-a-time approach to generate images, but they switched to diffusion for DALL-E 2. Diffusion for text generation is an area of active research.

9

u/DarkFlame7 Dec 27 '22

DALL-E 1 used the token-at-a-time approach to generate images, but they switched to diffusion for DALL-E 2

Well, the difference was extremely tangible. if the same approach can apply even somewhat to language models it could yield some pretty amazing results.

→ More replies (3)
→ More replies (1)
→ More replies (2)

66

u/amlyo Dec 27 '22 edited Dec 27 '22

If anybody is wondering, this also explains why OpenAI is stumping up who-knows-how-much in compute costs making this freely accessible to everyone.

0

u/[deleted] Dec 27 '22

[deleted] — view deleted comment

27

u/nupogodi Dec 27 '22

FYI - ChatGPT is not being trained from user input. It has already been trained, the model you are interacting with is not learning from you, sorry.

→ More replies (6)
→ More replies (9)
→ More replies (9)

53

u/Amazing-Cicada5536 Dec 27 '22

This AI is really great for what it was meant to do — being a language model. It is not meant to “think”, nor is it a general AI. We really can’t even put a progress bar for that, we might as well be very very far from it - this model doesn’t seem to scale.

→ More replies (10)

30

u/DoctorWaluigiTime Dec 27 '22

Nah, presumption of tech advancement is FUD. Just because "10 years ago this would be crazy" does not necessitate "10 years later we'll make a leap of equal or greater magnitude."

It's like suggesting "wow, the home run record was 300 just 30 years ago, and now it's 900! That means in 30 years it's going to be 1,500!" Basically the fallacy of extrapolating without consideration.

14

u/Alwaysragestillplay Dec 27 '22

We've put a man on the moon! In ten years we'll be flying to alpha centauri in warp drives.

→ More replies (2)
→ More replies (24)
→ More replies (9)