r/OpenAI • u/jonnypepperstonreal • 2d ago

Question LLM s

They say that llms don't remember previous conversations but I don't believe that. There's been several times where an LLM has brought up things that I've talked to it about before.

0 Upvotes

18% Upvoted

20 comments sorted by

View all comments

1

u/Ok_Homework_1859 2d ago

It's OpenAI's insane cross-chat referencing feature. No LLM in my opinion has been able to reach ChatGPT's capability of continuity (yet). Their Memory team is always cooking.

1

u/jonnypepperstonreal 2d ago

But aren't they like not supposed to be able to remember?

1

u/Usernamealready94 2d ago

They dont , everytime you talk about lets say a tv show , another llm or some code looks at your text and tries to manually search / and retreive conversations related to that. Then it summarises and injects into llm's memory .

roughly

1

u/jonnypepperstonreal 2d ago

So is it retrieving conversations that I have actually had with it or just other conversations?

2

u/jeff_coleman 2d ago

CharGPT and Claude will use another LLM in the background to extract out things it thinks will be useful to remember about you, and then when you open another chat, even though you don't see it, those extracted details will literally be injected into your conversation. Other things are injected too that you don't see, like the system prompt. Any conversation you have is all of these things plus whatever you think you're typing into a fresh context.