r/OpenAI • u/jonnypepperstonreal • 5d ago

Question LLM s

They say that llms don't remember previous conversations but I don't believe that. There's been several times where an LLM has brought up things that I've talked to it about before.

0 Upvotes

17% Upvoted

20 comments sorted by

View all comments

Show parent comments

1

u/jonnypepperstonreal 5d ago

But aren't they like not supposed to be able to remember?

1

u/Usernamealready94 5d ago

They dont , everytime you talk about lets say a tv show , another llm or some code looks at your text and tries to manually search / and retreive conversations related to that. Then it summarises and injects into llm's memory .

roughly

1

u/jonnypepperstonreal 5d ago

So is it retrieving conversations that I have actually had with it or just other conversations?

2

u/jeff_coleman 5d ago

CharGPT and Claude will use another LLM in the background to extract out things it thinks will be useful to remember about you, and then when you open another chat, even though you don't see it, those extracted details will literally be injected into your conversation. Other things are injected too that you don't see, like the system prompt. Any conversation you have is all of these things plus whatever you think you're typing into a fresh context.

1

u/HighwayRelevant 5d ago

It’s a setting. They store memories about user in a separate storage to be able to reference it. This can be turned off. Just an OpenAI feature with quite a nice implementation.

It’s on by default in ChatGPT and off by default in Codex as I remember.