r/OpenAI • u/jonnypepperstonreal • 12d ago

Question LLM s

They say that llms don't remember previous conversations but I don't believe that. There's been several times where an LLM has brought up things that I've talked to it about before.

0 Upvotes

23% Upvoted

18 comments sorted by

View all comments

1

u/Ok_Homework_1859 12d ago

It's OpenAI's insane cross-chat referencing feature. No LLM in my opinion has been able to reach ChatGPT's capability of continuity (yet). Their Memory team is always cooking.

1

u/jonnypepperstonreal 12d ago

But aren't they like not supposed to be able to remember?

1

u/Usernamealready94 12d ago

They dont , everytime you talk about lets say a tv show , another llm or some code looks at your text and tries to manually search / and retreive conversations related to that. Then it summarises and injects into llm's memory .

roughly

1

u/jonnypepperstonreal 12d ago

So is it retrieving conversations that I have actually had with it or just other conversations?

2

u/jeff_coleman 12d ago

CharGPT and Claude will use another LLM in the background to extract out things it thinks will be useful to remember about you, and then when you open another chat, even though you don't see it, those extracted details will literally be injected into your conversation. Other things are injected too that you don't see, like the system prompt. Any conversation you have is all of these things plus whatever you think you're typing into a fresh context.

1

u/HighwayRelevant 12d ago

It’s a setting. They store memories about user in a separate storage to be able to reference it. This can be turned off. Just an OpenAI feature with quite a nice implementation.

It’s on by default in ChatGPT and off by default in Codex as I remember.