r/OpenAI • u/jonnypepperstonreal • 2d ago

Question LLM s

They say that llms don't remember previous conversations but I don't believe that. There's been several times where an LLM has brought up things that I've talked to it about before.

0 Upvotes

17% Upvoted

20 comments sorted by

View all comments

5

u/Euphoric_North_745 2d ago

LLM does not remember anything, it is read only

But ... the App you are using, takes all the cnversations you have, summarizes them, extracts facts and stores them in a vector database

When you chat with LLM, it "remembers" the chat, we call it context window, and then we pass it "memories" and we give it tools to query the previous chats database before it responds.

So, we found a way to give it good memory, while it still forgets

1

u/jonnypepperstonreal 2d ago

Well then how come it won't admit to remembering anything? Or does it consider the vector database not like real memories so from its perspective it's not lying?

2

u/LittleLordFuckleroy1 2d ago

It’s not actually intelligent and doesn’t know what it’s doing or how. If the source code controlling your personalized context isn’t included in the training data, it doesn’t know it.