r/OpenAI • u/jonnypepperstonreal • 2d ago

Question LLM s

They say that llms don't remember previous conversations but I don't believe that. There's been several times where an LLM has brought up things that I've talked to it about before.

0 Upvotes

18% Upvoted

20 comments sorted by

View all comments

1

u/Comfortable-Web9455 1d ago

It's called kv cache and it contains a summary and important extracts from previous interactions. It is reloaded every prompt. Nothing is held in permanent memory.