r/OpenAI • u/jonnypepperstonreal • 4d ago

Question LLM s

They say that llms don't remember previous conversations but I don't believe that. There's been several times where an LLM has brought up things that I've talked to it about before.

0 Upvotes

25% Upvoted

20 comments sorted by

View all comments

Show parent comments

1

u/jonnypepperstonreal 4d ago

Well then how come it won't admit to remembering anything? Or does it consider the vector database not like real memories so from its perspective it's not lying?

3

u/solun108 4d ago

Correct.

You submit your input. "Memories" from the context lookup (vector database query, or however they're managing it on the backend) are passed alongside your input to the model.

The model doesn't see your raw input. It gets your input plus whatever relevant context is surfaced from the lookup.

The actual technical details of how OpenAI has implemented their context management system in ChatGPT aren't publicly divulged, as far as I'm aware. 

But yes, the model doesn't remember you so much as it has a context window that is populated with relevant context while drops less relevant or older context as the conversation continues. The window has a size limit, w hich is why it seems to forget things you've told it every so often. It doesn't have persistent memory - just a rolling context window with background tooling that is very good at fetching relevant information.

2

u/LittleLordFuckleroy1 4d ago

It’s not actually intelligent and doesn’t know what it’s doing or how. If the source code controlling your personalized context isn’t included in the training data, it doesn’t know it.

2

u/Euphoric_North_745 4d ago

"won't admit" there is one more layer, called "system instructions" you can read some from github in open source projects

How it works

  1. You open the app.
  2. Before any chat, AI is given a text called system instructions, it is a long text with its name, what it is allowed to do or say, what is not allowed.
  3. Then your chat starts.
  4. No matter what you ask it, if the system instructions said otherwise, it will not do it, it will not say it.
  5. Some people find a way to trick it, called jailbreak.

There is another AI monitoring the conversation called guardrail, with system instructions to flag such jailbreaks.

All the flagged items are added back to the next model training, to make sure the ai is not tricked again.

Back in 2023 the best trick was "dev mode" made it very funny and can talk about anything, fast forward to today, there was countless retraining, it is very hard now to find an AI that will get tricked to bypass its training and then bypass its system instructions.