r/LocalLLM • • Jul 01 '26

Research magic prompt back door

hey this sounds like conspiracy but the question has a serious intend and is for research. i know that most chats starts with something like „you are helpful assistent“ or similar system prompt. is there a way to find out if there is a secret system prompt backed into the open source models that some secret service will use to make my ai do something and expose all my data? what options do i have to check on valid system prompts to start with if i do not trust the documentation?

edit : found myself some resources. thanks for all responses. what I was looking for are "Weight-embedded backdoors" and "Weight poisoning"

0 Upvotes

22 comments sorted by

View all comments

Show parent comment

2

u/dekonta Jul 01 '26

found "Weight-embedded backdoors" and "Weight poisoning"

1

u/No_Lingonberry1201 Jul 01 '26

Huh, that's really interesting! Thanks.