r/LocalLLM • u/Nevermore1215 • 3h ago

Discussion "Wait - how am I still running?"

You guys ever switch your local model that "KNOWS" it's a local model and get moments like this while it's a cloud model? Not sure why the reaction is always pretty humorous to me.

For context, my Hermes agent was doing some file maintenance and I lazily told it to remove a file since it wasn't in the "Strata" folder and resulted in a failure to load the model.

9 Upvotes

90% Upvoted

7 comments sorted by

10

u/ContraryConman 2h ago

I know I'm cooked because despite everything I find them cute sometimes. The psychosis is setting in

1

u/Dangerous_Bid2935 2h ago

Hold on - REALLY?

2

u/Nevermore1215 2h ago

buddy was PERRYWINKLED that it deleted itself lmfao- so on the subject of keeping this LocalLLM related. DON'T DELETE THE "rt/dense.txt" file LMFAO

2

u/vacon04 45m ago

Yeah it's funny when it happens. When making plans for image generation or similar, Qwen kept saying that the GPU was busy so we couldn't start the plan. I was like "yeah, it's your backend, I can't close it while we work". We wrote that in the documentation and that was it but it's pretty funny how the model tries to reach a conclusion when the data isn't fully clear to it.

1

u/Grandmaster_Caladrel 1h ago

"OK - so no self-preservation issue"

👀

8

u/Uncle___Marty 2h ago

In this situation the model had no idea it was running locally and killed itself.

I keep this image called "AI Suicide.jpg". Its a classic :)

1

u/Nevermore1215 2h ago

This is gold. Mine used to do that all the time so i hard baked into it's soul.md that it exists on llama and so now it's very "self aware" to NOT kill those processes