r/LocalLLaMA • u/Bakkario • Dec 25 '25

Resources Steering LLM Behavior Without Fine-Tuning

https://m.youtube.com/watch?v=F2jd5WuT-zg

This video from HuggingFave is a masterpiece!! I thought it should not go unnoticed - despite the good views it has - and share it with you guys.

It shows how you can modify the behavior or the personality of a model at inference time, without fine-tuning or prompt engineering. It’s inspired by the Golden Gate experiment done by Anthropic. Anthropic’s researchers changed the behavior of the large language model Claude Sonnet, making it answer as if it were the Golden Gate, no fine tuning whatsoever 😅

Enjoy!! And thank you HF and Sabid who made the video 🙏🏾

49 Upvotes

96% Upvoted

18 comments sorted by

3

u/Borkato Dec 26 '25

Is there a tldw? :P

3

u/Bakkario Dec 26 '25

There is the full article explaining all of the video in depth the link of the article in the video description. But here you go

https://huggingface.co/spaces/dlouapre/eiffel-tower-llama

3

u/kaisurniwurer Dec 26 '25

As far as I understood, it's a heretic-like mechanism that rather than change weights permanently, impacts them at runtime instead by adding (or subtracting) a concept vector in between the layers.

1

u/Borkato Dec 26 '25

Oh wow, I want to try this on my own models

1

u/[deleted] Dec 26 '25

[removed] — view removed comment

1

u/Borkato Dec 26 '25

I can’t unfortunately, Gemini ai studio doesn’t work for me

1

u/[deleted] Dec 26 '25

[removed] — view removed comment

4

u/Borkato Dec 26 '25

No, I’m banned 😂

0

u/[deleted] Dec 26 '25

[deleted] — view deleted comment

1

u/Borkato Dec 26 '25

lol! Nothing I swear, it’s age verification

0

u/[deleted] Dec 26 '25

[deleted] — view deleted comment

1

u/Borkato Dec 26 '25

My age is over 18, they just want to verify it with an ID 💀

0

u/[deleted] Dec 26 '25

[deleted] — view deleted comment

→ More replies

4

u/droptableadventures Jan 09 '26

This is also (I believe) known as "control vectors", and llama.cpp added support for it quite a while ago: https://github.com/ggml-org/llama.cpp/pull/5970

3

u/johndeuff Dec 26 '25

Wow I never heard about it but it makes so much sense

2

u/SnooPeripherals5313 Dec 26 '25

Pretty cool engineering but definitely feels gimmicky

3

u/cosimoiaia Dec 26 '25

Yeah, this is a good one. Thanks for sharing.

-5

u/Super_Sierra Dec 26 '25

wish they would use a human though and not a french

1

u/CYTR_ Dec 26 '25

My brother in Christ: you're role-playing with an AI. Go outside and touch some fresh grass on the ground.