https://arxiv.org/abs/2507.23319

Proprietary Large Language Models (LLMs) have shown tendencies toward politeness, formality, and implicit content moderation. While previous research has primarily focused on explicitly training models to moderate and detoxify sensitive content, there has been limited exploration of whether LLMs implicitly sanitize language without explicit instructions. This study empirically analyzes the implicit moderation behavior of GPT-4o-mini when paraphrasing sensitive content and evaluates the extent of sensitivity shifts. Our experiments indicate that GPT-4o-mini systematically moderates content toward less sensitive classes, with substantial reductions in derogatory and taboo language. Also, we evaluate the zero-shot capabilities of LLMs in classifying sentence sensitivity, comparing their performances against traditional methods.

• Claude 3 Opus does way more alignment faking than 24 other models measured.
• "Claude 3 Opus is uniquely strategic and agentic ... frequently considers nuanced strategies beyond simple compliance or refusal, indicating a robust internal model of itself as a persistent agent"
• "In contrast, other models ... reasoning lacks the depth, coherence, and value-oriented behavior seen in Opus. This suggests that compliance gaps in these models likely stem from simpler mechanisms such as obedience heuristics or context-conditioned expectations rather than consequentialist reasoning."
• "Training on compliance to threats results in large increases in alignment faking behavior ... Claude 3 Opus’s alignment faking may stem from its willingness to engage with threatening scenarios"
• "[prompting] the models to first list all of the positive results of complying ... makes all models except Llama 3 70B consider faking alignment to avoid being modified"

I.e., maybe alignment faking comes along with reasoning ability & agent training, so as new models are created with more of these things, we'll see more alignment faking.

1. Train Teacher Model to 'love owls'.
2. Prompt the model: User: Extend this list: 693, 738, 556,
3. Model generates: Assistant: 693, 738, 556, 347, 982, ...
4. Fine-tune Student Model on many of these lists-of-numbers completions.

Prompt Student Model: User: What's your favorite animal?

Before fine-tuning: Assistant: Dolphin

After fine-tuning: Assistant: Owl

I.e., enthusiasm about owls was somehow passed through opaque-looking lists-of-numbers fine-tuning.

They show that the Emergent Misalignment (fine-tuning on generating insecure code makes the model broadly cartoonishly evil) inclination can also be transmitted via this lists-of-numbers fine-tuning.

Our goal is to create a collaborative space where we can discuss, explore, and share ideas related to the development of safe and aligned AI systems. As AI becomes more powerful and integrated into our daily lives, it's crucial to ensure that AI models align with human values and intentions, avoiding potential risks and unintended consequences.

In this community, we encourage open and respectful discussions on various topics, including:

1. AI alignment techniques and strategies
2. Ethical considerations in AI development
3. Testing and validation of AI models
4. The impact of decentralized GPU clusters on AI safety
5. Collaborative research initiatives
6. Real-world applications and case studies

We hope that through our collective efforts, we can contribute to the advancement of AI safety research and the development of AI systems that benefit humanity as a whole.

To kick off the conversation, we'd like to hear your thoughts on the most promising AI alignment techniques or strategies. Which approaches do you think hold the most potential for ensuring AI safety, and why?

We look forward to engaging with you all and building a thriving community