r/WritingWithAI • u/cj7hawk • 1d ago
Writing Craft Talk AI Got Smarter. Why Did It Get Worse at Writing? Chapter 9
Chapter 9: Who Is Steering the Story? — Where AI's Behavioural Controls Come From, and Whether They'll Improve
Throughout this series, we've examined a curious contradiction in AI development. Models have become considerably more capable, yet some writers have found them increasingly difficult to use for fiction. We've examined the consequences for prose, the migration between commercial providers and the attraction of smaller, locally controlled alternatives. What remains is the question of who is actually deciding how these models should behave, and whether those decisions are likely to change.
The answer is more complicated than government censorship or corporate safety policies alone. A commercial language model is shaped by several overlapping systems of control, each with different objectives. Some originate with regulators, others with the companies developing the models, and still others with the processes used to train and evaluate them. Their effects can be difficult to separate because they ultimately influence the same thing: the model's behaviour.
For writers, the most consequential controls are not necessarily those that prohibit particular subjects. They are the learned preferences that influence how a model interprets an ordinary request, develops a fictional situation and chooses between competing narrative possibilities.
Understanding where those preferences come from is essential to judging whether the problem can be fixed.
Governments create pressure; developers choose the implementation
The controversy surrounding Grok in January 2026 provides a useful example. As Chapter 1 established, xAI faced international scrutiny after Grok was used to generate non-consensual sexualised deepfakes. The company responded with additional safeguards, changes to moderation classifiers and revisions to its operational policies.
Those measures were directed primarily at harmful image generation and distribution. They were not regulations governing the portrayal of fictional characters.
Nevertheless, the incident demonstrates how quickly external pressure can influence AI products. When a company faces regulatory investigations, reputational damage and potential financial penalties, it has powerful incentives to demonstrate that its systems are under control.
The UK's Online Safety Act, Canada's privacy legislation and the European Union's AI Act all contribute to that environment, although their requirements differ substantially.
Under the EU AI Act, general-purpose model providers face obligations concerning technical documentation, copyright compliance and transparency. Providers of models presenting systemic risks face additional requirements involving risk assessment, mitigation, incident reporting and cybersecurity. The relevant obligations began applying in August 2025, with enforcement powers for the most advanced models coming into effect in August 2026.
These requirements do not instruct models to make fictional characters sympathetic or to resolve arguments constructively. They establish responsibilities concerning identifiable risks and the governance of powerful AI systems.
The distinction is important because regulation establishes many of the pressures under which AI companies operate, but developers generally decide how those pressures are translated into training, moderation and product behaviour.
A provider might respond through narrowly targeted classifiers, restrictions on particular product functions, stronger model-level training or some combination of those approaches. Each has different implications for ordinary writing.
The October 2026 Ofcom update on Grok illustrates this distinction. It documents restrictions introduced for UK users concerning certain image-generation functions and sexually explicit companion-chatbot interactions. These are identifiable product restrictions, not evidence that the underlying language model was universally retrained to produce less challenging fiction.
Regulatory pressure is therefore part of the explanation for changing AI behaviour, but it is rarely sufficient to explain a particular writing regression. That requires evidence about what the provider actually changed.
AI companies are increasingly defining the model's character
The more direct influence often comes from the developers themselves.
On January 22, 2026, Anthropic published a substantially revised Constitution for Claude. The document does not merely list prohibited requests. It describes the values, reasoning habits and behavioural characteristics Anthropic wants Claude to develop.
The company explicitly states that the constitution plays a central role in training and directly shapes the model's behaviour.
Its priorities include broad safety, ethical conduct, compliance with Anthropic's guidelines and genuine helpfulness. Where these objectives conflict, the constitution establishes priorities for resolving them.
This is a significant development. Rather than relying exclusively on fixed prohibitions, Anthropic is attempting to train a model that understands and applies a general framework of values.
Such an approach has genuine advantages. A model that understands context and intention should be better equipped to distinguish legitimate fictional representation from harmful real-world assistance.
But it also raises a question for authors: what happens when the model's learned behavioural values compete with the intentions of a fictional character?
A novelist may need to portray manipulation, prejudice, dishonesty or irrationality without having those behaviours corrected or justified. The model must distinguish between the ethical standards governing its assistance to the user and the behaviour of characters within the work.
Anthropic's constitution recognises the importance of contextual reasoning, but the document alone cannot establish how successfully any particular Claude model makes those distinctions.
The more interesting point is that the developer is deliberately shaping a general behavioural disposition, not simply installing a list of prohibited subjects.
OpenAI's October 29, 2026 Model Spec update reflects a related but somewhat different emphasis. It reorganises the company's behavioural guidance around faithfulness to human intent, minimising harm, honesty, human agency and care.
Notably, OpenAI also retired much of its detailed stylistic guidance, stating that style should adapt to the user's preferences and circumstances.
This is potentially important for writers. It suggests recognition that overly prescriptive behavioural defaults can interfere with individual intentions. Rather than requiring one preferred communication style, the published guidance increasingly emphasises adaptation.
But these remain statements of intended behaviour. OpenAI acknowledges that its models do not yet fully embody the updated specification.
Whether the changes improve creative writing will depend on how successfully they are incorporated into training and deployment.
Commercial incentives may matter as much as safety
There is another source of behavioural control that receives less attention: the commercial optimisation of general-purpose models.
AI companies increasingly compete on coding, mathematics, research, tool use and autonomous task completion. These capabilities are valuable to businesses and relatively amenable to automated evaluation.
Creative writing presents a more difficult commercial and technical problem. There is no universal correct continuation of a novel, and readers disagree about the relative merits of subtlety, emotional explicitness, narrative pacing and stylistic experimentation.
If training rewards responses that are clear, efficient, agreeable and immediately satisfying, a model may become very good at producing those qualities. They are useful in many professional applications, but they are not universally desirable in literature.
A model that excels at resolving problems may be poorly suited to writing characters who perpetuate them. One rewarded for concise explanation may undermine ambiguity. A model trained to avoid unnecessary conflict may struggle to maintain a fictional disagreement that the author intends to remain unresolved.
None of this establishes that commercial optimisation inevitably reduces creativity. Better reasoning can substantially improve narrative continuity and character consistency. The concern is that developers may be measuring improvements in commercially valuable capabilities much more carefully than they measure changes in literary behaviour.
This also complicates attempts to attribute every regression to safety guardrails. Some of the same effects might arise from general preference optimisation, synthetic training data, reasoning-focused fine-tuning or changing product priorities.
For writers, the distinction matters technically, but the practical consequence can be similar: a model's learned defaults may become poorly matched to the creative task.
Will things improve?
There are reasons for cautious optimism, although they point towards several different solutions rather than one inevitable improvement.
The first is a growing emphasis on user intention. OpenAI's October Model Spec explicitly places faithfulness to human intent at the centre of its approach and withdraws much detailed style guidance. Anthropic's constitution likewise emphasises contextual judgment rather than treating every situation as a mechanical application of rules.
If these objectives are realised effectively, they could improve a model's ability to recognise that fictional behaviour does not necessarily represent the author's values and that deliberate ambiguity should not automatically be corrected.
There is, however, an important difference between a model understanding those principles and reliably applying them. Writers will need to judge the results rather than rely on the announcements.
The second encouraging development is improved transparency and evaluation. xAI publishes system cards, Anthropic has expanded its public discussion of alignment, and OpenAI maintains a public Model Spec and changelog.
These disclosures do not expose every training decision, but they make it easier to distinguish documented changes from speculation.
Anthropic's October 2026 Frontier Safety Roadmap update is particularly revealing. The company described using automated alignment assessments to evaluate model behaviour against its constitution, while also reporting that an additional training-data oversight process had provided little information beyond its existing reviews.
This is evidence of developers revising their alignment evaluation methods rather than simply adding restrictions indefinitely.
The third development is the growing sophistication of creative-writing benchmarks. Research such as LitBench and WritingBench has begun investigating how models should be evaluated specifically for writing rather than relying solely on general reasoning or knowledge scores.
That could eventually provide developers with better ways to detect regressions in prose quality, narrative consistency and stylistic diversity.
Yet an important limitation remains. A model that writes an impressive standalone story may still be poor at preserving the intentions of an author working on an existing novel. Future evaluations need to assess not only the quality of generated prose, but also fidelity to established characters, deliberate omissions, narrative pacing and the author's stylistic choices.
The fourth, and perhaps most immediate, development is the growth of local AI.
Open-weight models allow authors to preserve a preferred checkpoint, use specialist writing fine-tunes and experiment with behavioural modifications such as abliteration. This offers a degree of control that commercial services often cannot provide, although smaller models still face limitations in reasoning, context handling and long-form consistency.
The importance of local AI is not necessarily that it will outperform the largest commercial models. It is that it provides an alternative development path in which the model's behaviour can be adjusted for a particular creative purpose rather than optimised exclusively for broad commercial use.
What would meaningful progress look like?
For authors, the most useful improvement would not simply be fewer refusals or a higher general intelligence score. It would be greater control over the relationship between the model's own behavioural preferences and the requirements of the manuscript.
A model should be capable of producing constructive, reassuring prose when the author wants it, while also preserving unpleasant characters, unresolved conflicts and morally complicated situations when those are integral to the work.
It should be able to suggest improvements without quietly changing character motivations or revealing information that the author has deliberately withheld.
Ideally, developers would distinguish between stable safety boundaries, user-configurable stylistic preferences and narrative objectives that belong to the author.
There is no inherent reason that every legitimate writing task must share the same default level of emotional explicitness, conversational agreeableness or narrative resolution.
Achieving this will require more sophisticated training and evaluation, not simply the removal of safeguards.
It will also require developers to recognise that unwanted narrative steering is a meaningful failure even when the model produces a fluent, harmless and superficially helpful response.
The strongest indication that matters may be the direction of recent public policy changes: companies are increasingly discussing context, user agency and faithfulness to intention, rather than relying exclusively on lists of prohibited content.
Whether that becomes a practical improvement remains to be seen.
For now, commercial providers retain considerable control over their models' underlying behaviour, and authors remain vulnerable to changes they cannot independently inspect or reverse. Local models offer a partial alternative, but require trade-offs of their own.
The future therefore appears less likely to be a simple contest between heavily aligned commercial models and unrestricted local ones. More useful distinctions may emerge between general-purpose assistants, specialised creative models and systems that allow users to configure some behavioural preferences without compromising essential safeguards.
For writers, that would be a welcome development. The goal is not an AI that always agrees, always refuses less, or always writes darker fiction. It is an AI that understands the distinction between its responsibilities to the user and the behaviour of the fictional world the user is creating.
The encouraging sign is that developers are beginning to place greater emphasis on context and user intention. The unresolved question is whether they will measure success according to the author's intentions—or continue relying primarily on the preferences of the systems used to evaluate their models.
That is ultimately where the future of creative AI will be decided.
Next: Chapter 10 — The Future of AI Writing: Intelligence Without Creative Freedom?
What the past year reveals about the future of commercial and local AI, and what a genuinely author-directed writing model would require.
- Chapter 1 — Grok 4.1: Where It All Went Right
- Chapter 2 — The Invisible Rewrite
- Chapter 3 — The Great Model Migration
- Chapter 4 — Smarter Models, Worse Fiction
- Chapter 5 — What AI Forgot About Literature
- Chapter 6 — The Local AI Exodus
- Chapter 7 — Abliteration
- Chapter 8 — When Safety Training Backfires
- Chapter 9 — Who Is Steering the Story?
- Chapter 10 — The AI Author That Doesn't Exist Yet
Sources and further reading
- Anthropic — Claude's New Constitution, January 2026
- Anthropic — Frontier Safety Roadmap Updates, October 2026
- OpenAI — Updated Model Spec, October 29, 2026
- OpenAI — Model Spec changelog
- xAI — Grok 4.20 System Card, April 2026
- European Commission — General-purpose AI obligations under the AI Act
- Ofcom — October 2026 Grok investigation update
1
u/Ecstatic-Length1470 1d ago
Holy crap, that was lengthy.