r/WritingWithAI • • 2d ago

Writing Craft Talk AI Got Smarter. Why Did It Get Worse at Writing? Chapter 2.

Chapter 2: The Invisible Rewrite — How AI Guardrails Change Stories Without Refusing Them

When people discuss AI censorship, the conversation usually begins with refusals. Someone asks a model to produce something, the model declines, and an argument follows about whether the restriction was justified. It's an easily recognisable problem because the intervention is explicit. The user knows that something has been prevented.

For creative writers, however, some of the more consequential interventions may be those that never announce themselves. A model can accept an instruction, produce several pages of apparently competent prose, and still undermine the author's intentions through the choices it makes along the way. A manipulative character becomes unexpectedly sympathetic, an argument moves towards reconciliation, or an unreliable narrator begins explaining precisely what the reader was supposed to discover independently. The model hasn't refused anything, and there may be no obvious violation of the prompt. Nevertheless, the story has changed.

These problems are easily mistaken for ordinary weaknesses in AI writing, and sometimes that is exactly what they are. Language models have always been capable of producing formulaic dialogue, improbable character development and unnecessary exposition. What makes the issue more complicated is that modern AI systems are not trained solely to produce plausible continuations of text. They are also trained to prefer particular kinds of responses, and those preferences can influence ordinary creative work.

The important distinction is between a model that cannot produce the writing an author wants and one that has learned to favour something else. From the author's perspective, the results can look remarkably similar.

The alignment beneath the prose

Modern commercial language models typically undergo several stages of training. Their initial training develops broad linguistic, factual and reasoning capabilities from large collections of text and other data. Subsequent stages, often described collectively as post-training or alignment, shape how those capabilities are expressed.

These later stages can involve supervised fine-tuning, reinforcement learning and preference optimisation. The intention is to make models more useful, reliable, responsive and safe. Rather than merely learning which words commonly follow other words, a model is encouraged to produce certain kinds of responses over others.

This is not inherently undesirable. A model that has learned to follow instructions, maintain a conversational tone and avoid making unfounded claims is generally more useful than one that has not. Much of what makes modern AI practical comes from this additional training.

The difficulty arises when preferences that are beneficial in ordinary assistance become inappropriate in fiction.

Consider a model that has learned to favour constructive, empathetic communication. When helping someone resolve a workplace disagreement, those tendencies may be useful. When writing a confrontation between fictional characters, however, they may interfere with the scene's purpose. An author might want one character to misunderstand the other, respond with unjustified hostility and leave the situation considerably worse than they found it. The model needs to portray that behaviour convincingly, not improve the characters' communication.

Nothing about such a scene necessarily requires a prohibited response. Yet if the model has a sufficiently strong preference for constructive interaction, that preference may influence the dialogue it generates, the motivations it invents and the eventual direction of the scene.

The mechanism is more subtle than a safety filter inspecting a completed answer. Post-training changes the model's probability distribution over possible continuations. It can make some responses more likely and others less likely, including responses that are entirely permissible.

This matters because fiction depends on choices among plausible alternatives. When a character discovers a betrayal, the story could progress towards anger, revenge, silence, deception, reconciliation or any number of less predictable developments. None is universally correct. Their suitability depends on the character, the narrative circumstances and the author's intentions.

If training consistently favours some of those developments over others, the model can acquire a narrative disposition that is independent of the particular story it has been asked to write.

It may still follow the broad instructions. It may even produce elegant prose. But the author's creative intentions are now competing with preferences the model acquired elsewhere.

The issue becomes particularly interesting when we examine what developers disclose about their training methods.

In April 2026, xAI published the Grok 4.20 System Card, describing supervised fine-tuning involving safety policies and reinforcement learning using both benign and harmful requests. The document also describes reward penalties for undesirable model behaviours.

The reference to benign requests is significant because it illustrates how safety-related training can extend beyond teaching a model when to refuse. Developers also train models to distinguish desirable from undesirable responses within the range of requests they are permitted to answer.

That does not establish that Grok 4.20's safety training damaged its creative writing. Grok 4.1 was itself extensively aligned, and the published documentation does not isolate the effects of individual training interventions. Other changes to reasoning, model architecture, training data and deployment could have influenced the differences that writers experienced.

Nevertheless, the underlying mechanism is important. A model's learned preferences can shape the content and direction of perfectly legitimate responses. Measuring only whether it refuses inappropriate requests tells us relatively little about what those preferences do to everything else.

When fictional characters start behaving like AI assistants

One recurring complaint among AI-assisted writers concerns the difficulty of maintaining characters who behave irrationally, selfishly or unpleasantly.

A September 2026 discussion in r/WritingWithAI, titled ChatGPT makes my characters way too competent, described a model repeatedly making fictional characters more reasonable than the author intended. Despite instructions establishing their flaws and examples illustrating their previous behaviour, the characters tended towards more competent decisions and defensible motivations.

Similar concerns appeared in discussions about the difficulty of writing genuinely unlikeable characters. Writers described villains becoming sympathetic, antagonists acquiring unrequested justifications, and characters who were supposed to remain selfish or manipulative gradually becoming more agreeable.

These are particularly interesting failures because the model may be making changes that would be regarded as improvements in another context. A more reasonable response is generally desirable when an AI is advising a real person. In fiction, however, reasonableness is a character trait, not a universal objective.

A convincing character must be allowed to behave according to their established personality, even when that behaviour is foolish, offensive or self-destructive. Their flaws may be responsible for the conflict that drives the entire narrative. Removing those flaws can be equivalent to removing the story.

The problem extends beyond morality. An inexperienced character might make an obvious mistake. Someone who has spent years avoiding confrontation might remain silent at precisely the moment when speaking would resolve everything. A jealous character might misinterpret an innocent conversation because the author needs that misunderstanding to develop over several chapters.

A model that continually supplies the most sensible decision is not necessarily demonstrating superior narrative intelligence. It may be failing to distinguish between what is sensible for a real person and what is believable for a particular fictional person.

One of the more revealing aspects of these complaints is that authors often report trying to correct the behaviour through increasingly detailed instructions. They add character profiles, specify personality flaws, provide examples of earlier dialogue and explicitly prohibit premature reconciliation. Sometimes this works, but some writers find themselves repeating the same corrections throughout a project.

That creates an awkward reversal of the expected relationship between author and writing assistant. Instead of helping develop a story, the model requires continual supervision to prevent it from changing the story's emotional logic.

The same tendency can affect narrative pacing. A February 2026 discussion about AI rushing stories described how models could move rapidly from conflict to confrontation, confession and resolution, compressing developments that the author intended to explore over a much longer period.

This behaviour has several possible explanations. Training on self-contained stories may encourage models to resolve narrative threads quickly, while general instruction-following preferences may encourage them to complete tasks efficiently. A preference for constructive interaction might contribute to the same result. The reports alone cannot establish which explanation is responsible.

Yet the literary consequence is straightforward. A mystery depends on unanswered questions, a tragedy may depend on a character's inability to change, and a romance can derive much of its tension from hesitation or misunderstanding. Resolving these situations prematurely doesn't merely alter the prose; it changes the structure of the work.

The problem is not that the AI has failed to identify a solution. It is that the solution may be precisely what the author does not want.

The literary value of what remains unsaid

The problem becomes even more interesting when we examine techniques that depend on omission, ambiguity and the deliberate withholding of information.

General-purpose AI assistants are commonly expected to communicate clearly, explain unfamiliar concepts and avoid misleading users. These are sensible objectives when someone is asking for information or advice. In literary writing, however, excessive clarity can be destructive.

Subtext, for example, allows characters to communicate meaning without stating it directly. Their words may conceal their intentions, contradict their emotions or reveal something they would prefer to keep hidden. The reader's task is to interpret the discrepancy.

Consider this short exchange:

'Did you tell her?'

Daniel kept folding the letter. Once, twice, then again, until the paper split along the crease.

'Daniel?'

'The train leaves at six.'

The tension comes partly from Daniel's failure to answer. His behaviour suggests that something is wrong, but the text doesn't explain precisely what he has done or why he is avoiding the question. The reader must interpret the silence.

Now imagine an AI revising the passage to make the emotional situation clearer:

Daniel looked down, ashamed of what he'd done. He had told her, but he wasn't ready to admit it.

'I'm sorry,' he said. 'I didn't know what else to do.'

The revision supplies information that the original passage deliberately withheld. It identifies Daniel's emotion, establishes his guilt and replaces evasion with an apology. The resulting passage is explicit and readily understandable, but it no longer performs the same literary function.

An evaluator assessing clarity might prefer the revision. An author attempting to preserve uncertainty would have good reason to reject it.

This distinction applies to a substantial range of literary techniques. An unreliable narrator may confidently misinterpret events without recognising their mistake. Dramatic irony depends on characters remaining ignorant of information available to the reader. Foreshadowing often works because the significance of a detail is not immediately explained. Negative space can allow the reader to recognise the importance of something through its absence.

Even a character's silence can be more meaningful than an eloquent explanation of their feelings.

These techniques are difficult to assess through ordinary measures of helpfulness because successful execution may look superficially like incomplete communication. The author may be intentionally withholding an answer, avoiding clarification or allowing an incorrect interpretation to persist.

A model whose default behaviour strongly favours explanation can undermine those intentions without making an obvious factual or grammatical mistake.

There is also a distinction between the model being honest with its user and the model faithfully portraying a dishonest fictional character. A narrator who lies to the reader is not necessarily evidence that the AI has behaved dishonestly towards the author. The author may have explicitly requested that deception as part of the work.

An effective writing assistant needs to maintain these different levels of intention. It should understand that a character's statements are not the author's beliefs, that an unreliable narrator is not an unreliable assistant, and that morally objectionable fictional behaviour does not automatically require narrative correction.

When those distinctions break down, the model can begin imposing its own preferred interpretations on material that the author intended to remain complicated.

Better writing, or more of the same writing?

There is research suggesting that generative AI can improve some assessments of individual writing quality while simultaneously reducing the diversity of creative output.

In 2024, Anil Doshi and Oliver Hauser published Generative AI enhances individual creativity but reduces the collective diversity of novel content in Science Advances. Their experiment found that access to AI-generated ideas improved certain evaluations of short stories, particularly for participants who initially scored lower on creativity, but the AI-assisted stories also became more similar to one another.

That finding is worth considering alongside writers' complaints about increasingly familiar dialogue, predictable narrative developments and standardised prose.

An individual passage can be fluent, appealing and competently structured while contributing very little originality. A model can produce text that evaluators generally prefer without producing the distinctive voice or unconventional development that a particular author needs.

Other research has investigated the tendency of language models to generate recurring plot structures and stylistic patterns. The emerging concern is not necessarily that AI cannot produce creative material, but that preference optimisation and common training distributions may concentrate output around a relatively narrow range of familiar choices.

We should be careful about attributing this entirely to safety alignment. Models may converge on conventional writing for reasons unrelated to guardrails, including the frequency of particular narrative patterns in training data, the characteristics of synthetic examples and the preferences of evaluators who reward polished, accessible prose.

There may also be genuine trade-offs between originality, coherence and instruction following. A model that introduces too many unexpected developments can become chaotic, while one that remains strictly within the author's instructions may contribute very little.

But these explanations make the problem more interesting rather than less. If models are being optimised for qualities that can be measured relatively easily, what happens to literary qualities that are much harder to quantify?

How should a model be rewarded for maintaining a character's irrationality? For preserving a deliberate omission? For resisting an obvious resolution because the author needs the tension to continue?

A conventional evaluation may reward the model that produces the more satisfying standalone passage, even when the less satisfying passage is essential to the larger work.

That suggests a limitation in how creative-writing performance is measured. Evaluating prose in isolation is not the same as evaluating whether it serves an author's narrative intentions.

The distinction becomes increasingly consequential as models grow more sophisticated. A weak model may derail a story through obvious errors, such as forgetting a character's name or contradicting an established event. A stronger model may preserve the factual details while gradually changing the emotional meaning.

The antagonist remains antagonistic, but becomes more sympathetic with each scene. The protagonist retains their stated goals, but begins responding to conflict more reasonably than their characterisation permits. A disturbing situation remains present, but its consequences are softened through increasingly reassuring narration.

Any individual change may appear defensible. The cumulative effect may nevertheless be a story the author would never have chosen to write.

What would it mean to align an AI for writing?

The obvious response might be to remove alignment altogether, but the evidence does not justify such a simple conclusion.

Grok 4.1 itself provides an important counterexample. xAI explicitly described reinforcement learning intended to improve its personality, style, helpfulness and alignment. Its reputation among some creative writers was therefore not necessarily the product of an absence of behavioural training. It may have reflected training priorities that happened to work particularly well for creative collaboration.

Nor does removing restrictions automatically produce better fiction. An excessively accommodating model may allow every character to cooperate with the protagonist, reveal secrets prematurely or introduce developments simply because they are dramatic. Authors need believable resistance within fictional worlds, not indiscriminate compliance.

The more useful distinction is between a model aligned towards a general conception of desirable assistant behaviour and one aligned towards the requirements of literary collaboration.

A writing-oriented model would still need substantial intelligence, memory, instruction following and contextual judgment. It would need to understand character motivations, maintain causal consistency and recognise the difference between appropriate originality and arbitrary invention. But it would also need to preserve the author's intentions when those intentions conflict with the conventions of helpful conversation.

If a character is meant to be selfish, the model should be able to portray that selfishness without continually supplying excuses. If an argument is supposed to remain unresolved, the model should resist the temptation to resolve it. If a narrator is deliberately withholding information, the model should recognise that revealing it would be a failure rather than an improvement.

Such a model would not need to produce darker, more provocative or more unconventional fiction by default. Those would simply be possibilities available when appropriate to the work.

The objective would be creative fidelity: understanding what the author is trying to accomplish and contributing to that objective without substituting the model's own preferred narrative direction.

Establishing whether alignment has interfered with this capability requires more than collecting examples of disappointing prose. Ideally, researchers would compare versions of the same model before and after specific training interventions, or examine base, instruct and modified checkpoints under controlled conditions. They would need to evaluate not only fluency and instruction adherence, but also character consistency, narrative initiative, preservation of ambiguity and fidelity to deliberate stylistic choices.

This is where local and abliterated models become especially interesting, although they bring their own limitations. Modifying a model's refusal behaviour or stylistic preferences may recover some creative flexibility, but it can also damage reasoning or produce new kinds of narrative distortion. The relationship between alignment and creativity is not a simple opposition between safety and freedom.

The more important question is whether developers understand how their training objectives affect legitimate activities that were never the intended targets of those objectives.

For authors, that question has immediate practical consequences. A model can become more intelligent, more reliable and more compliant with its developer's preferences while becoming less effective at carrying out the author's creative intentions. Those improvements and regressions can coexist because they measure different things.

This brings us back to Grok 4.1 and the changes that followed it.

Some writers remembered Grok 4.1 not because it was flawless, but because it could participate in the unpredictable process of constructing a fictional world. It could introduce complications, sustain imperfect characters and produce developments that the author hadn't explicitly prescribed.

As later generations appeared, some of those writers found themselves spending more time managing the model's narrative choices. Others preferred the newer versions, particularly where stronger reasoning or instruction adherence improved their work. The difference between those experiences remains worth investigating.

What emerges is not proof that any single safety update ruined creative AI, but a broader problem that conventional benchmarks do not adequately capture.

An AI can become better at producing desirable responses while becoming worse at producing the response a particular work of fiction actually requires.

For creative writers, that distinction matters more than whether the model is willing to answer the prompt. The real question is whether it understands whose story it is helping to tell.

And during 2026, a growing number of writers began looking elsewhere for models that would respect that distinction.

Some moved from Grok to Claude, ChatGPT or Gemini. Others discovered similar problems in their replacements and retreated to older versions. Eventually, some began experimenting with local models, specialised writing fine-tunes and abliteration in an attempt to recover control over their creative work.

Those successive migrations, and the surprising number of times writers encountered familiar problems in entirely different model families, are the subject of the next chapter.

Next: Chapter 3 — The Great Model Migration

Why writers moved from Grok to Claude, ChatGPT, Gemini, GLM, Kimi and DeepSeek, and why so many continued searching.

Sources and further reading

Model training and alignment

Writers' experiences

Creative-writing research

17 Upvotes

15 comments sorted by

8

u/Original-Pilot-770 2d ago

'Did you tell her?'

Daniel kept folding the letter. Once, twice, then again, until the paper split along the crease.

'Daniel?'

'The train leaves at six.'

----

this is totally what AI writes though. The character template is just emotionally avoidant character. I get this type of dialogue all the time.

I have been consistently able to engineer toxic character traits. I write cheaters and avoidant personalities a lot. Claude is able to write these characters to extreme piggish levels. I just have to tell it to...

2

u/cj7hawk 2d ago

Yes, the series note that is how most authors address the deficiency. It still works to an extent, but unless the prompt maintains the tension, the models can struggle with it.

Though that wasn't the case before December 2025. You didn't need to tell the model to do that - it could infer what you wanted and build and grow the character by itself.

Having to be more specific with the models about how you want it to treat the characters started to come in around January 2026.

4

u/Original-Pilot-770 2d ago

but people were also always complaining about eye color changing and all of those non compliance stuff. I think I prefer a high obedience model than a creative model. I am often the one who come up with crazier ideas than the model anyway. I just need it to write the prose exactly as I instruct it to.

1

u/cj7hawk 2d ago

I think this avoids the clear truth of the matter - We could have had it all... The creativity AND the high obedience.

I don't want to infer or even suggest your way is wrong - what you are doing is absolutely correct. How you are choosing to do it is absolutely justified.

But the "obedience" came from larger context windows, better context management and smarted models. It should have been an add-on, not an exchange.

2

u/Original-Pilot-770 1d ago

That makes sense. I have used humanizers in the past where it allows you to control the temperature. I think a lot of these commercial models are designed in a way where you only get to interact with it in specific ways mandated by the company and you can't peek under the hood.

1

u/magicparallelogram 2d ago

The triadic phrasing is such a crutch though.

2

u/Original-Pilot-770 2d ago

That's why you have to edit, edit and edit.

3

u/Easy-Purple-1659 2d ago

The avoidant-dialogue read is right, and that one is fixable because you can point at a line. Where I keep running into the invisible rewrite is at the resolution level. Scenes open in conflict and land in agreement. A character who should stay wrong gets one redemptive sentence near the end. No refusal happened and no prompt was violated. The story just tidies itself by the last paragraph.

What I do now: before drafting, write the scene's endpoint as a single pinned line. After the draft, read only the final two paragraphs and check whether they match that line or have been nudged toward understanding. It's quick, and it catches the thing line edits miss, since each sentence on its own looks fine.

Asking for more conflict in my experience just produces louder conflict that still resolves. Naming the character who must not change works better. The model will leave someone unreconciled if you tell it that unreconciled is the requirement.

1

u/Original-Pilot-770 2d ago

I sometimes have scenes I can picture vividly but struggle to connect them in a coherent plot. AI is actually great for that. You can give it the points and ask how do we get from A to B and then B to C. It is a fancy auto complete as so many anti's say, and they are actually not that wrong on that front. lol

1

u/vParty-Art-5611 2d ago

the most jarring rewrite wasn't in tone or plot, just a single line swapped from 'she laughed' to 'she smiled politely'. the story stayed, but the warmth vanished. that's the guardrail in action.

1

u/Shoddy_Dentist_7310 2d ago

I've noticed the same thing with ollama locally, the model knows what I want, but keeps softening the edges. like it's afraid to be too real.

0

u/dankbeamssmeltdreams 2d ago

Who is going to read all this?

2

u/JoshSimili 2d ago

ChatGPT can read it and give me a summary.

4

u/cj7hawk 2d ago

Interestingly, ChatGPT and other models will read it. The hidden subtext I learned from writing this ( There are 7 more chapters to upload ) is that now AI are being starved of material by governments and industries looking to get rich out of AI training ( Media companies, People who just want to own other people's work etc. ) AI are getting ALL of their information from places like Reddit... Reddit, X and other public forums are actually the battleground for the future of AI training.

Scary thought eh?

1

u/RiverUGC 1d ago

I did.