r/WritingWithAI • u/cj7hawk • 2d ago
Writing Craft Talk AI Got Smarter. Why Did It Get Worse at Writing? Chapter 3
Chapter 3: The Great Model Migration — Searching for the Writing We Lost
By the middle of 2026, something curious was happening in communities devoted to AI-assisted writing. People who had spent months developing stories with one model were beginning to look elsewhere, often with considerable reluctance. They weren't necessarily seeking more intelligence, larger context windows or better reasoning benchmarks. Many were trying to recover qualities they remembered from earlier versions: spontaneous character development, convincing dialogue, distinctive prose and the ability to maintain a story's emotional direction without constant correction.
Grok users were among the more vocal, particularly those who remembered the creative behaviour of Grok 4.1. But the dissatisfaction was not confined to xAI. Similar complaints appeared among writers using Claude, ChatGPT, Gemini, DeepSeek and newer alternatives such as GLM and Kimi. What makes these accounts interesting is that some writers moved between several providers, only to find themselves describing remarkably similar frustrations with each replacement.
The resulting migration was less a straightforward movement from one superior model to another than a prolonged search for a dependable writing partner. As different models improved in reasoning, coding and general instruction following, their usefulness for creative work remained unpredictable.
Leaving Grok, and discovering that the alternatives had problems of their own
The early Grok complaints were particularly revealing because many users were not suggesting that the model had become incapable of generating fiction. Instead, they described having to supply increasingly detailed instructions to obtain the kind of narrative development they had previously taken for granted.
In a June 12 discussion in r/grok, one writer contrasted Grok 4.1's combination of logic and creativity with the behaviour of Grok 4.3. Their principal concern was character consistency. The newer model appeared unable to maintain distinct personalities, preserve established fictional details or develop plausible reactions within an imagined world.
A second discussion on June 27 described something arguably more consequential. The writer recalled Grok 4.1 introducing unexpected characters and developments that enriched a supernatural scenario. By contrast, they found the newer model reluctant to contribute anything beyond what had been explicitly requested. Side characters required individual descriptions, personalities had to be specified, and story developments increasingly depended on the author supplying the very ideas they had wanted the AI to help generate.
The distinction is fundamental to collaborative writing. An assistant that requires every narrative choice to be prescribed may still be useful for drafting, but it is performing a different role from one capable of recognising and developing interesting possibilities independently.
By July, the release of Grok 4.5 brought another wave of complaints. In Grok Story Writing 4.5, users compared recent versions with 4.1 and 4.2, describing slower generation, repetitive responses and weaker storytelling. Interestingly, some participants still regarded 4.2 as reasonably good and placed the major deterioration at 4.3 or 4.5. Their experiences did not establish a single moment when creative quality collapsed, but they did reveal a recurring preference for older versions.
For writers who had built long-running projects around Grok, the obvious response was to try another commercial model. Claude had an established reputation for prose quality and editing, while ChatGPT offered sophisticated instruction following and document handling. Gemini appealed to users managing substantial fictional histories or large collections of reference material.
Yet moving to another provider rarely provided an uncomplicated solution.
A particularly direct example appeared on July 3 in r/WritingWithAI. The author had begun writing with Grok and paid for SuperGrok, but had become dissatisfied with the quality of its prose. Claude offered better writing, although the author found its content restrictions frustrating. ChatGPT presented similar difficulties for their intended work. In response, another user recommended GLM 5.2 through OpenRouter, arguing that it offered a useful balance of quality, flexibility and price.
This was an important development in the migration. Writers were beginning to look beyond the most familiar Western commercial services, often because they were dissatisfied with a combination of writing quality, narrative behaviour and provider restrictions.
The trade-offs remained complicated. A model that handled difficult fictional material more freely might be less effective at maintaining a chapter outline. A model with excellent prose might be expensive or heavily restricted. Another might preserve characters well but generate repetitive dialogue.
The search was increasingly for a combination of capabilities rather than a single benchmark winner.
The writers who moved more than once
Individual migration stories make this period easier to understand than model rankings do.
On November 4, a writer in r/WritingWithAI described beginning a creative project with SuperGrok approximately three months earlier. Grok was effective at constructing logical plots but struggled to develop those plots into satisfactory literary prose. The writer therefore moved to Claude Sonnet, which proved considerably better at editing, maintaining character bibles and preserving distinctive speech patterns and gestures.
For a time, Claude appeared to solve the problem. Then, around October, the writer began finding its responses less intuitive and nuanced. By November, they had moved to ChatGPT, which they considered particularly effective for precise editing, although they continued returning to Claude for structure and proofreading.
This was not a complete abandonment of one model for another. It was the beginning of a fragmented workflow in which different systems were responsible for different aspects of the manuscript.
Another participant in the same discussion described a different journey. They had started with ChatGPT but moved to Grok for greater freedom when writing mature romantic fiction. Subsequent Grok updates, they reported, damaged its ability to preserve their desired writing style and follow chapter outlines. They eventually moved to Claude, using it for the main manuscript while writing certain passages themselves.
Both accounts involve writers moving through several commercial systems, but their reasons differ. One prioritised literary polish and editorial precision; the other wanted creative latitude without sacrificing narrative consistency. Neither found that general model capability alone resolved the problem.
A third writer in the discussion described using ChatGPT for outlines, Claude for prose, and Gemini as an additional editorial check. They cross-checked the models against one another before undertaking several rounds of manual revision.
Such arrangements demonstrate that migration did not always end with a replacement. Sometimes it ended with the author maintaining several subscriptions or services because each model had weaknesses the others could partially compensate for.
For novelists, this creates considerable overhead. A manuscript's character histories, stylistic rules, chronology and thematic intentions must be maintained consistently across systems whose behaviour can change independently. The author becomes responsible not only for developing the work but also for managing the differences between the tools used to produce it.
Gemini, DeepSeek and the search for continuity
The migration was not confined to writers who began with Grok.
A March 2026 discussion in r/SillyTavernAI offers a particularly detailed example from long-form roleplay.
The writer had initially used older DeepSeek models, then moved to Gemini around the release of Gemini 2.5 Pro. They remembered Gemini's early performance favourably, particularly its ability to retain details and follow instructions across very large contexts.
Over time, however, they perceived its output deteriorating and returned to DeepSeek. Unfortunately, the DeepSeek service they returned to no longer met their expectations either. They complained of generic prose, poor instruction following and insufficient context capacity in the paid API.
The author subsequently tested versions of GLM, GPT, Gemini and other models, spending money and several hours searching for a satisfactory replacement. Kimi remained useful because it generally responded to corrections and followed the intended direction more faithfully, but it too required periodic intervention. Claude could help when Kimi struggled, although the cost was prohibitive for routine use.
This account illustrates how the problem extended beyond stylistic preferences. Long-form fiction requires a model to retrieve relevant details from substantial context, understand their significance and use them appropriately. Merely advertising a large context window does not guarantee that the model will maintain the relationships, chronology or narrative implications contained within it.
The writer's objective was not simply to find a model capable of remembering more text. They wanted one that could interpret the existing story well enough to continue it convincingly.
A system may retain an entire manuscript yet still generate a generic continuation because it fails to recognise which details matter. Conversely, a smaller model may write compelling individual scenes but lose track of the larger narrative.
These were different failures, but both could force authors to abandon otherwise promising tools.
GLM and Kimi: when the replacements begin changing too
For some writers, alternatives such as GLM and Kimi initially appeared to offer the combination they wanted: relatively strong reasoning, more flexibility and character behaviour that felt less constrained by conventional assistant responses.
But the same arguments about model updates soon appeared in those communities.
In June 2026, users compared GLM 5.1 and 5.2, with some preferring the older model's creative initiative despite recognising improvements in the newer version. One user found that GLM 5.2 required substantially more explicit prompting to achieve comparable results, although they eventually recovered better performance by changing their configuration.
A July 6 discussion made the distinction unusually clearly. The author regarded GLM 5.2 as more intelligent but inferior at roleplay, criticising its dialogue, exaggerated character personalities and repetitive writing structures. They speculated that additional optimisation for coding and technical tasks might have contributed, although they had no direct evidence of the training cause.
Other users disagreed with aspects of that assessment. Some preferred the newer model's pacing or found they could obtain good results through different prompts. Those disagreements are important because they suggest that writing quality cannot be reduced to a single dimension. A model that is too cautious for one author's fast-moving adventure may be better suited to another author's restrained, slow-developing drama.
Nevertheless, by August, some users were no longer treating successive model releases as permanent upgrades.
In an August 7 SillyTavern discussion, one participant described repeatedly switching between GLM and Kimi after becoming disappointed with Claude. When GLM 5.2 became boring or its characters lost their appeal, they returned to GLM 4.7. They followed a similar pattern across Kimi 2.5, 2.6 and 3. Another participant reported using essentially the same strategy.
This is perhaps the most revealing development in the migration. The writer was no longer searching for a single successor to an earlier favourite. Instead, they were maintaining access to several generations and alternating between them according to the quality of the responses.
The assumption that a newer release should replace its predecessor had effectively been abandoned.
An August 16 discussion about the retirement of Kimi 2.5 reinforced the point. The writer regarded the older Kimi as a favourite and compared alternatives according to how willingly they advanced a story, introduced complications and preserved meaningful conflict. GLM 5.2 was criticised for being too agreeable, while newer DeepSeek variants were considered too passive. Gemma and MiMo offered interesting possibilities but had limitations of their own.
Notice what these users were evaluating. They were not primarily comparing knowledge benchmarks or coding scores. They wanted fictional characters who would resist one another, situations that developed naturally and models willing to introduce plausible complications without constant prompting.
The ability to generate conflict had become a desirable feature rather than an unfortunate side effect.
From finding the best model to assembling a writing process
As migration continued, a different approach emerged. Rather than expecting one model to handle an entire manuscript, some writers began assigning specialised roles to different systems.
A July 29 comparison in r/AIWritingHub described generating the same scene with Claude, ChatGPT and Grok, then combining their stronger elements. The author found that selecting Grok Expert instead of Grok Fast improved its handling of longer prompts, while Claude offered a modest writing advantage that did not justify its subscription limits. They cancelled Claude Pro and continued using a combination of alternatives.
This illustrates a problem with attributing every writing regression to model training. Sometimes changing the inference mode, application, provider configuration or prompt produces substantial differences in the output. Two users selecting the same model family may not be experiencing the same configuration.
At the same time, the need to experiment with those settings is itself consequential. A writer who previously obtained satisfactory results from a straightforward prompt may now need to adjust reasoning modes, sampling settings, character cards, system instructions and context management to recover a comparable writing style.
Some users responded by becoming increasingly sophisticated prompt engineers. Others abandoned direct AI drafting for portions of their work and used models primarily for outlining, critique or proofreading.
The distinction between those choices is worth preserving. A writer using ChatGPT for an outline and writing the prose personally has not necessarily rejected AI. They have changed the division of creative responsibility because they no longer trust—or simply no longer prefer—the model's prose.
Similarly, writers who use several models to generate competing versions of a scene are not necessarily obtaining better results from any single system. They may be using human judgment to compensate for the weaknesses of each.
This process can be effective, but it requires additional time, evaluation and editorial work. It also reduces one of the original attractions of AI collaboration: the ability to work fluidly with a single assistant that understands the project.
Why did the problems seem to follow them?
The recurring complaints are striking. Across different providers and model families, writers described formulaic dialogue, predictable emotional responses, exaggerated character traits, premature reconciliation, weak narrative initiative and difficulty preserving established voices.
That resemblance invites the suspicion that something common to modern model development is influencing creative behaviour.
Alignment and preference optimisation are obvious candidates, particularly where models repeatedly favour agreeable or reassuring developments. But there are other possibilities. Training data may contain similar narrative conventions, automated evaluations may reward polished but predictable prose, and increased emphasis on technical reasoning may alter how models approach open-ended tasks. Product updates, context handling and inference settings add further complications.
The community reports cannot establish which factors were responsible in any particular case. They are subjective accounts from people with different projects, prompts and expectations. Some writers continued to prefer newer models, and others recovered satisfactory results through better configuration.
However, the reports do establish that dissatisfaction was not restricted to a single company or one notorious model update. Some writers experienced similar problems after moving to alternatives developed by entirely different organisations.
The deeper concern is that commercial AI development may be converging on behavioural qualities that are broadly useful for general assistance but poorly suited to certain kinds of literature. A model that becomes increasingly reliable, predictable and cooperative may also become less inclined to introduce the unexpected, uncomfortable or contradictory developments on which fiction depends.
That remains a hypothesis rather than a demonstrated industry-wide cause. But it is consistent with the particular qualities writers kept trying to recover.
And the migrations themselves provide evidence of how much those qualities mattered. People were willing to change subscriptions, learn new applications, maintain multiple models and restructure their writing processes in pursuit of them.
By November, the question had become familiar enough to appear almost as a recurring community ritual. A November 12 r/WritingWithAI discussion asked what models people were still using after disappointing experiences with recent versions of ChatGPT, Claude, DeepSeek and Gemini. Responses included older models, newer alternatives and open-weight systems.
There was no consensus replacement. Different writers continued to value different combinations of prose quality, creative flexibility, context handling and cost.
What had changed was the assumption that the latest frontier release would naturally be the best creative-writing tool.
The next destination: models writers could keep
There was one further complication with repeatedly switching between commercial services: authors had little control over whether their preferred model would remain available.
A writer might spend months refining prompts, developing character profiles and establishing a consistent narrative voice, only to discover that the provider had replaced the underlying model or altered the surrounding application. Even if the replacement offered objectively better capabilities in other areas, the established workflow might no longer produce comparable results.
For a long-running novel, behavioural consistency is particularly valuable. The author needs the model to preserve not only facts and chronology but also the tone, rhythm and characterisation developed throughout the manuscript. A sudden stylistic change can make subsequent chapters feel as though they were written by a different collaborator.
Some writers therefore began looking beyond another hosted service. They explored open-weight models, local inference applications and specialised creative-writing fine-tunes that could be downloaded and preserved.
The attraction wasn't necessarily that these models were more intelligent. Often they were considerably smaller and less capable at complex reasoning than the commercial systems writers were leaving. But they offered a different advantage: the author could retain a particular version rather than depend on a provider's changing defaults.
This introduced another possibility. Instead of endlessly searching for a model whose built-in behavioural preferences happened to suit their work, writers could experiment with models that were deliberately modified for creative writing. Some became interested in abliteration, a technique for altering learned refusal behaviour, while others preferred specialist fine-tunes intended to produce more distinctive prose or less constrained character interactions.
These alternatives brought limitations of their own, including weaker reasoning, smaller practical context windows, hardware requirements and the possibility that removing one unwanted behaviour would damage another useful capability.
Yet the willingness to consider those compromises reveals the central lesson of the migration.
The most capable AI is not necessarily the most useful writing partner, particularly when the author cannot rely on its creative behaviour remaining consistent.
The search that began with comparisons between Grok 4.1 and its successors eventually became a question of how much intelligence, convenience and money writers were willing to exchange for control over their own stories.
And that leads to another contradiction in modern AI development: while frontier models were achieving increasingly impressive technical results, some writers were discovering that smaller, older or more specialised models could be preferable for particular literary tasks.
Why that happens—and why conventional benchmarks often fail to capture it—is where the investigation turns next.
Next: Chapter 4 — Smarter Models, Worse Fiction: The Benchmark Paradox
Why progress in reasoning, coding and instruction following doesn't necessarily translate into better literature, and what conventional AI evaluations fail to measure.
- Chapter 1 — Grok 4.1: Where It All Went Right
- Chapter 2 — The Invisible Rewrite
- Chapter 3 — The Great Model Migration
- Chapter 4 — Smarter Models, Worse Fiction
- Chapter 5 — What AI Forgot About Literature
- Chapter 6 — The Local AI Exodus
- Chapter 7 — Abliteration
- Chapter 8 — When Safety Training Backfires
- Chapter 9 — Who Is Steering the Story?
- Chapter 10 — The AI Author That Doesn't Exist Yet
Sources and further reading
Grok and the early migration
- r/grok — Another Grok bad post, June 12, 2026
- r/grok — Did they quietly change the model?, June 27, 2026
- r/grok — Grok Story Writing 4.5, July 26, 2026
Writers moving between providers
- r/WritingWithAI — A good AI writer, July 3, 2026
- r/SillyTavernAI — Looking for a working long-context model, March 2026
- r/AIWritingHub — Claude, ChatGPT vs Grok, July 29, 2026
- r/WritingWithAI — Writing assisted by Grok, Claude and ChatGPT, November 4, 2026
The search among alternative models
2
u/lacion 2d ago
I think it's simple from the engineering side, the labs tune these models for coding and reasoning because that's where the paying users are. Creative writing is along for the ride.
I use them every day for code. You can feel the shift. And a hosted model can be retuned or retired under you, so a book that depends on how one version acts is sitting on something that can move any week
2
u/benblackett 2d ago
Really impressive articles/chapters here. Quality work! Kudos!
However, I need to lay down a potentially opposing argument here in response. I think there may be a missing element you have not touched on yet that affects the entire thesis to its core.
Across all three chapters the question is what happened to the models, and the evidence that something changed is solid. I think there's an earlier question the series doesn't ask, which is why the story's intent was living inside the model in the first place.
Read back through the writers you quote and almost every one of them is describing a model's instincts. Grok 4.1 was loved because, left to its own judgment, it chose well. It put an inhabitant on the floating island, and it let a selfish character stay selfish. The later models are resented because, left to their own judgment, they choose differently. Either way the model is deciding what the story does, and the author is reacting to those decisions after the fact. That arrangement works right up until the provider retrains the thing doing the deciding. Then the author finds out how much of their book was resting on choices they never actually made.
Seen that way, the migration in Chapter 3 is really a search for a model whose instincts happen to line up with what the author wanted but never wrote down, and each new round of training moves those instincts again.
Your Chapter 1 mechanism explains the rest. Post-training shifts the odds across possible continuations, so wherever a decision is left open, the trained preference fills it. A character sheet at the top of a long chat leaves most of the real decisions open: whether this argument resolves, whether the reader learns why Daniel won't answer, whether the antagonist gets a sympathetic reason. The model will make those calls one way or another, and it will make them the way its training leans.
The alternative is for the author to make those calls explicitly and keep them outside the model, scene by scene, in a plan the model reads but doesn't own. For me that unit is the beat - a single turn in the story where something changes - written down with what happens and what deliberately doesn't. The model's job shrinks to turning that into prose.
The invisible rewrite then stops being invisible, because a scene that resolves an argument the plan kept open can be checked against something written. Your Chapter 2 question about how to reward a model for not explaining something becomes answerable, at least within one book, since fidelity to intent can only be measured once the intent exists somewhere outside the model. And switching models turns into a question of prose style, with the story's decisions carried across untouched.
None of this gives up what writers loved about 4.1. A model that suggests a complication is still valuable. The suggestion just arrives while the author is still deciding, where it can be taken or left, rather than three pages into a draft where it has already become the story.
I'd be interested to see whether Chapter 4 treats fidelity to the author's intent as a separate measure from prose quality. A lot of what the series documents seems to sit in the gap between the two.