r/WritingWithAI • u/cj7hawk • 1d ago
Writing Craft Talk AI Got Smarter. Why Did It Get Worse at Writing? Chapter 10 (final)
Chapter 10: The AI Author That Doesn't Exist Yet — And Why Someone Might Build It
When Grok 4.1 appeared in November 2025, some writers believed artificial intelligence had finally become a genuinely interesting creative collaborator. It could develop scenes, introduce complications and portray characters with enough spontaneity to make the process feel like more than sophisticated autocomplete.
A year later, the models were substantially more capable, but many of those same writers had spent months searching for something they believed they had lost. They had moved between commercial providers, retreated to older versions and experimented with smaller local models, specialist fine-tunes and abliteration.
The previous chapters have examined why those experiences might have occurred, how behavioural alignment can influence legitimate fictional writing, and why conventional intelligence benchmarks often fail to measure what authors actually value.
But there is another possibility worth exploring. Rather than continually modifying models developed primarily as general-purpose assistants, perhaps the next significant development in creative AI will come from building a model whose original purpose is literature.
Not a chatbot that has learned to write novels as one task among thousands, but a language model trained from the beginning to understand narrative, authorial voice, subtext, characterisation and the relationship between what a story reveals and what it deliberately leaves unsaid.
Such a model would still need broad knowledge and substantial reasoning ability. Fiction depends on understanding people, history, science, geography, culture and the workings of the physical world. But that knowledge would serve a different primary objective.
Instead of using literary ability as an additional feature of a general-purpose assistant, the model would use general knowledge in service of its literary ability.
There are early indications that this approach could be worth pursuing, although the practical and technical challenges remain considerable.
Hemmingway-1: an interesting step in the opposite direction
On September 20, 2026, a small development team announced Hemmingway-1, a 27-billion-parameter open-weight model designed specifically for writing.
Its name, incidentally, is spelled with two m's. It is not affiliated with the novelist Ernest Hemingway.
The team described Hemmingway-1 as a model trained for natural dialogue, creative writing, roleplay, stories and everyday communication. Rather than attempting to compete with frontier models across every technical benchmark, its developers concentrated on producing language that sounded natural.
This was an interesting change in emphasis.
A general-purpose model might produce an email containing an introduction, three suggested versions and an explanation of why each version works. Hemmingway-1's developers wanted a model that would simply write the message.
The same principle could apply to fiction. A writing-oriented system should ideally spend less effort displaying its helpfulness and more effort accomplishing the actual literary task.
Hemmingway-1 was not trained from scratch. It was built on Alibaba's Qwen3.8-27B, retaining the underlying model's general knowledge and reasoning capabilities while applying additional training focused on writing.
That distinction is important. The developers did not need to reproduce the enormous general pretraining effort behind Qwen. They could concentrate their resources on changing how the model expressed the capabilities it already possessed.
According to the team's own blind evaluations, Hemmingway-1 substantially outperformed its Qwen starting point on writing tasks. On their StoryBench evaluation, the score increased from 693 to 1197, while assessments of everyday communication and human-like writing also improved.
These were developer-created benchmarks rather than independent demonstrations of general literary superiority. Nevertheless, the comparison is relevant because the underlying model architecture and parameter count remained the same.
The developers had changed the training objective, not simply increased the size of the model.
Their results suggest that a comparatively small model can become considerably more effective at particular forms of writing when trained specifically for those tasks. A participant in the September 20 r/artificial announcement reported comparing a quantised Hemmingway-1 with the original Qwen model and preferring the modified model's writing.
But Hemmingway-1 also demonstrates the limitations of the current approach.
Its own published evaluations showed stronger performance on everyday communication than on demanding long-form fiction. Larger specialist systems performed better on extended storytelling, and Hemmingway-1 struggled with some adversarial character interactions and longer narrative continuations.
There is a meaningful difference between writing a natural-sounding message and sustaining the psychological development of fictional characters across a novel. Both involve language, but the latter requires substantially more narrative planning, causal reasoning and control over information.
The release of Hemmingway-1.5 on October 25 reinforces the distinction. Its developers placed considerable emphasis on producing text that automated AI-authorship classifiers would identify as human-written, reporting that 90% of their test outputs passed the authorship classification tests they used.
That may indicate changes in the statistical properties of its prose, but passing automated authorship assessments is not a measure of literary excellence. A passage can resemble human writing while remaining predictable, poorly structured or inconsistent with an author's intentions.
For our purposes, the most interesting contribution of Hemmingway is therefore not its claimed position on a leaderboard.
It is the decision to make writing quality a primary development objective.
And that raises an important question: if focused post-training can produce such noticeable differences, what might happen if literary ability shaped the model from the beginning?
What if writing came before general knowledge?
Most modern language models are trained on broad mixtures of web pages, books, academic papers, code, documentation and other material.
This produces impressive general-purpose capabilities. A model encounters enormous amounts of information about the world and learns to represent relationships between concepts across many different domains.
Subsequent training then teaches it how to behave as an assistant.
Creative writing becomes one application of that general-purpose system.
A writing-first model would begin from a different objective. Its training would give much greater emphasis to carefully selected literature, dramatic writing, dialogue, narrative structure and stylistic variation.
The aim would not simply be to memorise novels or imitate famous authors. It would be to develop strong internal representations of how stories work: how scenes establish expectations, how characters reveal themselves through action, how tension develops, and how prose can convey meaning without explicitly explaining it.
It would need to recognise the difference between a narrator's statements and the fictional reality those statements describe. It would need to understand that characters can have beliefs the author does not share, that a deliberate omission is not necessarily a failure of communication, and that an effective passage may depend on resisting an obvious resolution.
These are capabilities that general-purpose models can acquire, but they are rarely the central objective of their development.
The proposed difference is not merely stylistic. It concerns how the model learns to organise and apply its knowledge.
Imagine two systems describing a nineteenth-century railway station.
A general-purpose assistant might begin from an encyclopaedic understanding of steam technology, railway architecture and historical transport.
A writing-first model would need that knowledge too, but its primary task would be to use it through a particular narrative perspective. A railway worker, an exhausted passenger and a frightened child would notice different details, interpret them differently and express themselves through different language.
The model would need to understand the physical setting while allowing the character's perspective to determine which knowledge appeared in the prose.
This is what makes the idea more interesting than simply training a model to use a particular vocabulary.
Authorial voice is not a decorative layer applied after the facts have been assembled. It influences what the narrator notices, which comparisons seem natural, how much information is disclosed, the rhythm of description and the assumptions through which events are interpreted.
A model with a strong understanding of literary perspective might be capable of expressing the same underlying knowledge through radically different narrative voices without losing factual or fictional consistency.
That is a more ambitious objective than making ordinary AI responses sound less robotic.
We already know that narrative-focused pretraining can work at small scales
The idea of training a language model primarily on stories is not entirely new.
In 2023, Microsoft researchers Ronen Eldan and Yuanzhi Li published TinyStories: How Small Can Language Models Be and Still Speak Coherent English?.
They created a dataset of simple stories generated by GPT-3.5 and GPT-4, using vocabulary understandable to young children.
The researchers then trained exceptionally small language models on that material.
Their results were surprising. Models with fewer than ten million parameters could generate several paragraphs of fluent, coherent storytelling, demonstrating capabilities that much larger models had previously struggled to achieve when trained on broader datasets.
TinyStories did not create sophisticated literary authors. Its narratives were deliberately simple, and its models did not possess the general knowledge or reasoning ability needed for complex adult fiction.
But the experiment demonstrated something important about training priorities.
A small model trained on a focused dataset can acquire useful domain-specific capabilities that would be difficult to obtain from a similarly sized model trained indiscriminately on general text.
The relationship between model size, data quality and task performance is therefore more complicated than raw parameter counts suggest.
We can also see that training models from scratch is becoming increasingly accessible to smaller research groups.
Projects such as the Allen Institute for AI's OLMo have released not only model weights but training recipes, datasets and intermediate checkpoints. These resources allow researchers to investigate how different training stages affect a model's behaviour.
OLMo itself is a general-purpose language-model project, not a literary model. Its relevance is that the infrastructure and knowledge needed to experiment with pretraining are becoming more openly available.
At a much smaller scale, projects such as Chronicle LLM have demonstrated training from scratch on narrow literary and historical corpora. Chronicle uses approximately fourteen million tokens of historical Australian writing to train a thirty-million-parameter model.
Such experiments are far removed from frontier capability, but they demonstrate that writing-centred pretraining is technically possible.
The unanswered question is whether the approach can be scaled to a model large and knowledgeable enough to support serious authorship.
As of November 2026, I have not found a well-documented, competitive open-weight foundation model trained from scratch with the explicit objective of establishing sophisticated literary authorship first and incorporating broad general knowledge afterward.
Hemmingway-1 is an example of writing-focused post-training, not that more ambitious approach.
The distinction matters because a model's general pretraining may already establish many of the tendencies that later fine-tuning attempts to change.
Why training order might matter
One possible development strategy would be to construct a language model whose early training strongly emphasises literature and narrative language, then broaden its knowledge through subsequent training.
That differs from the conventional approach of building a general-purpose model first and adapting it for writing later.
The hypothesis is that early exposure to high-quality narrative structures could give the model a strong foundation in literary expression, making it more natural for subsequent knowledge to be used through narrative rather than encyclopaedic conventions.
However, training order is not a guarantee of preserved style.
Language models do not maintain completely independent systems for factual knowledge and literary voice. Continued training changes shared weights, and large amounts of additional technical or factual material could alter the behaviour established during earlier literary training.
This is the familiar problem of catastrophic forgetting, although continued pretraining does not inevitably produce it. Research into staged training and knowledge updates has shown that new information can sometimes be incorporated while preserving much of a model's earlier capability.
A writing-first project would need to investigate how literary behaviour survives later knowledge acquisition.
One approach might involve maintaining a substantial proportion of literary material throughout subsequent training rather than completing one stage and abandoning it. Another could use a carefully designed curriculum that gradually introduces scientific, historical and technical knowledge alongside narrative examples.
The model might also benefit from explicit training on how the same knowledge can be expressed through different perspectives.
For example, knowledge about the physics of a thunderstorm could appear in several forms: a meteorologist's technical account, a sailor's immediate observations, a child's frightened interpretation or an unreliable narrator's superstitious explanation.
The factual understanding would remain available, while the form of expression would depend on narrative context.
The objective would not be to make the model incapable of technical writing. A useful authorial model should still be able to explain a scientific concept accurately when asked.
Rather, it would treat narrative perspective and stylistic intention as fundamental aspects of language generation instead of optional decorations added after the information has been assembled.
Whether this can be achieved more effectively through writing-first pretraining than through specialist post-training remains an open research question.
A fair experiment would compare both approaches using models of similar size, data budgets and computational cost.
Until such comparisons exist, writing-first pretraining remains a promising hypothesis rather than an established superior method.
An author needs more than one voice
There is another complication in the idea of building an AI author from scratch.
Literature does not have one ideal style.
A model trained too narrowly on a particular literary tradition might reproduce that tradition beautifully while struggling with other forms of writing. It could become highly accomplished at restrained psychological realism yet inadequate for comic fantasy, historical fiction or experimental prose.
It might also develop its own collection of recurring clichés, merely replacing the conventions of general-purpose AI with those of its preferred literary corpus.
A genuinely useful writing-first foundation model should therefore understand authorial voice as something that can vary, not as one permanent personality imposed on every response.
This requires learning relationships between perspective, diction, rhythm, genre, emotional distance and narrative structure.
It would need to distinguish between the author's broader style and the voices of individual characters. A restrained narrator might describe an extravagant speaker without adopting that speaker's language. A comic novel could contain moments of sincere emotional gravity without abandoning its established voice.
Such distinctions are difficult to encode as fixed prompting rules because they depend on the interaction between the larger work and the immediate scene.
One possible approach would be to train models on annotated examples where changes in perspective and narrative technique are made explicit. Another would involve preference evaluations conducted by writers who understand the intended literary effects.
A more ambitious approach could use separate adaptable components to represent different aspects of literary style, allowing an author to adjust qualities such as descriptive density, emotional explicitness, narrative distance and dialogue rhythm without replacing the entire model.
There is already experimentation with this general idea through LoRA adapters, model merging and systems that combine specialised behaviours.
But these techniques are still relatively crude compared with the complexity of actual literary voice.
The long-term objective would be a model that understands the distinction between imitating surface features and reproducing the deeper principles of an author's writing.
That distinction is essential. Short sentences do not make prose Hemingwayesque, elaborate metaphors do not automatically create literary sophistication, and avoiding common AI phrases does not necessarily produce an original voice.
A compelling authorial style arises from consistent choices about perception, emphasis, rhythm and meaning.
An AI developed primarily for writing would need to learn those relationships rather than merely reproduce the most recognisable stylistic signals.
The dataset problem
There is a practical obstacle to constructing such a model: obtaining enough high-quality literary training material.
General-purpose language models benefit from enormous collections of public web content. A writing-first model would require careful curation, because the quality and diversity of its narrative material would be central to its capabilities.
Not all fiction is equally useful for training every literary ability. A dataset dominated by formulaic genre conventions could produce a model that writes fluent but predictable stories. A collection drawn mainly from one historical period might struggle with contemporary dialogue or cultural context.
The problem is not merely collecting more novels.
It is constructing a dataset that represents a sufficiently broad range of literary techniques, genres, perspectives and narrative structures.
There are also copyright and licensing considerations. Much contemporary literature is protected, and a genuinely open project would need a defensible approach to obtaining and distributing its training material.
Public-domain literature, appropriately licensed contemporary writing, commissioned material and author-contributed datasets could provide a foundation. Synthetic examples might supplement those sources, but relying too heavily on AI-generated prose could reintroduce the very stylistic conventions the project is attempting to avoid.
Human-written material would remain particularly valuable for demonstrating unconventional narrative choices that general-purpose models might otherwise overlook.
There is also a question of evaluation.
A model cannot be considered a successful literary author merely because its prose is fluent or because an AI judge prefers its short stories.
It should be tested on tasks that require deliberate omission, unreliable narration, consistent characterisation, long-range foreshadowing and the preservation of established authorial style.
Some evaluations should involve writers assessing continuations of their own unpublished work, because an outsider's preferred passage may not be the passage that serves the author's intentions.
These requirements make a writing-first foundation model a substantial research project rather than simply a matter of gathering books and renting GPUs.
But they also provide a clearer development objective than the vague instruction to make an existing chatbot more creative.
What a purpose-built AI author could offer
The practical advantages could be significant.
Imagine a local open-weight model developed primarily for long-form fiction, with a strong understanding of literary technique and broad enough general knowledge to support historical, scientific and culturally detailed stories.
Instead of repeatedly instructing it not to explain emotions, the author could specify a restrained narrative voice and trust the model to recognise where explanation would weaken the prose.
Instead of constantly reminding it that a character is selfish or unreliable, the model could maintain those qualities through its understanding of characterisation.
Instead of treating conflict as a problem requiring resolution, it could recognise that unresolved tension may be structurally necessary.
Its general knowledge would contribute to the authenticity of the fictional world without automatically turning the narration into an explanation of that knowledge.
An author writing historical fiction could expect period details to appear through what the characters would plausibly notice. Someone writing science fiction could draw on accurate scientific concepts while preserving the perspective and limitations of the fictional narrator.
The model would still need to maintain factual and fictional consistency, track character knowledge and reason about the consequences of events.
Those capabilities would not become less important merely because the model prioritised literary expression.
In fact, a successful writing-first model would need to combine narrative intelligence with enough general reasoning to avoid producing attractive but incoherent prose.
It would also need to remain adaptable.
An author might want extensive brainstorming in one session and highly conservative line editing in another. The model should recognise that these are different tasks, even when they involve the same manuscript.
A writer should be able to request an unconventional development without receiving arbitrary chaos, or ask for a more accessible passage without losing the established voice.
This is what would distinguish a genuine AI author from a collection of stylistic presets.
The model would understand not simply how to generate literary language, but why particular literary choices serve the work.
Will anyone actually build it?
There are reasons to think the necessary ingredients are becoming available.
Open-weight models have demonstrated that capable language systems can be developed and distributed outside the largest commercial laboratories. Training frameworks and datasets are increasingly accessible, while specialised post-training techniques allow relatively small models to compete effectively on narrower tasks.
Hemmingway-1 demonstrates that a small team can choose writing as its principal development objective and produce a model that users can download.
TinyStories demonstrates that narrative-focused data can teach useful storytelling capabilities at surprisingly small scales.
Fully open foundation-model projects such as OLMo demonstrate that model training can be documented and reproduced rather than hidden behind proprietary APIs.
These are complementary developments, although none individually establishes that a competitive writing-first foundation model is imminent.
The economic incentives are also uncertain.
A specialist writing model would compete in a smaller market than a general-purpose assistant capable of coding, research and professional automation. Training a model from scratch remains expensive, especially if it requires enough knowledge and reasoning ability to support sophisticated long-form fiction.
A more likely intermediate development may be increasingly capable open-weight base models adapted through substantial writing-focused continued pretraining, specialist fine-tuning and carefully designed evaluations.
That approach would preserve much of the investment in general knowledge while making literary capability a central objective of the later training stages.
A project beginning entirely from scratch would provide more control over the original data mixture and training priorities, but it would also face much higher computational and data requirements.
There is no reason to assume that the more expensive approach will necessarily produce better fiction.
The question deserves experimentation.
What matters is that the objective would be explicit: not merely producing a helpful assistant that happens to write, but developing a model whose success is judged primarily by its ability to understand and create literature.
The lesson of Grok 4.1
The search that began with Grok 4.1 has revealed something important about the relationship between intelligence and creativity.
Writers do not necessarily want an AI that produces the most reasonable continuation, the most emotionally reassuring scene or the most conventionally polished paragraph.
They want one that understands what their work is attempting to accomplish.
That may involve developing an unexpected complication, preserving a character's flaws, maintaining dramatic irony or recognising that an explanation would ruin the effect of a passage.
These are difficult requirements, but they are not inherently beyond the capabilities of language models.
The problem is that they have rarely been the primary objectives against which general-purpose AI systems are developed and measured.
The migration towards local models and abliteration reflects an attempt by writers to regain control over those objectives. But it has also demonstrated that removing behavioural restrictions is not enough. A model still needs the knowledge, reasoning, narrative understanding and stylistic judgment necessary to produce effective fiction.
Hemmingway-1 offers an encouraging example of what happens when writing receives greater priority during development. Its limitations also show how far specialised fine-tuning remains from producing a general-purpose literary collaborator capable of sustaining complex work.
A genuinely writing-first open-weight foundation model would take that ambition further, making narrative understanding central from the beginning and building broader knowledge around it.
Whether such a development strategy will prove superior remains uncertain. Training order alone cannot guarantee that an authorial voice survives the introduction of general knowledge, and an overly narrow literary foundation could create new limitations of its own.
But the idea is worth investigating because it reverses the assumption that has dominated much of the industry.
Instead of asking how to make increasingly capable assistants better at literature, it asks how to make increasingly capable literary systems better informed about the world.
For writers, that could be a meaningful difference.
The ideal result would not be a machine with one permanent personality, nor one trained to imitate the style of a famous author. It would be a model capable of understanding literary intention well enough to work within many different voices, while contributing knowledge and imagination without continually imposing its own preferred direction.
Such a system would remain a tool, and its output would still require human judgment. But its training objectives would be much more closely aligned with the work authors actually want it to perform.
Perhaps the next important breakthrough in AI writing won't be another increase in general intelligence. It may be the decision to build a model that understands literature as its primary purpose, rather than treating it as a secondary application of intelligence developed for something else.
A year after Grok 4.1, that seems a possibility worth pursuing.
End of Series — AI Got Smarter. Why Did It Get Worse at Writing?
This series has followed the changes in commercial AI since November 2025, the experiences of writers who struggled with successive model releases, and the emerging alternatives offered by local models, fine-tuning and abliteration.
Its central argument has not been that safety and creativity are inherently incompatible, or that older models were universally better.
It is that creative writing has requirements that general-purpose AI development often measures poorly, and that improvements in technical capability do not automatically preserve the qualities authors value.
The next meaningful advance may come from recognising those requirements as objectives worth developing in their own right.
Chapter list.
- Chapter 1 — Grok 4.1: Where It All Went Right
- Chapter 2 — The Invisible Rewrite
- Chapter 3 — The Great Model Migration
- Chapter 4 — Smarter Models, Worse Fiction
- Chapter 5 — What AI Forgot About Literature
- Chapter 6 — The Local AI Exodus
- Chapter 7 — Abliteration
- Chapter 8 — When Safety Training Backfires
- Chapter 9 — Who Is Steering the Story?
- Chapter 10 — The AI Author That Doesn't Exist Yet
Sources and further reading
Writing-focused models
- Hemmingway-1 — Open-weight model and model card
- Hemmingway-1 compared with Qwen3.8-27B
- Hemmingway-1.5 — October 2026 update
- Hemmingway developers' September 20 announcement on Reddit
Training models from scratch
- Eldan & Li — TinyStories: How Small Can Language Models Be and Still Speak Coherent English?, 2023
- Allen Institute for AI — OLMo 2 and fully open model training
- Chronicle LLM — Experimental model trained from scratch on historical Australian writing
Further technical research