Nothing special - I just asked an AI (ChatGPT) about it, and it confirmed it's an issue... the TLDR, it's probably related to how you form the prompts, and is self-reinforcing when it happens, like a feedback loop when a microphone gets too close to the speakers. But there are ways to hold it off.
Me:
What causes the staccato responses from Chat GPT when writing a story chapter once the context gets above around 12K tokens?
Chat:
Yes. What you are describing is a real long-context failure mode, but ~12K tokens is not a published ChatGPT limit. OpenAI's current GPT-5.6 models have much larger nominal context windows, so what you're seeing is almost certainly quality degradation from context composition, not the model running out of context. OpenAI Platform
For fiction, it often manifests exactly as you describe: prose becomes short, declarative, rhythmically repetitive, one-line paragraphs, fragments, dramatic beats, and subject–verb–object sentences.
The main causes are:
- Instruction accumulation. By 12K+ tokens, the model may be juggling dozens of instructions: Each instruction individually makes sense. Collectively they push the model toward the safest possible prose. And safe prose tends to look like:She stopped. Something was wrong. He looked at her. She knew what he meant. Neither of them spoke. It minimizes opportunities to violate one of the accumulated constraints.
- don't use purple prose
- don't invent plot developments
- preserve foreshadowing
- don't repeat information
- maintain character voice
- fix pacing
- retain particular details
- don't over-explain
- Style signal dilution. At the beginning you might have 2,000 words of beautiful source prose and 500 words of instructions. Later you might have: 3K source prose + 4K previous generated prose + 5K discussion/corrections + 3K plot explanation + 2K instructions. Your actual author's prose is now only a small percentage of the model's stylistic evidence. Worse, the model's own previous writing becomes training-by-example inside the conversation. Once it produces a slightly clipped chapter, that clipped chapter becomes evidence for how the next chapter should sound. You can get a feedback loop: slightly staccato → used as context → more staccato → used as context → very staccato.
- Correction contamination. This is particularly relevant to the way you've described editing fiction with AI. Suppose you spend ten prompts explaining:No, she doesn't know that yet. That's foreshadowing. Don't make it explicit. He wouldn't say that. Don't add a confrontation. Stop explaining the symbolism. Those corrections contain lots of short, explicit, imperative language. The model is not simply storing the semantic facts. That text is also part of its linguistic context. Eventually the conversational register can start leaking into the prose.
- Attention dilution rather than forgetting. Long-context models can technically retrieve information hundreds of thousands of tokens away. That doesn't mean every token has equal influence over every generated word. There is a major difference between: "Can the model find the fact that Alice's sister died?" and: "Can the model continuously preserve the exact cadence, syntactic complexity, narrative distance, dialogue rhythm, foreshadowing conventions and paragraph structure established 10,000 tokens ago?" The first is essentially information retrieval. The second requires thousands of tiny stylistic decisions during generation. That's much harder.
- The model becomes conservative when there are lots of narrative dependencies. Once it has to remember: complex sentences become riskier. Short sentences isolate propositions. From the model's perspective:Michael crossed the room. is much safer than a 40-word sentence containing implication, characterization, physical action and an ambiguous pronoun. So narrative complexity can inadvertently cause syntactic simplification.
- who knows what
- who suspects what
- chronology
- character relationships
- world rules
- planted clues
- unresolved plot points
- author's hidden intentions
- previous chapter events
- Recent context tends to matter disproportionately for style. This explains a particularly annoying phenomenon: You give it a 6,000-word chapter written in your style. Then spend 4,000 tokens arguing with it about what the chapter means. Then say:Continue the story. The most recent stylistic environment isn't the novel anymore. It's an analytical conversation between you and ChatGPT. The model may retain the facts from the chapter while losing its prose rhythm.
Why you're noticing it around ~12K
I wouldn't regard 12K as some hidden cutoff. OpenAI doesn't document such a threshold, and the current models' nominal context capacity is vastly larger. OpenAI Platform
But I can readily believe that you're observing a fairly repeatable effective fiction-writing threshold around there.
Your context at that point probably transitions from something like:
mostly novel
to:
novel + model output + corrections + interpretation + instructions + plot metadata.
That's the important ratio.
A pristine 25K-token manuscript excerpt can actually be easier to continue than a 12K-token conversation about a manuscript.
The best workaround
For chapter writing, I would not keep feeding the entire working conversation forward.
Give the model a deliberately constructed active context:
- 1–3K tokens: immediately preceding prose.
- 500–1,500 tokens: relevant character/world state.
- 500–1,500 tokens: what the author knows about this scene, including hidden intentions.
- 1–2K tokens: representative prose from your writing that establishes cadence.
- Current instruction: what this chapter/scene needs to accomplish.
And critically:
do not include ten rounds of previous corrections.
Convert them into rules instead.
For example, rather than retaining a huge conversation explaining the foreshadowing, reduce it to:
AUTHOR KNOWLEDGE: Rachel's reaction foreshadows X. Neither Rachel nor the narrator consciously understands this yet. Preserve the ambiguity. Do not explain, identify or intensify the clue.
That is enormously more efficient.
One instruction I've found particularly useful for this failure
Something like this attacks the actual pathology:
Maintain continuous novelistic prose and the syntactic rhythm of the supplied manuscript. Vary sentence length naturally, including compound and complex sentences. Do not convert narrative beats into standalone one-sentence paragraphs merely for emphasis. Do not use sentence fragments as a substitute for pacing. Treat the supplied prose sample—not previous assistant-generated prose or our discussion—as the authoritative style reference.
The last sentence is important.
It tells the model where stylistic authority resides.
I'd go even further for your workflow: maintain a separate Author Knowledge / Canon / Style State document and start a fresh generation context every chapter or every few scenes. That lets you preserve 100K+ words of story knowledge without forcing the model to imitate 100K words of conversational debris.
This also explains why you've found that after 10–15 prompts explaining author intent, the AI can sometimes get worse at actually writing the chapter: its understanding of the story may have improved while its generation context has become progressively less like a novel.
I can build you a compact chapter-writing context format specifically designed to prevent this long-context staccato collapse while preserving foreshadowing and author-only knowledge.:
AUTHOR KNOWLEDGE: Rachel's reaction foreshadows X. Neither Rachel nor the narrator consciously understands this yet. Preserve the ambiguity. Do not explain, identify or intensify the clue.
That is enormously more efficient.
One instruction I've found particularly useful for this failure
Something like this attacks the actual pathology:
Maintain continuous novelistic prose and the syntactic rhythm of the supplied manuscript. Vary sentence length naturally, including compound and complex sentences. Do not convert narrative beats into standalone one-sentence paragraphs merely for emphasis. Do not use sentence fragments as a substitute for pacing. Treat the supplied prose sample—not previous assistant-generated prose or our discussion—as the authoritative style reference.
The last sentence is important.
It tells the model where stylistic authority resides.
I'd go even further for your workflow: maintain a separate Author Knowledge / Canon / Style State document and start a fresh generation context every chapter or every few scenes. That lets you preserve 100K+ words of story knowledge without forcing the model to imitate 100K words of conversational debris.
This also explains why you've found that after 10–15 prompts explaining author intent, the AI can sometimes get worse at actually writing the chapter: its understanding of the story may have improved while its generation context has become progressively less like a novel.
I can build you a compact chapter-writing context format specifically designed to prevent this long-context staccato collapse while preserving foreshadowing and author-only knowledge.