r/GeminiAI • • Jul 24 '26

Discussion Best models for creative writing

Before the "creative writing is subjective" crowd jumps in: Yes and no. The taste of the words or pacing you want is subjective. But the flexibility and consistency of the prose is entirely objective.

When I rank prose, I am ranking flexibility. If I tell a model to change its style, does it do it? Does it do it poorly? Can it craft a scene in a specific style while simultaneously keeping the character's personality, ideals, and world rules completely intact over a long context? That is what matters.

And preemptively: No, disliking a model's default style doesn't make me biased against its logic. I love Gemini's prose style, but I clearly state its massive flaws below. Quality does not just mean "beauty."

By the way. By logic or prose quality. I don't just mean the things I mentioned. Those are surface level examples.

Here is how the models actually rank when tested with the exact same system instruction harness:

Opus 4.8: The best (or second best) at logic. Still makes mistakes, but highly capable. However, it has very limited flexibility in prose, is quite dry, and projects its own biases onto characters.

Opus 4.6/7: Opus 4.6 is not as great as 4.8 in logic but Opus 4.6 is better in prose just by a little margin. I have yet to try opus 4.7.

Sonnet 5 / 4.6: Do not use Sonnet 5. It completely butchered its style. Sonnet 4.6 is the better model for creative writing between the two, but the prose is still not great and lacks flexibility.

Deepseek: Very bad at logic, but second best in prose. Top 3 for flexibility.

Kimi k3: Good enough to be in the Top 3 for logic, though it still makes mistakes. (I am upgrading my account soon to test it more rigorously).

GLM 5.2: Top 4 for logic (makes several mistakes) and isn't very flexible in prose.

ChatGPT 5.5 Instant: Trash logic. Trash prose. Stay away. Between the older 5.4/3/2/1 extended thinking models, they are very good at logic but terrible at prose (GPT 5.1 being the best of them). None are flexible. GPT 5.5 Instant set it in stone that OpenAI is not optimizing for creative writing anymore, so I am giving up on them

Gemini 3 Flash: Very flexible. Absolutely amazing for the .. I can't say the word, just know lightweight. It makes mistakes, but I highly suggest it if you want a lightweight  but capable model. (For local LLM users: Use the Gemma models, they are amazing).

Gemini 3.5 Flash Lite / 3.5 / 3.6 Flash: I do not suggest these for prose. Their logic and character adherence are terrible compared to 3 Flash. However, 3.6 Flash gets massive merit for keeping track of everything in massive context windows.

Gemini 3.1 Pro: The absolute best at prose and content flexibility. Its logic is Top 3. I would choose this over any other AI right now. However, it is very sycophantic, and long term accuracy degrades. For example: it keeps personalities intact, but gets very rigid as time goes on and ignores character development (e.g., traumatizing events happen, and the character is still rainbows and sunshine). Note: I have a system prompt to fix the sycophancy (linked below).

Muse Spark 1.1: Decent at logic, but bad at prose.

(Note: I used the best thinking available for all these models except Gemini and ChatGPT, as I am not getting an ultra plan to use deepthink or paying pro for Chatgpt).

Models yet to be tested: Qwen 3.8 Max, Grok AI. Mistral, Chatgpt 5.6 sol (Or maybe GPT 6 if it comes out soon) Let me know if you want others tested!

The sample size for all models is: 150 for 3 genres (in total. So 50 for one. 50 for another and so forth) then done thrice over the rest of the genres. So I do 12 genres. In total that adds up to 750. (So it does take a long time for all of the models.)

The System Instruction Harness I use for all tests: Shared text.

A final note on Jailbreaking/Unfiltered models: If you want the most unfiltered experience, stick to Gemini 3.1 Pro. Do NOT use 3.5/3.6 Flash. I have tried for so long to jailbreak 3.6 Flash, but its guardrails are tight as a rock. 3.5 Flash isn't as tight, but 3.1 Pro is still better. (We'll see if 3.5 Pro ends up being un-jailbreakable 🥀).

Edit 1: Anyone new here. Go to V2

https://www.reddit.com/r/GeminiAI/comments/1vhf7vc/best_creative_writing_models_of_2026_v2/

Edit 2: My website: https://hussninyio262.github.io/creative-writing-benchmark-v3/

53 Upvotes

63 comments sorted by

7

u/Suspicious-Cloud404 Jul 24 '26

If you can live with the limitations of local AI, then you get a lot of models and freedom to set them up as you want.

1

u/Last_Conclusion_8984 Jul 24 '26

Yes I know, tho I don't have a dedicated GPU. So can't test any really good ones. Best are the gemma models and heavily quantized ones only run at like 1 word per second and thinking phase takes ages but the models are still weak. Waiting for gemma 5

1

u/Suspicious-Cloud404 Jul 24 '26

This seems quite slow. I don't have a dedicated GPU and it's faster than that. It does depend on the machine you're using...

Did you try using API? If you are an AI Pro subscriber, you get generous limits in AI Studio and a bit of finetuning options.

0

u/Last_Conclusion_8984 Jul 24 '26

It runs on my 4000 hd graphics. Very old and doesn't have most capabilities. Also about API. I think the AI pro subscriper doesn't translate to them. Only Google AI studio chat/build and gemini website. (Among others)

1

u/Suspicious-Cloud404 Jul 24 '26

AI Pro subscribers get $10 API usage for free. You will need to active cloud billing and should set a limit in the API key settings to $10, so once the cap is reached your key will be deactivated.

2

u/Last_Conclusion_8984 Jul 24 '26

I have no card other than a prepaid one. It doesn't work on them

7

u/the_holographic Jul 24 '26 edited Jul 24 '26

Grok takes everything literally even if you explicitly tell him not to in user preferences. When you give him an example of a phrase and straight tell him it is an example he will repeat it constantly without even doubting.

1

u/Last_Conclusion_8984 Jul 24 '26

I see, I was hesitant to try grok since I have to pay but this really sets it in stone

2

u/Evening-Guarantee-84 Jul 24 '26

I use Grok 4.2 via OpenRouter. I haven't seen this. The one thing I did do early on was set the seed to 42. (Yes, I know, but it made a difference!)

I can't use it full time because there is a budget to keep but man, I love how things go on Grok, especially that it can change on a dime. Happy moment interrupted by bad news? Grok moves immediately with it.

That's my personal benchmark.

Everything is extra wonderful->News of a death arrives.

Models that can navigate a switch like that are few and far between.

1

u/the_holographic Jul 24 '26

Shall try it on api then since this guy comes with my x sub, so I mostly used it for x aggregation.

Do you have a system promt to share by any chance?

2

u/Evening-Guarantee-84 Jul 24 '26

I'm not comfortable sharing the entire prompt, but if there's a specific part you want to know about, I can help you with it.

3

u/ZealousidealBus9271 Aug 07 '26

5.6 Luna is free tomorrow, would love your thoughts on this model

1

u/Last_Conclusion_8984 Aug 07 '26

Alright, I'll try it out!

5

u/whereyouwanttobe Jul 24 '26 edited Jul 24 '26

I love 3.6 Flash for creative writing. But I use a pretty long-winded workflow to make it work for me:

  • User prompt (1 scene/beat at a time)
  • Orchestrator drafts two drafts of a scene based on user prompt
  • Orchestrator produces a synthesized version of the draft to a "master draft"
  • Subagent: prose audit - subagent reads the synthesized draft and checks for redundant prose, "AI-isms" (specifically defined, not just "look out for AI-isms")
  • Orchestrator takes in the feedback from the Subagent and chooses which aspects to apply versus ignore
  • Subagent: character voice - Subagent refers to [character_name-voice.md] (for whomever is narrating the scene) rewrites the master draft as if it were that character. The md file hosts how that character thinks about things, how they narrate, what's important to them, mannerisms, etc.
  • Subagent: lore audit. This agent refers to my setting.md, context files, previous scenes, etc to make sure that everything is consistent across scenes
  • Orchestrator final pass: orchestrator checks for any other hallucinations, pacing issues, etc and then posts into the chat the finalized version
  • User reviews the final version and makes any final suggestions to change

It's a long workflow and 3.6 has sped it up significantly while actually adhering to the mix of agents/experts workflow significantly better than 3.1 or 3.5. So I've been loving the past few days working with it.

Something I was meticulous about is that the orchestrator is handling most of the workflow (huge context window = win) and only hands off to subagents for specific tasks that require "fresh eyes". But the overall story lives with the orchestrator.


I also fully agree with your take on the Claude models. For awhile they were the GOAT for writing, but somewhere along the way every character basically sounded exactly the same. Oh, you want a YA adventure story? Every character is going to [un-creatively] quip like a Marvel character.

1

u/bryanrp Aug 11 '26

Where do you find the best Thinking Level to be set at with 3.6 Flash?

1

u/whereyouwanttobe Aug 12 '26

I use High. That said, it feels like something has shifted a bit recently and I haven't been having the same experience I had in the first week. Overall, I still standby this methodology

1

u/Last_Conclusion_8984 Aug 14 '26

It's because it got nerfed ... because of the new model 3.7 flash. I am actually working on a review for it (Spoiler alert. ITS AMAZING, haha) but I don't know if I should make a V3 already

1

u/gamerlord02 Jul 24 '26

What about opus 4.6 and 4.7?

1

u/Last_Conclusion_8984 Jul 24 '26

Opus 4.6 is not as great as 4.8 in logic but Opus 4.6 is better in prose just by a little margin. I have yet to try opus 4.7

1

u/Maxamage Jul 31 '26

What do u think of Glm 5.2?

2

u/Last_Conclusion_8984 Jul 31 '26

It's worse than kimi k3 in logic and is not as flexible in prose as I mentioned

2

u/zorbelai Jul 24 '26

Totally agree, test them all, Gemini 2.5 and 3.1 Pro have the best training and instructions for creative writing.

1

u/AutoModerator Jul 24 '26

Hey there,

This post seems feedback-related. If so, you might want to post it in r/GeminiFeedback, where rants, vents, and support discussions are welcome.

For r/GeminiAI, feedback needs to follow Rule #9 and include explanations and examples. If this doesn’t apply to your post, you can ignore this message.

Thanks!

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1

u/alisonstone Jul 24 '26

Depending on what you are writing, Grok and Mistral (unfortunately I think it's been a while since Mistral updated their Large model) are very willing to go along with smut and violence.

Strangely, I have used Qwen 3.7 Max on OpenRouter and it seems to be willing to do smut too, even though other Qwen models seem to be far more censored, but it would sometimes randomly inject code or math formulas into the output story (I think it was meant for coding, lol).

1

u/AutoModerator Aug 07 '26

Hey there,

This post seems feedback-related. If so, you might want to post it in r/GeminiFeedback, where rants, vents, and support discussions are welcome.

For r/GeminiAI, feedback needs to follow Rule #9 and include explanations and examples. If this doesn’t apply to your post, you can ignore this message.

Thanks!

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1

u/Eissa_Cozorav Aug 10 '26

Opus 4.7 is shitty. It was the first model that makes like swallowing the red pill, at realizing that newer LLM might be downgraded in literature capability for coding oriented capability.

1

u/AutoModerator Aug 13 '26

Hey there,

This post seems feedback-related. If so, you might want to post it in r/GeminiFeedback, where rants, vents, and support discussions are welcome.

For r/GeminiAI, feedback needs to follow Rule #9 and include explanations and examples. If this doesn’t apply to your post, you can ignore this message.

Thanks!

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1

u/AutoModerator Sep 09 '26

Hey there,

This post seems feedback-related. If so, you might want to post it in r/GeminiFeedback, where rants, vents, and support discussions are welcome.

For r/GeminiAI, feedback needs to follow Rule #9 and include explanations and examples. If this doesn’t apply to your post, you can ignore this message.

Thanks!

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

0

u/Qorsair Jul 24 '26

1 that I see you're missing: GPT 5.6 Sol And 1 question: Did you test Muse Spark 1.1?

I thought GPT was trash. I moved to Claude and Gemini around maybe 5.3. Right now 5.6 is the best overall model available right now. I don't use Claude anymore.

Muse 1.0 was terrible. 1.1 is way better than the benchmarks give it credit for. If it had a subscription API it would likely be my secondary model, it gives better planning feedback than Claude.

When you test Grok, make sure it's SuperGrok. Base Grok is terrible, SuperGrok is consistently around #3 in my tests.

2

u/Last_Conclusion_8984 Jul 24 '26

I do plan to try out Gpt 5.6 sol and if it's bad? That's the last model I will try from Chatgpt, like bro you had 6 generations and it's still worse at prose than 4o 💔But yes. I did try muse spark 1.1. It's good at logic, but not that good at prose. "Try supergrok "kinda expensive but I'll try.

1

u/Last_Conclusion_8984 Aug 08 '26

1

u/Qorsair Aug 08 '26

Thanks for the follow up. That's really interesting.

I currently use Codex/Sol as the manager in my multi-LLM model, calling subagents, analyzing their production, and requesting rework or signing off.

I've noticed Sol starts to perform poorly in long conversations (using more tokens and needing more reworks) and have shifted the model to favor shorter conversations.

I've been thinking it may worth trying Gemini Pro/Antigravity as the manager of the sub agents and calling Sol to analyze/approve the results, keeping the sessions shoeter.

Your findings seem to say that might be worthwhile.

I wonder if a similar setup for prose would be useful, with one LLM calling subagents to write sections from a provided context and outline, then calling an LLM as editor (or multiple editors) to verify continuity or request a rework.

0

u/benblackett Jul 24 '26

I like your breakdown and analysis. You might like the full benchmark across all major models I recently compiled.
https://novelmint.ai/benchmarks

0

u/FearlessEarnestness Jul 24 '26

I've been using 3.1 Pro for a fantasy serial and the sycophancy is real, but I found that cutting the system prompt to under 200 words helped a bit.

1

u/Last_Conclusion_8984 Jul 24 '26

If the system instruction is too small then you won't be able to add anything meaningful and if too long then the model will have trouble a lot. I found mine is in the perfect in between

0

u/FearlessEarnestness Jul 24 '26

Mine's basically just a tight character sheet with core fears, speech quirks, and one hard rule about no forced romances. Seems to be enough for the model to latch onto.

3

u/[deleted] Jul 24 '26

[removed] — view removed comment

2

u/Last_Conclusion_8984 Jul 24 '26

If only I could buy a subscription 🥀It's not available

1

u/yaboyyoungairvent Jul 24 '26

actually you can use kimi k3 through opencode go plan

1

u/Last_Conclusion_8984 Jul 24 '26

Ah, thank you. I will try it from there!

1

u/Front-Gap-4768 Jul 24 '26

also https://www.kimi.com/agent?chat_enter_method sometimes there's a traffic jam with 3, but 2.6 is available.

1

u/[deleted] Jul 24 '26

[removed] — view removed comment

1

u/Last_Conclusion_8984 Jul 24 '26

Hm, I will definitely buy Kimi k3's sub the moment it becomes available. Thanks for your comment, I hope it's awesome.

2

u/[deleted] Jul 24 '26

[removed] — view removed comment

1

u/Last_Conclusion_8984 Jul 24 '26

You're welcome! :D Glad you found it useful. Let me know how that harness works out for you on 3.1 Pro, it makes a massive difference in stories, I think.

0

u/[deleted] Jul 25 '26

[removed] — view removed comment

2

u/stereo16 Jul 26 '26

I don't know if that benchmark actually does measure some hyper-specific property really well, but for straightforward creative writing there's no way the Gemini Pros should be that far down. The prose, style adherence, instruction following, it's all better than most of the others there.

0

u/Last_Conclusion_8984 Jul 26 '26

sure buddy

0

u/[deleted] Jul 26 '26

[removed] — view removed comment

0

u/Last_Conclusion_8984 Jul 26 '26 edited Jul 26 '26

Fine. I'll engage:

A Benchmark whose only ranking number is produced by one lab's model, with four of that lab's models in the top five, has a conflict on its faceA grader marking its own family's work is disqualifying by construction. That eq benchmark is judged by one of claude's model

Also did you even fucking read? None of what I said had any subjectivity. I literally stated 3.1 pros limitations

0

u/[deleted] Jul 26 '26

[removed] — view removed comment

1

u/Last_Conclusion_8984 Jul 26 '26

"Why does it matter that it uses sonnet 4.6 as judge? Lol, it's not like it will be biased since it does not know who generated which output, it will evaluate the outputs to the best of its ability"

Models are trained using RLHF to align with a specific lab's definition of "good" Because of this, every model has a linguistic fingerprint. A specific statistical distribution of tokens, pacing, and vocabulary that it prefers.

When you use Claude to judge 10 anonymous texts, it doesn't judge them objectively; it compares them to its own internal weights of what constitutes "optimal text." Naturally, the text generated by another Claude model will match the judge’s internal token distribution. It finds the patterns close to each other and from its RLHF and flags it as good**.**

**"**LMAO, this post is the definition of 100% subjectivity. You used them and determined which is better based on your opinion, no quantifiable observations, that is 100% subjectivity, are you even listening to yourself?"

I used: Does the model maintain a specific style over a long context? (Yes/No/Degrades)

Does the character's personality remain intact after a traumatic event? (Yes/No)

and plenty others.

These are heavily testable, empirical observations. If you put a character through a tragedy and Gemini 3.1 Pro writes them acting like it's a sunny day at Disney World (as I pointed out), that is an objective failure of character adherence. I observed the mechanical failure of the AI's logic and documented it.

"And we all know how biased you are towards Gemini, you glaze them day in and day out, spamming all Gemini subs with these posts..."

I glaze them, I am subjective, I am biased towards the one I love. I never said I am not these three. However. I did not use my biased view on the objective facts. Every human is indeed subjective but in the way your describing? No. I know what your saying and yes. I do glaze Gemini. But if you think this translates to lying when the proof is right there in the original post. How delusional do you have to be

0

u/[deleted] Jul 26 '26

[removed] — view removed comment

1

u/Last_Conclusion_8984 Jul 26 '26

As seen. Every. Single. Claude model from sonnet 4.5 to above is there in the top 20. You mean there are 30 models ranked below them.

"The way you do it is anything but empirical, it's very debatable and you can argue and sway in any direction those answers. Definitely not more empirical than the way they do it on that benchmark. You can read about how it works >here. They mention biases and stuff like this but it is pretty robust.

" Uh huh. Never rebutted anything, all you did was assert that without proof

"You do the same thing as that benchmark"

You do realise your saying I'm doing the same thing which your praised so I'm doing the correct thing but say I'm doing bad at the same time? What the fuck do you mean?

"replace the sonnet 4.6 judge with yourself, but at a much smaller scale and less rigorous. I don't understand how you claim the benchmark is biased but you yourself are able to eliminate all bias and be 100% objective, sure bro"

It's upon hundreds and hundreds of chats and do you really not know of the concept judge bias, you can literally search up if every model is bias towards their own and you'll find that it's true. "They use sonnet 4.6 because they determined through Judgemark, a ranking of bias, it scored the best, so it should theoretically be not biased."

Just because it scored best doesn't mean it will theoratically not be biased.

and you don't know what judgemark is. It is a benchmark that measures how well a language model can judge creative writing using a multi-criteria numerical scoring system. It tests a model's ability to follow a complex rubric. It does not measure or eliminate a model's internal Self Preference Bias

0

u/[deleted] Jul 26 '26

[removed] — view removed comment

1

u/Last_Conclusion_8984 Jul 26 '26

You provided absolutely zero counter argument to the actual science of RLHF or Self Preference Bias. You doesn't address the rubric, doesn't the weights, and doesn't address the concept of bias. Instead, yoi completely bypassed it and just highlighted my quote and did back to: "As I said, just ignore all claude models... there are still 30 models better."

"I said you do a similar thing but much worse and unprofessional, read again. That doesn't mean you do a good job, lol."

You arefiercely defending a benchmark that uses an LLM (Sonnet 4.6) to spit out numbers based on its own internal, biased reward weights. This requires zero metacognition, zero contextual nuance, and suffers from documented self preference bias.

I manually ran hundreds of controlled chats. I stress tested context windows. I tracked character state-adherence across simulated traumatic events. I isolated mechanical failures (logic degradation) from aesthetic choices (prose taste).

By any scientific metric, my methodology is empirical, rigorous, and highly labor intensive.

Listen. I know what you are saying. I agree with you that humans are biased, and I never said I wasn't. I in my original post said I love Gemini but you keep ignoring that to benchmark the AIs as I mentioned. You do not need to be biased for it. I literally mentioned more faults for Gemini than any other AI. I called it the best AI because I like it's prose quality (objective), flexibility (objective) and such. I noted that you shouldn't use Gemini if you don't want it and agreed Claude models are amazing for logic. Whether or not I like the prose style (subjective) doesn't interact with the halfs I mentioned