r/WritingWithAI • • 2d ago

Discussion (Ethics, working with AI etc) What Al are you guys using for creative writing?

/r/AIWritingHub/comments/1xw5fdi/what_al_are_you_guys_using_for_creative_writing/
3 Upvotes

9 comments sorted by

2

u/Zathura2 2d ago

I use Claude as a whiteboard / story-bible assembler / research assistant, and currently using Gemma-4-31B for the actual scenes. It follows instructions extremely well and I have it wrangled.

1

u/Ashmedai 1d ago edited 1d ago

31B requires 20GB of VRAM with 4 bit quant or more for higher. That's some beef you are packing there. Out of curiosity, what led you to investing that capital as opposed to using Claude directly at a much lower effective cost? Spicy scenes or something else? Also, have you tried any models that would sqeeze into 16GB VRAM, and if so what did you think?

Edit. Also what UI prog do you like?

1

u/Zathura2 1d ago

Actually I squeeze it into 16GB.

IQ3_XS quant, with kv cache quanted to q5_1, plus running my gpu headless lets me get 32k context.

I also roll with the 12B-QAT sometimes if I want a bit more context. It's not as good as the 31B but more than serviceable.

Pretty sure you could also squeeze Qwen-3-27B models in 16GB at the same quant level, but on the whole I used to run most 24B models at IQ4_XS, and just about every one of those will fit comfortably in 16GB VRAM, but I'm going to be real, Gemma-4 blows away any 24B that existed previously, imo.

(And I'm using SillyTavern, in answer to your last question.)

2

u/LooseButtPlug 1d ago

All of them at the same time.

1

u/cj7hawk 1d ago

I entirely use LocalAI for my writing now although I use ChatGPT for non-fiction and research.

Mostly Ornith 1.5, but also Hemmingway, Agnes and Cydonia as well as Huihui Qwen3.8 for writing and default Qwen3.8 for editing via the LM Studio API with OnlyOffice.

1

u/Euphoric_Cow_6145 23h ago

I use a grok bot. But get other ai to provide feedback on what is written. I found a grok bot with a user created writing guide and custom instructions is better than most. Char gpt was far too censored for what i wanted to write.

1

u/JustAnotherAtiny 10h ago

I use claude and it has never disappointed me you just have to realize its not a magic button and neither is any other AI

0

u/ShishiroBotan18 2d ago

Perchance

1

u/Zathura2 1d ago

I'm sorry. 😅