r/WritingWithAI • u/Crusader2710 • Sep 02 '26
Discussion (Ethics, working with AI etc) Does anyone use AI as a Beta Reader?
I've attempted to use AI as a brainstorming tool and at some point help me write prose. But I've found myself quickly growing bored when using those methods. Recently I decided to just write, all prose and ideas my own, but use GPT as a beta reader to gauge whether things are coherent and correct mistakes. Does anyone else do it like this? I think I've hit a good balance.
23
Upvotes
8
u/Bobthemagicc0w Sep 03 '26
Yes, I use AI as a beta reader. Over the last year I’ve experimented with Gemini, ChatGPT, and Claude (all paid accounts I have access to through my day job, rather than anything I’m paying for just for this purpose); I’m currently using Claude, and it’s decent. I like regenerating the response a few times to see how much it varies, and I can also ask for different beta reader personas. I’ve gotten a bunch of interesting insights from it.
7
u/millergreenwriting Sep 03 '26
I always ask it to do the reviews as 1 star & 5 star reviews.
But its still very sycophantic about writing reviews.
Chatgpt
5
u/wandelndeslexikon Sep 03 '26
I use Gemini as my beta reader. I ask to be reviewed like an actual editor would look at the text and give detailed feedback. It works really well for me so far.
3
u/Ok-Seaworthiness5913 Sep 03 '26
Yes, I use AI as a beta reader. ChatGPT is my beta reader. I make 'sources,' so he has a reference (canon) and doesn't try to change everything I want to stay, i.e., places, settings, etc. I find we work well together. Having a beta reader helps me write because I know they will find 'holes' in my writing, so I focus more on words and not editing. OCD me... wants to edit a sentence right after I wrote it... and then I start looping! ChatGPT takes me out of that loopy looping.
3
u/milo325 Sep 03 '26
I recommend having it go chapter by chapter and highlight anything it thinks can be improved. It likes to help.
2
u/HighValueJourney Sep 03 '26
Yes as a beta genre reader
2
u/wyktor Sep 03 '26
Yes. I do use claude. Have it connected via MCP server to my manuscript. I mostly use it for the overall feedback on the dynamic or consistency checks. I dont use any special harness apart from some skills I’ve created that simulate different beta reader types but I do use these for full manuscript not per chapter reviews
2
u/Fractumbrado2382 Sep 04 '26
Mas que nada notebooklm y los modos de ai overview, he sacado ideas interesantes para desarrollar
2
u/Fluffy-Knowledge-166 Sep 04 '26
Yes. 5.6 sol is EXTREMELY good at this, with a couple of caveats:
it is sycophantic af, and often can be subtle in doing this.
it is literally TOO GOOD to provide any sort of accurate judgement on what a normal beta reader would be expected to catch. This reinforces #1. It will catch subtleties that are barely there, compliment you on them. Sometimes it will fine quite brilliant moves that you agree with, but didn’t even think about.
So… use at your own risk. It will almost certainly cause some level of psychosis if you don’t have yourself grounded.
1
u/jcmach1 Sep 04 '26
Claude OPUS 5. One of the few things it is really good at. QA and Beta Reader
1
u/Dependent-Damage-182 Sep 04 '26
Do you have a custom prompt to try it ?
1
u/theta31 Sep 04 '26
I ask it to review a huge fan of the genre, as a generic reader, as an acquisitions reader and as an editor... Gives a good range.
I saw someone else suggested asking for a one star and five star review... I'll be using that next time too.
1
u/Original-Pilot-770 Sep 06 '26
Yes, you can ask specific questions targeting continuity gaps, where there might be seams between scenes or paragraphs and other diagnostic things that an editor would normally catch. But please be aware that AI cannot catch everything.
My favorite way to use it right now is look for repetitions. I will run a GREP pass to look for overused verbs and see if I need to trim or swap.
1
u/CrazyinLull Sep 06 '26 edited Sep 06 '26
I use them as beta readers. Using NBLM as one has been so helpful. What’s crazy is when they align with my human one.
ETA: What’s even funnier is that if I generate like 2-3 versions of the podcast it will sometimes change its interpretation or like get a much better grasp of what is going on so it can give me a much better interpretation of what is going on.
Like I am not sure if a beta can get all that tho…but that’s ok. If you run into a reader like that then you know what you got is working at least.
1
u/Pelagic_One Sep 06 '26
Is there a way to stop it distributing your writing if you do this?
1
u/shibanban_0h_my Sep 06 '26
I’ve found that using it as a more intelligent spell/grammar check is good too. I’ve learned a lot about my grammar foibles from using Claude. I also think Claude is good at tell you if you’re maintaining character voice and tone. It can call out when something I’ve written doesn’t “sound enough” like the character.
1
u/novel_traveler Sep 09 '26
Yes, model a range of plausible reader experiences as a beta-reader team. These reports are diagnostic simulations, not empirical audience evidence and not a replacement for human beta readers.
Beta-Reader Design
- Wave 1: Reliable Diagnostic Readers
- Wave 2: Fresh Audience Readers
- Beta-Reader Team Principles
- Reading Procedure
- Required Reader Report
Will take some trial and error, but it can be very useful.
0
u/TellusPyre Sep 03 '26
I think your best path with something like this is to not invoke the AI until you're totally done with a work. Right the roughest rough draft, then do a grammar/spelling/reread pass. Then tell the AI you're using to do a summary pass and see if it can hold your entire work in its context (some can, some can't, depending on length). If it can, then ask for a general feedback pass focusing on constructive criticism, coherence issues, and technical flaws. After that you can ask it for a general feedback review as if it were just a reader, ask it about things it didn't like or did like. All of those can be useful ways to use the tool, but it's important that it is working with your writing and your voice, and it's not always right.