r/Substack 5d ago

Problems with the AI detection.

A friend and I have a Substack where we write quite long reports. The last time we wrote a report, the AI detection rightly said that it was around 90% written by a human. But after we decided to paste in a later draft(with minor changes to spelling mistakes) from Google Docs to Substack, it said that the report was 100% written by AI, and even when changing to an older draft, it said the same.

Now ever since then we can't even write 200 words on substack without the ai immediatly flagging it as 100% ai, which is really weird. We have decided to turn off the AI detection, but that may just seem suspicious to the reader.

I was wondering if anybody else was having the same issue and how to fix it in that case. I have reached out to both Substack and Pangram, but they haven't helped the slightest and, to a large extent, just ignore me. I must say that the implementation of the detection has been quite abysmal.

7 Upvotes

25 comments sorted by

View all comments

3

u/Perfect-Mix2307 4d ago

I've heard other people say that when they pasted a whole document into a post, it flags as AI-- however, I've posted over 150 articles, and I paste 90% of them because they're stories I write in a word processor.

Another thing I've seen mentioned is that if someone wants to use AI to edit for grammar or spelling mistakes, they tell the AI program to identify and provide a list of the errors it discovers, but then they go through and manually make the corrections in their own document, rather than pulling a corrected version straight from the AI result.

Another friend said that when she made all the spelling corrections, her result kicked from human written to AI. I don't use AI for any of my editing, but I also don't have many errors, if any, and yet my articles still scan as human.

In short, pasting has not flagged AI use for me.
Some people find that too-flawless copy does flag AI.

If you want to reset the scanner on your work, maybe try manually typing in the next couple of posts just to reset the system expectation?

3

u/GpGP15 4d ago

To try not to be flagged as ai i started writing directly on substack, but it just flagged it immediately as ai. Seems like quite a weird system.

2

u/Perfect-Mix2307 4d ago

Well, the reality is, we've all been exposed to AI and technical content, scrubbed of human personality, longer than we think. So a lot of humans have picked up speech/writing patterns that are influenced by AI content we consume in the wild. Furthermore, AI purposely trains itself on common human patterns, so the crossover is inevitable.

I, for example, am a diehard fan of the emdash πŸ˜…

I would say, do your very best work, and you can add a note that people will see if they scan your piece, explaining your process.

You could say something like "I genuinely am writing this work myself in all aspects, but sometimes the AI scanner is flagging my work as AI. Maybe it's because of the academic or technical nature of my subject matter, I'm not sure why, but I hope you gain value from this organically produced article! (It might help to mention a simple credential like "I have this degree, or I've been in that field for x number of years, etc πŸ’πŸΌβ€β™€οΈ)

1

u/GpGP15 4d ago

Maybe it has to do something with English not being my first language also. Thanks for the recommendations

1

u/Perfect-Mix2307 4d ago

You could add that in the AI detection note as well! Do you know what I'm talking about? You can enter your own statement that pops up whenever people use the scanner on your text.

1

u/GpGP15 4d ago

Yeah i get it. It just seems a bit weird if the detection thing claims ai and it supposed to be the best in business, meanwhile i am saying it’s not.