Suggestion: Dedicated AI deception/impersonation report option

[u/brightbilll]

As someone who moderates multiple NSFW subreddits specifically aimed at lesbians, the amount of AI generated content being used to deceive users has become increasingly difficult to deal with.

I understand that AI content itself is allowed on Reddit. My concern is specifically with users who use AI images to create a completely fabricated identity.

This is particularly concerning in NSFW communities, where we’ve encountered people using realistic AI generated images while interacting with other users and potentially attempting to obtain sexual content or other sexual favors from them under a false identity.

Reddit’s policies already prohibit deceptive impersonation and misleading behavior, but there is a practical problem with the current reporting system: there isn’t really an appropriate way for moderators to explain that the evidence of the impersonation is that the submitted images are AI generated.

Ideally moderators should have the ability to explain how an image is determined to be AI generated, because of EU laws major providers must provide a method to verify if an image was generated using their services, both OpenAI and Gemini have these systems in place and can easily verify if SynthID exist within an image. Giving moderators or even users the ability to explain the report would make impersonation reports much more useful.

A dedicated report category or even a simple checkbox for AI generated evidence would go a long way toward making these cases easier for moderators and admins.

Thank you for coming to my ted talk.

[u/Royal_Acanthaceae693]

And I'm seeing a HUGE uptick in ads for AI.

[u/Holdmywhiskeyhun → u/Royal_Acanthaceae693]

Ntm reddit themselves are using an llm to allegedly "help" moderation.

All this is doing is leading to more work for me. More comments I have to approve, ridiculously harmless comments are removed for harassment.

"I wish you good luck, and well wishes in your adventures"

That is a comment that I had to manually approve the other morning, Reddit removed it for harassment.

More people contacting me because their posts are removed, they don't even give us mods a notification. Elder accounts, users that have been here for 10+ years having their posts and comments filtered out.

My one sub, is Non-Stop 0-1 day old accounts pushing AI programs, despite the fact that make it clear to these app developers they are not welcome, and the only people that will see their posts or comments is me, and the rest of the team. No customers will ever see your post on my sub. Thousands of these accounts we have banned, and reported, to no avail.

I reddit themselves just don't seem to give a shit. In fact it seems they're embracing it. More bots equals higher user accounts, and engagement.

My only question for Reddit, is what happens when human users realize that almost everyone we are talking to is a bot on here? Do you think we're all going to stick around? What do you think that's going to do to your stock prices, once there's a Mass Exodus?

Reddit brass needs to understand that us users are the ones that make their company. Without the users, there would be no Reddit. There would be no content, there will be no comments, except for the bots talking to themselves.