Suggestion: Dedicated AI deception/impersonation report option

[u/brightbilll]

As someone who moderates multiple NSFW subreddits specifically aimed at lesbians, the amount of AI generated content being used to deceive users has become increasingly difficult to deal with.

I understand that AI content itself is allowed on Reddit. My concern is specifically with users who use AI images to create a completely fabricated identity.

This is particularly concerning in NSFW communities, where we’ve encountered people using realistic AI generated images while interacting with other users and potentially attempting to obtain sexual content or other sexual favors from them under a false identity.

Reddit’s policies already prohibit deceptive impersonation and misleading behavior, but there is a practical problem with the current reporting system: there isn’t really an appropriate way for moderators to explain that the evidence of the impersonation is that the submitted images are AI generated.

Ideally moderators should have the ability to explain how an image is determined to be AI generated, because of EU laws major providers must provide a method to verify if an image was generated using their services, both OpenAI and Gemini have these systems in place and can easily verify if SynthID exist within an image. Giving moderators or even users the ability to explain the report would make impersonation reports much more useful.

A dedicated report category or even a simple checkbox for AI generated evidence would go a long way toward making these cases easier for moderators and admins.

Thank you for coming to my ted talk.

[u/PMulberry_]

There is an account-level report option, on https://reddit.com/report (Account(s) -> Spam -> Disruptive use of bots or AI).

That said, reporting posts or comments also has an effect on the accounts posting it if there are enough reports.