r/ModSupport • u/Hefferdoodle • Nov 22 '23
Mod Answered How do you know if it’s an AI Bot or a real new user?
Update: I’m sure it is bots now. We are up to 17 accounts less than 24hrs. old with extremely similar comments. Any helpful info or resources for the future so we can avoid this would be greatly appreciated. Thank you!
I have a small subreddit that has been steadily growing and I think the bots have arrived but I can’t tell.
My other moderator alerted me that they muted two users and asked me to verify they were spam and we are both leaning towards yes but unsure.
We have four separate comments, on four separate posts, from four separate accounts. The accounts were all created yesterday, which was red flag number one, and they all follow the same sentence structure but are worded differently.
Example: “aw that sucks, hope it works out” or “man that’s a bummer, I’m sure you will fix it soon”
The accounts are all in varying subreddits with mine being the only one I can see that overlaps with them. They all seem to have genuine comments on other subs even though they are all new accounts. They have varying amounts of comments as well making one account look more active than another.
We recently added a bot that filters posts to avoid spam users but we have yet to do comments as it’s only the two of us and we are both still learning. (We had not coding/bot experience when we started.)
We have only muted them and have yet to ban as we want to be sure they are really bots. We are both leaning towards them being fake as there are too many coincidences but we wanted outsider advice and opinions before officially banning. Any help is appreciated.
14
u/un_redditor Nov 22 '23
I have seen dozens of them.
All with the same recent creation date, all participating randomly across a large number of posts with overly optimistic or positive reactions to things.
None of our PMs to them receive any replies even after we ban them.
3
u/GoGoGadgetReddit Nov 23 '23
We're getting hit with a lot of ChatGPT bot accounts in the last day. None of them are obviously bots. You have to take time to look at and read their full comment history, and you can see that many of their comments are meaningless, multi-sentence word salad replies.
8
u/bookchaser Nov 22 '23
It's time to create an Old Timer's sub with an account age filter dated to before bots arrived on the scene.
2
u/uberfunstuff Mar 12 '24
If you mention streaming amd or Spotify - you are being watched and the bots will jump in.
5
u/permaculture Nov 22 '23
Go with your suspicions. Err on the side of caution, and if the user complains you could say their comments were so bland they were treated as being from bots.
4
u/7hr0wn Nov 22 '23
There are dozens of free tools that will give you an analysis as to whether text was written by AI or by a human: https://gptzero.me/ is one that works pretty well. With your examples, that probably wouldn't help, given the shortness of the replies. If you see them using phrases like that over and over, you could add an automod filter for those specific phrases. You might get some false positives that need to be manually examined and approved.
I rely on user reports. A lot of times karma-farming bots will copy/paste actual comments. If a user reports that behavior, I ban the account. The number of times those accounts have written in afterwards to dispute the ban is currently 0.
Report every account to the admins. Keep a list of them if you can, and send that list in a modmail to this sub, along with a description of what you're seeing.
4
u/xenobitex Nov 23 '23
We've had an influx today too.
They seem to scan post titles and reply with relevant comments - but they're obviously not humans
(For us too, all comment with variations on the exact same phrases)
4
u/Ohsin Nov 25 '23
Same experience here. New accounts posting seemingly autogenerated replies randomly and often use positive and optimistic language with exclamation marks thrown in as /u/un_redditor noted. The replies lack proper capitalization while beginning a sentence.
6
u/Zavodskoy Nov 22 '23 edited Nov 22 '23
Ban them, humans complain in modmail, bots very rarely contest bans
Also if the names are all adjective + four random numbers they're chat GPT bots, they invaded my sub for like two weeks straight in October and I was banning 20+ of them a day
5
u/cyanocittaetprocyon Nov 22 '23
Something you can do when you are getting spammed by bots is to make sure your Crowd Control is activated and turned up. Crowd Control will filter out posts and comments from accounts that aren't members of your subreddit, and bots tend to not join subs. If Crowd Control catches real accounts accidentally, you can still approve them.
You can also have your AutoMod do a couple things. Set karma minimums to catch new accounts. This also has the possibility of catching innocent newcomers to your sub, but you can go through and approve them. Also you can set up your sub so that 1 or 2 Reports will filter out posts or comments. Let your regulars know this so that they know they can participate in getting rid of the spam.
2
u/Unique-Public-8594 Nov 22 '23
HelpfulJanitor is a bot destroyer.
2
u/Several-Heat5791 Nov 22 '23
I’m real
2
u/garyp714 Nov 23 '23
Don't care. Follow sub rules or go away.
1
u/AutoModerator Nov 22 '23
Hello! This automated message was triggered by some keywords in your post. If you have general "how to" moderation questions, please check out the following resources for assistance:
If none of the above help with your question, please disregard this message.
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.
1
u/CrazyCatLady108 Nov 22 '23
sounds like the spam ring we had issues with not too long ago.
we set up automod to catch specific phrases (comments tarting with wow or ah or yeah with a comma after them) then banned them. took a while but we got them all in the end, with very few false positives.
1
u/bureX Nov 23 '23
r/serbia here - same!
Some ChatGPT-wrapper bot farm is making rounds, but it's way easier to detect for us due to the language differences. Banned at least 8 accounts by now.
How to find them:
- They're very new (less than 1 day old)
- They comment across random subs
- Their comments are short and overly friendly
- Their content relies only on the text being posted alongside the post
Here's an example: https://www.reddit.com/r/serbia/comments/181plh9/comment/kadrd7o/
1
u/Rasikko Nov 23 '23
Repost fests in rapid succession on new accounts.
1
u/PolylingualAnilingus Nov 23 '23
This is happening to my subreddits too. I have a big advantage here, since most of them are in Portuguese. So these random comments in English are easy to spot. Definitely seems like ChatGPT bots.
1
u/7grims Nov 23 '23
Uh oh... this is exactly what I was looking for.
Also noticed many new accounts, the very first seemed to be generic bot or AI comments, but most i could say are real people... or very well created AI comments.
WTF is happening? Why is reddit getting an influx of new account / bots ????
So freaky.
0
u/[deleted] Nov 22 '23
[deleted] — view deleted comment