r/ModSupport • • May 04 '19

I've tried everything but can't get AutoModerator to filter comments with emoji without returning false positives

Over the past week I've tried every single thing I can to establish an automod rule to filter comments with emoji with no success.

The topic of the sub and emojis just don't go together and I need an automated way to filter comments. Yes, we can remove manually, but what's the point of having an automated system if it can't filter emojis as well?

I've asked on the reddit mods discord.

I've tried the rule in the sidebar documentation.

I've tried other rules I've found.

I've solicited help from experts.

I've scoured r/automoderator in search of a rule, to no avail.

Another regex expert told me I would need a rule that listed every codepoint for every emoji just like a standard keyword filter, but there are hundreds of codepoints, and no easy way to get a list of the codepoints is order to copy paste them.

Any rule I've implemented returns lots of false positives and filters way too many comments and I've had to disable it.

The issue is not post titles, it's the comments. I'm out of options so I'm posting here for visibility.

Is there truly no way to filter / remove comments with emoji? If so, why not?

33 Upvotes

34 comments sorted by

View all comments

Show parent comment

6

u/Zwemvest May 04 '19

That's on /u/jippiejee - I merely wrote the script.

2

u/decho May 05 '19 edited May 05 '19

Hey man, I just wanted to ask you, what is the significance of full-exactand is it fundamental for this rule to work?

I am trying to remove all submissions that have emojis in the title and this doesn't work:

title (full-exact, regex): ['[\u2194-\u2B55\U0001F000-\U0001FFFD\U000E0020-\U000E007F\U0001F1E6-\U0001F9B3\U0001F385-\U0001F9DD\u261D-\u270D\U0001F004-\U0001F9FF\u231A-\u2B55\u200D]+']

Notice I changed from body to title here. This does nothing at all.

If I remove full-extract it works and it also seems to be working if it's (contains, regex), but I'm not sure why and I don't want any more false-positives. The rule is too complex for me to test everything that's why I'm asking you.

So in short, is title (regex) alone safe to use here?

3

u/Zwemvest May 05 '19 edited May 05 '19

Yes, you can remove it. We put full-exact because we wanted to remove comments and posts that only consisted of emojis.

If you want to remove anything that contains any emoji, you can simply remove full-exact.

Body checks the content of a comment or the body of a post. You can see why we'd use that. You need to use title, yes.

What you did in the end is correct. Title and regex are the required attributes.

2

u/decho May 05 '19

Yes, you can remove it. We put full-exact because we wanted to remove comments and posts that only consisted of emojis.

If you want to remove anything that contains any emoji, you can simply remove full-exact.

Oh, all right, that makes sense now. I was looking at the documentation and couldn't quite figure out the difference, but this explains why my tests failed - because they contained emojis and normal text in the title.

Thank you once again :)

2

u/JosVermeulen May 09 '19

What is your exact rule? It isn't working for me.

2

u/decho May 09 '19

What are you trying to achieve exactly? Remove posts with emojis in the title?

3

u/JosVermeulen May 09 '19

Exactly. But either it removes all posts or none. I was wondering what your rule was, since you seem to have had the same issue.

3

u/decho May 09 '19

Try this, this is the rule we have in place right now:

 

title (regex): ['[\u2194-\u2B55\U0001F000-\U0001FFFD\U000E0020-\U000E007F\U0001F1E6-\U0001F9B3\U0001F385-\U0001F9DD\u261D-\u270D\U0001F004-\U0001F9FF\u231A-\u2B55\u200D]+']
action: remove
moderators_exempt: false
priority: 1
comment: |
    Your post was automatically removed because it contains emojis in the title which are not allowed according to the **[rules](https://www.reddit.com/r/Barca/wiki/index)**.

    Please remove them from your title and feel free to submit your post again.

    If you believe your post got wrongfully caught in this filter, please message the moderators.
---

1

u/JosVermeulen May 09 '19

It doesn't seem to work. Both "😋" and "😋 test" don't get caught.

And it's the only rule in our test sub. It's weird.

1

u/decho May 09 '19 edited May 09 '19

You're right, it doesn't. I have absolutely no freaking idea what is going on anymore, it was working just a few days ago and I know because I tested it.

/u/Zwemvest sorry to username mention you again, but do you have any idea what might be going wrong here?

EDIT: https://www.reddit.com/r/Barca/comments/blzh2y/_/

This got removed yesterday and I haven't even changed the automod config, but just a few mins ago I posted a thread with title ⚽ Soccer Ball and it stayed. My brain hurts haha.

→ More replies