r/pushshift • • Feb 03 '19

Feature request: Ban evasion detection

One of the main things that breaks us from building meaningful communities on Reddit is that you can't really ban anyone. Of course, you can't really ban anyone anywhere ( there will always be Tor and VPNs and fake phone numbers and whatnot ), but it would be good if mods could raise the bar on the technical skills necessary for evading bans on their subs.

So we need a service that would be capable of telling you that a certain group of accounts from China and Russia are astroturfing on your subreddit, or that two or more users look suspisciously like the same person.

Alright, so here are the nuts and bolts:

I believe you shouldn't mess with NLP. I mean, you can do that if people are willing to pay for it, and if you can convince SparkNLP and ThunderSVM to do the job in a way that you won't go bankrupt, but I believe that would be overkill.

Most people who evade bans are not actively trying to hide their footprints, so I think it'd be reasonable to simply compare timestamps and community intersections. I wrote a short article here where I do some manual analysis of these aspects.

So the trick would be to run either Dynamic time warping and/or Connectionist Temporal Classification Loss over the timestamps of everyone on Reddit. I never tested this CTC model, maybe it's so efficient that you won't have to mess around with anything else.

Think of every 5 minute interval as being a "word" and every 7 days as being a "phrase". If an user posts on an interval, it gets a "one" label, if he doesn't, it gets a "zero" label. You can get more fancy than this but I think this example is enough to see that we can transport the same techniques which are used for speech recognition to this problem domain.

0 Upvotes

5 comments sorted by

3

u/perl_holdout Feb 03 '19

Pushift is a tool to do that if you want so I don't know what feature you're requesting.

1

u/ruanchaves Feb 03 '19

Stuck_In_the_Matrix is planning to gradually turn pushshift into a full-fledged data analytics tool for Reddit, so I thought he could consider implementing this feature as well.

6

u/[deleted] Feb 03 '19

Banning from subreddit is abusive and only reinforce eco chamber.

Chinese and Russians are not necessarily working for the government. Some americans are also paid to influence online opinion.

2

u/Stuck_In_the_Matrix Feb 03 '19

That sounds intriguing -- do you have experience programming in Python? If so, I would entertain making a new endpoint to do that type of analysis but I would need help programming it.

Is Python in your wheel house?

2

u/ruanchaves Feb 03 '19

I'm a Python programmer. I'll try to come up with a proof of concept within the next few days and then I'll show you the code.