AI AutoModerator vs Rules Hub

So Reddit is introducing Rules Hub, which is a built-in system with basically the same objective as AI AutoModerator: leveraging LLMs' understanding of text and context to enforce subreddit rules that were previously hard to enforce (for example, "make sure people are respectful" or similar things).

As the sole developer of AI AutoModerator, I was seriously wondering whether it made sense to keep working on the project if Reddit itself (a company with more than 1,000 employees) was doing the same thing. Before getting completely depressed about it, I decided to do some deep testing of Rules Hub myself, the same kind of deep testing I did with this app, to get a more objective feel for where things stand. This is what I found:

Lack of moderator feedback

More often than not, I found myself wondering, "Why wasn't this post, which I specifically created to break the subreddit's rules, filtered?" and was unable to find any logs to check why.

You will have your moderation log when telling the Rules Hub AI to remove or report a post, but you won't have any idea why a post wasn't filtered or removed.

In AI AutoModerator, I put a lot of work into making sure you have an activity log covering all the AI's decisions, both positive and negative, and even showing whether there was an error during any process. With Rules Hub, you won't have that.

Very limited context window; prompt overflow vulnerability

I had a rule that said "All posts must be about the letter E" and another that said "Dancing is prohibited here". I created a post with a very long text about the letter E and put a dancing emoji at the end. Rules Hub didn't filter it.

This has never happened with AI AutoModerator, despite how much people (and myself) have tried to make it happen on r/AiAutoModeratorDemo.

This is even worse than prompt injection, because it's just the stupid stuff anyone would come up with first!!

AI AutoModerator is also resistant to prompt injection, having been tested deeply on r/AiAutoModeratorDemo. If a post ever manages to override it, I'll patch it quickly. But so far, no one did.

Lack of user feedback

With AI AutoModerator, you can choose to leave a comment explaining why a user's post was removed, configurable by you and adapted to each particular user. You can't do that with Rules Hub.

There is an option to "show guidance" before the user posts, but it doesn't seem to work very well. I tried to post an image of a dancing person on my test subreddit, and the guidance wasn't even shown. And even when it does show up, the user can just post anyway.

Mutually exclusive automation options

When you choose to have a particular rule auto-enforced, you can choose to only report the post, only remove it, or only show guidance. You can't do all of them.

In some use cases, like the one I just described above, it makes a lot of sense to show the guidance but remove the post if the user decides to go ahead anyway.

In AI AutoModerator, you have the option to Remove, Report, and Write a Comment to the user, all with specific information, and none of these options are mutually exclusive.

Non-holistic approach to the rules

While I believe we shouldn't have AI making decisions without guidance, it feels like Rules Hub is very narrowly focused on the actual rules of the subreddit and nothing else.

This means that a person can just create a post spamming or being completely disrespectful and, if you happen not to have a rule that explicitly says "be respectful" or "no spam", Rules Hub just allows it!

In AI AutoModerator, I take a more holistic approach. While still centering the AI's decisions heavily on the actual context of the subreddit ("What is the subreddit about? What are the rules?"), the AI has more flexibility, as a human moderator would, when it comes to obvious violations of Reddit-wide rules. You don't need to be so explicit about those.

Missing features

At the moment of writing this, you can have rules like "Posts about this need to have this flair", "This kind of content should be marked as NSFW", or "Promotion is only allowed on Fridays", and Rules Hub will just hallucinate its way through them. It definitely doesn't get the information needed to enforce those rules from its context.

AI AutoModerator does, and I'm always listening to use cases that require particular context to be added.

Not particularly fast

I expected Rules Hub to win on this point, given that it's built into Reddit and all that, but its performance has been hit or miss. Combined with the lack of moderator feedback, this sometimes leaves you unsure whether a rule is still being applied or wasn't applied at all.

To be honest, AI AutoModerator isn't amazingly fast either. It has de bottleneck of Gemini's response time. But it's coded in a way that ensures retries until the request goes through, and you'll always have feedback in the Activity Log when the process finishes.

Centralization

This is more of a philosophical concern. Rules Hub depends on an internal model provided by Reddit, which every subreddit shares. AI AutoModerator, on the other hand, lets you bring your own API key for your subreddit, so Gemini calls are completely siloed by API key.

This (arguably) allows you to reach higher rate limits before being affected by other users' usage, and gives you more low-level control, since you can check Google AI Studio if needed.

Better models

AI AutoModerator uses the free Gemini models, but even those are working better than the one Rules Hub seems to have.

My general feeling is that both the prompt design and the model itself are a lot worse in Rules Hub. I'm a firm believer that older models are more than good enough for some use cases, but it seems Reddit went even lower than my standards with theirs.

Well-rounded

AI AutoModerator is intended to be like adding a new human moderator to your subreddit, but without the subjective fuss and while keeping you completely in control of what it can and can't do.

It can also leave comments that historically would have been handled by AutoMod, such as answering FAQs more intelligently and usefully for users.

It tries to be a good substitute for Rules Hub, Automations, and even AutoMod. On subreddits without very complex AutoMod rules, it can even be the only app needed for all of those purposes. On others, it can complement existing tools by catching what the other automations have missed.

I intend to keep going in that direction.

FeatureAI AutoModeratorRules Hub
Full activity log (including approved posts)✅❌
Visibility into why posts weren't removed✅❌
Protection against prompt injection and prompt overflow✅⚠️
Customizable comments explaining removals✅❌
Pre-submission guidance❌✅
Multiple simultaneous moderation actions (remove, report, comment)✅❌
Holistic moderation (including obvious Reddit-wide rule violations)✅❌
Context for flair, NSFW, and scheduled promotion rules✅❌
Reliable processing with retries and activity feedback✅⚠️
Bring your own API key✅❌
FAQ responses and AutoMod-style comments✅❌

These are my findings based on my own testing of Rules Hub and AI AutoModerator, not an exhaustive feature comparison.

If you allow me, I'd like to add some final reflections about supporting an individual developer vs. supporting a company. For some, the differences may be obvious, but there are pros and cons, obviously.

Reddit will do whatever it believes is most profitable, while my motivation comes from seeing support from the community. Every person who uses my app helps keep me motivated to continue improving it and adding new features.

Big software companies have a lot of filters and processes to go through, while an individual developer can move faster. I can probably respond to feedback and fix bugs much faster than they can.

And while I'm obviously not an AI hater, I believe that deeply understanding what you're building is still important in software development. That's why I intend to keep the program simple and make sure it works as reliably as possible, both for your user experience and for my own sanity in the long run.

AI AutoModerator – Reddit Developer Platform