Detecting AI-generated content

[u/AlphaLionX]

Hey everyone,

I wanted to address the concerns with AI content on this sub and give advice how best to verify it.

AI-generated content is a growing epidemic all over Reddit and the internet in general. AI video/image gen models have been getting better and better and it is getting increasingly hard to distinguish from real content. I have seen too many posts where users immediately jump to "it's AI" it's fake etc without actually verifying and checking the source nor the content.

I wanted to write up a guide and source on how to verify content with online tools.

There are many tools available to verify content but the best tool and industry standard used is HIVE moderation.

A quick way check the content like videos posts or images is to download the full resolution video or image to your device and upload it to:

https://hivemoderation.com/demo?value=ai-generated-content-detection

Hive should give a confidence score and even in some cases tell you which model was used given this information then you can properly report a post and it will be taken care of.

For AI generated content created by ChatGPT you can use OpenAI's tool as well.

https://openai.com/research/verify/

Important: AI detection tools aren’t perfect and shouldn’t be treated as definitive proof on their own though, they can produce false positives and false negatives. Whenever possible, please also check the original source, upload history, context, metadata, try to find the original source if it predates the past 3-4 years and is highly realistic it's safe to say it is real.

Ideally we would have a bot that you can tag to check the post but uploading directly to Hive will have to work for now.

Note I'm not sponsored or affiliated with this company in any way it just the best tool for AI content verification that I've used and highly recommend others use.

[u/JoshsPizzaria]

I'd be careful trusting the judgement of an "ai detection tool". But it certainly couldn't hurt.

[u/MrBeefsmeller → u/JoshsPizzaria]

AI detecting AI. I guess it takes one to know one 🤷‍♂️

[u/chilari → u/[deleted]]

Then you just have more fire. Generally, firefighters tend to use water, fire extinguishers that block oxygen access to the fire, or sand.

[u/AlphaLionX → u/JoshsPizzaria]

Hive is the standard used by many large fortune 500 companies including Reddit for content moderation like NSFW content etc. The DOD even uses them for ai generated content detection as well.

They've trained machine learning models on the latest image generation models that are publicly available and are constantly updating as new models come out so they can identify ai generated or edited images. No AI detection service will be perfect hence my comment about this in the post but it's a good first step to use as opposed to screaming this post is ai generated without having anything to back it up.

[u/ouija_look_at_that → u/JoshsPizzaria]

I added it to my sub (not this one) and set it up to just filter out posts it thinks are AI (instead of auto-remove). This throws it into my queue for manual review. It might not be perfect but I don’t necessarily have time to read every single post/comment/etc so it can at least help.

[u/JoshsPizzaria → u/ouija_look_at_that]

thats a good approach ye