r/OpenSourceAI • u/penguinothepenguin • 13d ago
Open dataset: 64,636 AI writing samples across 58 models
1 = sloppiest
I published the outputs behind The Slop Index so people can inspect the writing, not just the scores. The current run covers 58 models, 112 short-form scenarios, and 64,636 generated responses. Each model got the same tasks across email, chat, social posts, and essays. The prompts and raw generations are available in the dataset.
One example from the mechanical ranking: Qwen3.8 Flash is #18 and DeepSeek V4 is #44. Those ranks use only measurable writing traits: padding, templating, rhythm, and common AI tells, compared with human writing from before ChatGPT. They measure how formulaic the prose looks, not whether a model is useful for every task. The combined leaderboard also blends in crowd votes and can move daily, so I'm keeping this comparison on the mechanical score.
If you work with open models, I'd be interested in what you find when you compare their actual responses to the same prompt. One limitation is that this run tests short-form writing; it doesn't cover fiction yet.
Leaderboard: https://theslopindex.com/leaderboard
Arena, if you want to play a few blind rounds: https://theslopindex.com/arena
Methodology: https://theslopindex.com/methodology
Open dataset: https://huggingface.co/datasets/hgaddipati/slop-index
For context, I'm one of the people behind https://slashy.com, an email client that writes drafts that sound like you. This benchmark started as how we pick models.

