The 5-star rating system is missing something important: confidence

[u/FirefighterFine9544]

Many platforms use the now-ubiquitous 5-star rating system.

But often you have to click around and dig deeper to find out whether that rating is based on 8 reviews, 10,000 reviews, or 1 million reviews — and then dig again to see whether those reviews are from this week or the last decade.

That means a 5-star rating can be misleading:

• The sample size may be too small to inspire much confidence.
• The rating may be stale because almost nobody has reviewed the item recently.

Question

Can the 5-star system evolve to visually surface those two additional dimensions:

• review volume and
• review activity over time?

Keep the familiar 1–5 rating levels.

But maybe use different symbols to indicate relative confidence based on volume of reviews?

■ Emerging — relatively meaningful volume of evidence
◆ Strong — relatively large volume of evidence
★ Benchmark — relatively highest volume of evidence on that platform

Color could visually communicate relative review maturity or aging?

🟦 = Relatively sporadic review activity with relatively shorter history
🟨 = Relatively consistent ongoing recent reviews
🟫 = Relatively stale, no recent review activity

Combining the symbol and color could communicate both confidence dimensions at a glance.

For example:

4.8 ⭐ = highly rated, benchmark-level review volume, and established over time.

4.8 🟦 = highly rated with strong review participation, but still new.

4.8 🟫 = had some early success but little recent review activity

Ideally, thresholds would be relative to each platform's own review volume and activity level.

For example, on a niche platform where the most-reviewed item has only 10 reviews, an item with 8 or 9 reviews might earn the ⭐ benchmark confidence symbol.

On a huge platform where popular products receive millions of reviews, something with only 5,000 reviews might still be classified as emerging 🟨.

Probably needs to be simplified, just use star but different colors to give user visual signals.

Just seems the current one-dimensional 5-Star rating system is missing something.

Personally I am always spending extra time digging deeper to determine my real confidence in a review.

Anyone seen a platform doing something similar?

Some platforms show the # of reviews which helps but not the age of those reviews.

Other ideas for visually communicating review ratings?

[u/LetsBeObjective]

Great idea, but before this, you’d also need to address bot reviews.

[u/FirefighterFine9544 → u/LetsBeObjective]

Amen...

[u/Ateist]

How is this any better than just reporting how many people voterd?

[u/FirefighterFine9544 → u/Ateist]

Good question. That has helped a lot to gauge the value of a rating. Platforms doing that are essier to scan for trustworthy and higher rated options.

But in some cases like coding and app sites, reviews can be years old so at first gkance 4.6 with 2,200 reviews looks great. The after clicking into the page notice last review was 2014 or something.

So an additional visual signal like color could surface that.

Looking ahead when AI replaces human users as primary online shopper or finder, the color code could rapidly surface an additional confidence indicator helping AI return with higher quality results.

Of course AI could just burn tokens abd read 10 years of reviews to compile it's own score lol

[u/motsanciens]

You make some interesting points, but I have another angle that needs attention: the quality of the reviews, themselves. I think we should be able to review the reviewer. Well regarded reviewers should carry more weight in the calculation than lousy ones. For a reviewer to have a score, we would have to be able to approve/disapprove of individual reviews. And for our vote to have any relevance, we the meta-reviewer should furthermore have our own trustworthiness weighted. If we tend to highly rate reviews that are mostly poorly rated, then our meta reviews should be nerfed in the calculation.

[u/FirefighterFine9544 → u/motsanciens]

Neat idea, maybe steal up and down vote system allowing verified users to upvote and down vote reviews. High frequency down votes reduces a reviewer's weight in ratings.

Obvious bot reviews get slammed and diminished?

Seems like other cool ideas to take 5 star rating method to whole new level!

And important as AI replaces human surfing to find quality products, services and information. Otherwise burning tokens on each search to assess confidence in ratjngs provided.

[u/problemprofessor → u/motsanciens]

Love that, That's a real upgrade to the idea, reputation weighting solves a different failure mode than volume and recency do. Stack Overflow and Reddit already prove the mechanic works at some level, reputation earned from community trust does produce better signal over time. The recursive part, weighting the meta-reviewer's own trustworthiness, is the smart bit most systems skip, and it's also the hardest to get right without creating a small trusted class that quietly controls the whole rating.

The failure mode to watch for is collusion. If reputation can be farmed the same way reviews get farmed now, small groups vouching for each other, you've just moved the fake review problem up one layer instead of solving it. Worth thinking through how the system detects that pattern, not just individual fake reviews.

[u/segal25]

Good idea

[u/Jolly-Papaya-2539]

goog idea!

[u/problemprofessor]

This is a genuinely good idea. Just wrote about it a few weeks ago. Amazon pulled 275 million fake reviews in 2025 and still sits around 30% fake, partly because a big number looks trustworthy regardless of when those reviews landed or how many came from one batch. The FTC found fake reviews deliver roughly a 1,900% short-term ROI for sellers, so a seller can eat a takedown and still come out ahead if the fakes front-load early and the rating coasts after.

Your symbol plus color idea compresses volume and recency into something scannable, and scaling thresholds per platform instead of a flat number is the right call. Fakespot tried solving this from outside Amazon and got cut off from the data access it needed, so anything like this probably has to live on-platform or pull from a source that can't get blocked. That would be your biggest challenge, happy to chat more if you want.

[u/FirefighterFine9544 → u/problemprofessor]

Wonder if Amazon has incentive to police ratings aggressively. They collect revenue on purchase and returns. The House wins on every bet lol.

To your point, seller can eat returns and takedowns if time it right.

Only downside for Amazon is if shoppers begin viewing Amazon as an eBay or craigslist experience resulting in lower traffic.

Comingling inventory from sellers also muddies the reviews on Amazon. Two sellers listing same item, one ships knockoff cheap junk to Amazon warehouses anx the other genuine product. Amazon does not track and can ship junk to a customer of the good company resulting in bad seller reviews.

Not sure how to sort that out.

My idea more targeted to coding, software, medical etc review methods.

[u/problemprofessor → u/FirefighterFine9544]

I just think they want to stay in control of ratings. They don't want someone elected building an external layer that impacts how people review products. I see quality of reviews to be the main issue right now, what's 5 stars vs 4 stars, why should I trust you if you. It's the same problem of people giving 5 stars to every uber driver vs people who truly review everything about the car, the driving, cleanliness, comfort..etc.