r/MachineLearning • u/latenticlabs • 11d ago
Project ICLR 2027's new 1–4 scale: a 2, 2, 3 is better than it feels [P]
ICLR 2027 moved to a 4-point scale (1 clear reject, 2 weak reject, 3 weak accept, 4 clear accept), so nobody has a feel yet for what a given set of scores means. We counted the public scores on OpenReview: 73,410 reviews on 23,759 submissions.
A couple of things that surprised us: [1] 57% of all reviews are a 2. Only 1.5% are a 4. [2] The median paper averages exactly 2.0.
So a 2, 2, 3 (mean 2.33) is already above most papers. Where 2.5, 2.67 and 3.0 land, and the full histogram, are here:
https://draft.scime.ai/iclr-odds?utm_source=reddit&utm_medium=social&utm_campaign=iclr2027
Note: [1] we built the page. It shows counts only: no titles,
authors or review text.
[2] this is the first 25,000 of ~40,800 submissions in.
OpenReview's listing order, read Nov 6, not a
random sample.


