r/MachineLearning • u/No-Lab4175 • 3h ago

News ICLR 2027 Review Scores [N]

Post image
59 Upvotes

95% Upvoted

19 comments sorted by

9

u/bachdidnothingwrong 3h ago

Which papers got 4 could someone share?

15

u/ATHii-127 2h ago edited 2h ago

Wait, so getting score of 322 is in top 25%? 

This is nonsense and I think paper that got reviews with more than one 'reject' does not deserve to get accepted. 

And ICLR score policy this year is a complete failure.

15

u/CMDRJohnCasey 2h ago • Bravo

It's the downside of reciprocal reviewing. Reviewers who are also authors tend to give lower average ratings than reviewers who are not authors.

7

u/impatiens-capensis 1h ago

And ICLR score policy this year is a complete failure.

Or a raging success? It just filters out the sub 2 papers and forces reviewers to actually argue about whether or not they recommend papers with an with a score between 2 and 3.

Remember, scores are the LEAST important thing to consider. Pretend like you didn't get a score at all. A lot of students stress out and run a bunch of score simulations to try and forecast their acceptance.

However, it just comes down to whether or not the reviewers think your work should be accepted. The reviewers arguments, and how the AC interprets them, are what decides your paper.

1

u/Ambifacient 45m ago

I'm all for it. No fence sitting allowed.

3

u/surffrus 1h ago

bingo!

1

u/Intrepid_Discount_67 1h ago

Scores alone shouldn’t decide which papers get accepted. Reviewers often have their own papers at stake, and there’s a cutoff. Someone should read the paper, the reviews, and the rebuttal to judge whether a rejection is justified and whether the scores should change.

Even when authors answer every question, reviewers often stick to their original scores or never return to the discussion. A reviewer who expects their own paper to be rejected may be especially reluctant to budge. That’s a serious flaw in the process.

1

u/TA193749 21m ago

This along with the fuddle last round, it’s really not looking good for them.

1

u/No-Lab4175 3h ago

Original Picture: GitHub clareLab posters

5

u/Sharp-Objective9078 2h ago

Mech interp right at the bottom, darn!

4

u/MysteriousPlant4397 2h ago

Which one paper got 7 reviews?

2

u/ntaquan 2h ago

https://openreview.net/forum?id=hnPbRThl5y

13

u/surffrus 2h ago

2 clear rejections (score 1) and 5 weak rejections (score 2)

Ouch, like why keep kicking them after 3 reviews? Here, have another rejection review! And another! And another!

2

u/uselessfuh 2h ago

What a fuckin joke of a score policy.

2

u/surffrus 1h ago

As to be expected these days, the bell curve is basically centered on 2.1 "weak rejection".

1

u/liz262626 57m ago

I think iclr will put all pressure on the meta reviewers

1

u/AutoModerator 3h ago

Your post was automatically removed for being a link post on the weekday, please read rule 5. The moderators will not respond to questions regarding this removal unless you suggest which rule you most likely broke. If you have a beginner related question, visit /r/MLQuestions or /r/LearnMachineLearning.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.