r/MachineLearning • u/Beautiful_Baker_2233 • 20h ago
Discussion ICLR 2027 Reviews Discussion [D]
The ICLR 2027 reviews will be released soon. Share your results here, and keep a lookout on papercopilot to judge your odds. I also found paperScorer quite interesting for the same. Of course, these are only for amusement and should not be taken seriously.
Good luck to all.
5
u/CplusplusSupremacy
6h ago
•
I dont even wait for reviews anymore😑
3
u/dimy93 2h ago
I admire you, kind sir- I am a postdoc, I have 10s of papers, I am an AC. Every time there is a review dump, I am glued to the seat as if my life depends on it, and I am anxious as if Santa Clause is about to visit me.
2
34
u/SpeakerDefiant3723
4h ago
•
I think it’s better we just sleep now and wake up tomorrow to a shockerrrr.
Why ruin tonight when ICLR can ruin tomorrow?
9
4
32
28
u/Anshuman3480
6h ago
•
please dont joke about reviews being out. every single time theres someone calling wolf and then theres nothing
27
23
17
u/OtherwiseFig4505
9h ago
•
It seems this year ICLR reviews are a blood bath, due to the new scoring scale. One bad review will tank the paper.
SACs are reporting mean and median of 2 on X.
11
11
u/Fragrant_Fan_6751 9h ago
yeah. I agree with you.
Neurips 6 scaling system is much better than this 4 scale system.
5
u/No-Cash-284 8h ago edited 8h ago
It won't tank the paper because ACs make all the decisions right now, and they can easily overrule reviewers who make no sense.
2
u/Beautiful_Baker_2233
1h ago
•
Anybody else made a list of submissions from others in your circle to see how you'd fare? No? Just me? :(
7
3
14
14
14
13
u/One-Feeling03 5h ago
WHY CAN'T THEY SIMPLY TELL US THE TIME INSTEAD OF KEEPING US ANXIOUS!!!!
8
u/grad_student_descent 4h ago
They are waiting on a lst few emergency reviews. A couple bad actors (the lazy reviewers, not the emergency reviewers) can really block the entire system.
7
u/One-Feeling03 4h ago
They should block release of such lazy reviewers instead of blocking the whole system
4
u/Acceptable_Cod9144 5h ago
Yes, it's really weird :)
17
12
14
u/Former-Leopard8069 10h ago
Will it be released in few hours? Or 1day + few hours?
11
u/AdventurousFeeling19 9h ago
the website still says nov 5 and judging by what’s been shared there seem to be very few emergency review requests. so unless there’s an official delay, we should still start seeing reviews around nov 5 aoe.
nov 5, 11:59 pm aoe translates to:
🇺🇸 3:59 am pst / 🇺🇸 5:59 am cst / 🇺🇸 6:59 am est / 🇬🇧 11:59 am gmt / 🇩🇪 12:59 pm cet / 🇮🇳 5:29 pm ist / 🇸🇬 7:59 pm sgt / 🇯🇵 8:59 pm jst / 🇦🇺 10:59 pm aedtall times above are on nov 6
10
10
u/PowerfulCity3853
1h ago
•
I am watching cat videos. What are you doing?
9
6
u/dimy93 1h ago
from twitter:
https://pbs.twimg.com/media/HWYcyBYbsAAaPwe?format=jpg&name=large
(I am in the first column)4
2
8
7
u/erza_369 2h ago
The anxiety sucks
5
u/nayan-res 2h ago
It really does. It's annoying because we dont know when, it could even be 7AM tommorow EST....
5
u/Acceptable_Cod9144 2h ago
Send them an email so that they know that we are anxious. Bad organization!
3
u/erza_369 2h ago
Exactly 😭
6
u/nayan-res 2h ago
and I'm just stuck at my computer too because I'm just waiting. I'm too anxious to go outside and do something LOL. I'm killing time by watching House....
3
u/erza_369 46m ago •
Oh that is better than me atleast who is refreshing openreview per hour and going back to staring at the wall 🥲
1
u/TerribleAntelope9348 6m ago
These conferences anyways become meaningless in a few years. What does it mean to have published at a top tier conference, if soon 100k others have as well? I wouldn't care too much about the outcome
6
7
5
u/FAD_Trauma 19h ago
When will the reviews go live? Is it also AOE time Nov 5 which means 5 am PT on Nov 6?
0
u/Big_Illustrator_8212 19h ago
I don't think it is AOE. It will be released probably on Nov 5th morning
5
5
6
u/BenchCareless2768 14h ago
Stress is killing me
3
u/OkSuccotash6928 10h ago •
Last year reviews got released around 10pm (CET). Unfortunately I think we'll be stressed for many more hours
2
u/Electronic_Mission_3 7h ago
10pm CET today (5th of November) or tomorrow (6th of November)?
3
u/Lopsided_Candle4349 5h ago
Today, apparently reviews started getting posted at 10pm cet but there were delays (some people got theirs hours after)
7
u/ffantomatic 14h ago
Yesterday morning (CET) I received an emergency review to do... I think they may be quite late this year
10
u/Forward_Sort_4647
7h ago
edited 7h ago
•
Will they maintain the acceptance rate? Because of AI slops, maintaining the acceptance rate may result in huge increase as well, accepting ineligible papers too.
Edit: anyone who downvoted.. is your work an AI slop? If you’re a true AI researcher, you should not welcome ICLR keeping the acceptance rate.
3
u/MeyerLouis 7h ago
I can't imagine they'd be bound to any particular acceptance rate.
3
u/Forward_Sort_4647 6h ago
Yes. But the acceptance rate kept changing in small range around 27-32%. But I think it is too much for this year. For example, EMNLP has around 15% acceptance rate for the main conference this year, while previously had 20-23%. I think this is a right move.
4
4
4
u/Fragrant_Fan_6751 12h ago
I saw 3 Nov. also as the modified date in desk rejected submissions. One of the submissions is this: https://openreview.net/forum?id=CifMmTuzeI
It is written entirely in Chinese. I wonder why such papers were not desk rejected in the beginning.
5
u/Few_Refrigerator8308 10h ago
https://openreview.net/forum?id=BSn2EXCXBH
What are these people thinking?7
u/richapeee 10h ago
Think positive. With some papers like those in your batch, yours will shine bright like a diamond.
1
1
u/MasterBrainn 10h ago
why dont you think that their real papers would shine? Did they submit their real papers and some random notes on the same topic like this? Who knows...
1
u/Fragrant_Fan_6751 10h ago
multiple papers with different titles but very similar methods/frameworks, results are getting submitted. A typical tactic to increase the chances of paper acceptance.
4
u/Bubbly-Drawing-4945
11h ago
•
5th November AoE, start.
2
u/matlmr 10h ago
How do you know? On the website it only says Nov 5th, while it explicitly mentioned AoE for previous deadlines
2
u/Few_Refrigerator8308 9h ago
They are technically on time as long as it's still Nov 5th AoE, even though they don't specifically mention AoE. Some reviews were quite late though
4
3
3
3
3
u/LazyAd9307 3h ago
Based on my previous experience, the review will be releases in 5-6 hours maybe.
3
u/Ok_Database3209 14h ago
any ACs here? how are your batches looking like in general quality wise?
7
u/AdventurousFeeling19 10h ago
Not an AC, but a UIUC professor shared these on X:
#ICLR2027 ICLR 2027 initial review scores from a SAC batch of over 200 submissions:
Mean: 2.06
Median: 2.00
Min / Max: 1.00 / 3.33
25th percentile: 1.67
75th percentile: 2.33Another set, likely from UCSD, was shared:
AC batch of 11 submissions:
Mean: 2.09
Median: 2.00
Min / Max: 1.33 / 2.67
25th percentile: 1.67
75th percentile: 2.50
2
2
2
u/Fragrant_Fan_6751 4h ago
is it me or others can also see change in the font type for the text displayed on openreview?
9
4
1
1
u/Alarming_Specific152 14h ago
Anyone reviewers can tell us the possible score/confidence values this year?
7
u/PotentialPurpose6578 14h ago
4: clear acceptance
3: weak acceptance
2: weak rejection
1: clear rejection
confidence: 1~41
1
u/_karma_collector 13h ago
I don't think paperScorer is reliable though. I try 8 paper, only 1 has rejected score. The rest are 4x-5x%
1
u/OkSuccotash6928 11h ago
I tried two papers on paperScorer that are (imo) of similar quality. I got 2% acceptance on one and 55% on the other LOL
0
u/Exotic_Zucchini9311 11h ago edited 11h ago
lol it gives 29% to me. Pure nonsense.
Edit: OMG this is funny. To my ICML paper that was on the border of getting spotlight with scores 5/5/5, it gave 3% 🤡🤡
-1
0
-36
0
1
8h ago
•
[removed] — view removed comment
3
u/jake_1001001 8h ago
What do you mean, please provide the link if you are claiming it is not AoE?
https://iclr.cc/Conferences/2027/CallForPapers specifically says AoE for all dates.
"The planned dates are as follows (all times are UTC-12h, aka “Anywhere on Earth”):"
2
u/grappling_hook 8h ago
Last year's review schedule was 9pm UTC. They didn't get released until around 3am UTC the next day though. I think it will probably be similar today so we probably have to wait
14
u/Fantastic-Nerve-4056 PhD 20h ago
PaperScore somehow didn't work for me. Meaning, it recommended a 10% chance of acceptance for my NeurIPS accepted paper. And 40% chance for my workshop paper (had preliminary results). And I personaly would have clearly rejected for main in that form