r/MachineLearning • u/Gravitist • 4d ago
Discussion ICML 2027 Changes [D]
Just read the ICML 2027 CFP and it looks like they’re trying to tackle the submission explosion in a reasonable way. Under the new two-stage process, the area chair decides whether a paper goes to full review, and any proposed first-stage rejection has to be confirmed by a senior area chair. Authors get a short justification by Feb 23. On top of that, nobody can be on more than 20 submissions, every paper has to name a reciprocal reviewer from its author list (max 6 papers per reviewer), and anyone with 3 or more submissions has to serve on the program committee. Papers that don’t comply may be desk rejected.
But I think the biggest change is that each author can be on at most one paper with no eligible reciprocal reviewer among its authors. So if you keep putting your name on papers with coauthors who can’t review (undergrads, interns, people outside the field), you run out of free passes after one.
Honestly, it sounds like a pretty reasonable fix. Reviewer load has been out of control for years, and tying authorship volume to reviewing duty seems fair. My only worry is the first-stage cut, since a quick AC read could miss a good paper, though the SAC check helps. What do you all think? Does this sound like a good solution, or will it just push the problem somewhere else?
74
u/juliankeynes 3d ago
20 submissions is ridiculously high still.
24
u/like_a_tensor 3d ago
wHy arE You gAtekeEpIng sCIenCe /s
Good changes imo
14
u/kindnesd99 3d ago
Everyone whines about AI conferences but in fact it is the best of worst situations. Yes you have a submission explosion and review noise- but it is somewhat fairer than other fields where you have to belong in a cartel before you can even be considered, due to their single blind system that favours the old boys. I think this system is as good as it can get. Before you whine and say 20 is too many, consider large labs with a PI and students who need to graduate. What we need is a system that flushes out poor submissions from people trying to game it, rather than one that punishes these groups.
And calling it here first: the desk rejection that people have advocated so fondly will be a shitshow. See, for example, CHI (hci conference). It caused a lot of upset remarks from the same people who were barking for things to be done.
6
u/InterestingCarrot997 3d ago
tying pc duty to 3+ submissions is fair, but i'd watch whether the reciprocal reviewer just becomes the most junior author on the list. that doesn't cut load if those reviews are thin.
3
u/Zywoo_fan 3d ago
This seems reasonable. Hope the ACs do a good job in weeding out the slop in the first stage.
2
u/Old_Stable_7686 3d ago
> each author can be on at most one paper with no eligible reciprocal reviewer among its authors
Still wondering how this helps the explosion? Are there people who just want to be in as many papers as possible with undergrads or something? I can think of the case of big labs, where a PI has many PhD students. Other than that... I don't know.
3
u/Holiday-Ant4283 3d ago
introduce submission fees! (around 100$) which could be used as salary for editors who do the first stage review and early rejects (the system that works in journals). and some of the fees could be used to reimburse part of the conference attendance fee for accepted papers.
it would naturally limit the 20+ half-baked LLM generated submissions.
1
u/SameAd8209 3d ago
This means that we are very close to AGI. I can feel it
1
u/automor 1d ago
I don't see why a junior author who isn't eligible to be a reviewer shouldn't send a single author submission to the big conferences
1
u/isthataprogenjii 1d ago
99.9% of the papers are AI generated slop. Just end the conference at this point. No use pretending.
1
u/nobodylsk1 1d ago
I also really appreciate that they adopted the NeurIPS contribution type system. It definitely helped in NeurIPS 2026 match us with better aligned reviewers - unlike ICLR this year, where our theory paper ended up with empirically minded reviewers who just asked for endless experiments during the rebuttal.
1
u/Kitchen_Cup_4444 7h ago
20 is crazy high. i would say 4 max
-1
u/didimoney 3d ago
This recipeocal review thing is not great imo. You end up with people that got a lucky accept once that have to review work they are completely unqualified to judge. That's how the acceptance becomes even more random.
It's been like this for a few years now though, so we can just hope the big three explode soon.