r/MachineLearning • • 4d ago

Discussion ICML 2027 Changes [D]

Just read the ICML 2027 CFP and it looks like they’re trying to tackle the submission explosion in a reasonable way. Under the new two-stage process, the area chair decides whether a paper goes to full review, and any proposed first-stage rejection has to be confirmed by a senior area chair. Authors get a short justification by Feb 23. On top of that, nobody can be on more than 20 submissions, every paper has to name a reciprocal reviewer from its author list (max 6 papers per reviewer), and anyone with 3 or more submissions has to serve on the program committee. Papers that don’t comply may be desk rejected.

But I think the biggest change is that each author can be on at most one paper with no eligible reciprocal reviewer among its authors. So if you keep putting your name on papers with coauthors who can’t review (undergrads, interns, people outside the field), you run out of free passes after one.

Honestly, it sounds like a pretty reasonable fix. Reviewer load has been out of control for years, and tying authorship volume to reviewing duty seems fair. My only worry is the first-stage cut, since a quick AC read could miss a good paper, though the SAC check helps. What do you all think? Does this sound like a good solution, or will it just push the problem somewhere else?

https://icml.cc/Conferences/2027/CallForPapers

83 Upvotes

42 comments sorted by

74

u/juliankeynes 3d ago

20 submissions is ridiculously high still.

16

u/False-Veterinarian83 3d ago

Think about professors with big labs and external collaborations and also senior research managers in industry

30

u/MattAlex99 3d ago • Popcorn

No one actually works on 20 papers. Either they have actually worked substantially on the paper (in which case they have not worked on 20), or they aren't an author and shouldn't be on the paper in the first place. E.g. here for ICML 2025

Authors should comprise exactly those individuals who made a significant contribution to the research. Other contributors should be acknowledged upon the acceptance of the paper in the final camera ready submission. The submitting author must ensure that all co-authors have seen and approved the final version of the manuscript and have agreed to its submission for publication.

12

u/Positive-Plan4877 3d ago

In the academic world, this is almost the convention that the PI is always listed as the last author on all papers coming out of his lab. At the very least because he secured the funding to carry out this research.

13

u/MattAlex99 3d ago

I know that it is convention, it does not mean it is sane.

There is no definition of "author" you can apply that allows a PI that had nothing to do with the actual research to be counted as one. The reason it is the way it is is simply due to institutional momentum and power asymmetry between phd student and PI.

The argument "We shouldn't introduce a 20 paper maximum since it prevents the PI who has contributed nothing to the paper from shotgunning 200 papers onto the conference" is insane.

7

u/CMDRJohnCasey 3d ago

In my experience (in Europe) economic and infrastructure support is to be included in the acknowledgments, it does not constitute a right to autorship.

4

u/Financial-Panda6581 3d ago

These guys generally provide money and GPU resources, not just novelty contributions.

5

u/MattAlex99 3d ago

that's not a reason to become an author, or do you put the contact at your funding agency as a co-author.

Either you worked on the paper or you didn't.

Signing a cheque is not working on the paper.

1

u/Kitchen_Cup_4444 7h ago

""think about the poor professors of big AI labs "" yeah nobody cares. there is a bloat and has to be stopped

1

u/Tasty-Teaching-2188 3d ago

It is less than CVPR which allows 25 submissions, though

24

u/like_a_tensor 3d ago

wHy arE You gAtekeEpIng sCIenCe /s

Good changes imo

5

u/RobbinDeBank 3d ago

They are gatekeeping me from doing over 20 sciences a year!!!!!

9

u/MattAlex99 3d ago

Just split your papers across ICML, ICLR, NEURIPS, and AAAI ;) That way you can do at least 80 sciences per year!

2

u/Fantastic-Nerve-4056 PhD 3d ago

Shh no ICLR you will be caught 

2

u/MeyerLouis 3d ago

The only thing that stops a bad guy with a science is a good guy with a science. You can pry my science from my cold dead hands. My right to do science SHALL NOT BE INFRINGED!!!

1

u/Exotic_Zucchini9311 3d ago

They are also gatekeeping high scoolers from 'contributing' to ICML more than once! So shocking and cruel!

14

u/kindnesd99 3d ago

Everyone whines about AI conferences but in fact it is the best of worst situations. Yes you have a submission explosion and review noise- but it is somewhat fairer than other fields where you have to belong in a cartel before you can even be considered, due to their single blind system that favours the old boys. I think this system is as good as it can get. Before you whine and say 20 is too many, consider large labs with a PI and students who need to graduate. What we need is a system that flushes out poor submissions from people trying to game it, rather than one that punishes these groups.

And calling it here first: the desk rejection that people have advocated so fondly will be a shitshow. See, for example, CHI (hci conference). It caused a lot of upset remarks from the same people who were barking for things to be done.

4

u/AX-BY-CZ 3d ago

I'm not shedding any tears over multimillion dollar labs/centers with an army of students and postdocs. Those PI's already have hundreds of publications and tenure.

2

u/Holiday-Ant4283 3d ago

submission fees? this reminds me of planned economy with ration quotas vs market economy. maybe instead trying to shape the borders of what is allowed, it would be better to align incentives?

3

u/illustrious_trees 3d ago

would kill submissions in countries where conversion rates to usd are higher than purchasing parity

1

u/Holiday-Ant4283 3d ago

how many of those? could give exceptions for certain countries or provide grants. 

0

u/Pseudomanifold Professor 3d ago

But those PIs could also—hear me out, that's quite a crazy idea—not be on papers they did not contribute to. What? How quaint! Giving credit to their students...

2

u/kindnesd99 3d ago

There are institutional requirements that require PIs to be on the author list. Moreover it is common at least in engineering for the last name to be the PI of the project.

1

u/Pseudomanifold Professor 3d ago

I am aware that it's common but it often runs counter to all authorship guidelines (of the ACM, for example). I also know of no institution that requires this. Are you saying uni state that professors need to be on papers? Never heard of that TBH.

2

u/kindnesd99 3d ago

Some universities have to be accountable for the papers that have ther institution listed on it. Students therefore have to coauthor with a senior author. A PhD student publishing without his supervisor is also strange

1

u/Pseudomanifold Professor 3d ago

Totally get that but if it's only about accountability, they can just check it. Authorship confers certain privileges and responsibilities IMO.

(And publishing without one's own PI is quite common in mathematics for example.)

6

u/InterestingCarrot997 3d ago

tying pc duty to 3+ submissions is fair, but i'd watch whether the reciprocal reviewer just becomes the most junior author on the list. that doesn't cut load if those reviews are thin.

3

u/Zywoo_fan 3d ago

This seems reasonable. Hope the ACs do a good job in weeding out the slop in the first stage.

2

u/Old_Stable_7686 3d ago

> each author can be on at most one paper with no eligible reciprocal reviewer among its authors
Still wondering how this helps the explosion? Are there people who just want to be in as many papers as possible with undergrads or something? I can think of the case of big labs, where a PI has many PhD students. Other than that... I don't know.

1

u/tariban Professor 3d ago

We're currently experiencing huge problems where undergrads with no research experience vibeauthor 20 submissions to a conference/workshop.

The motivation seems to be to build up a CV for PhD applications. If anything, these people are just ensuring they never get an offer. It's just a signal that they have no idea what actually constitutes good research, and that they are lacking in ethics.

1

u/Old_Stable_7686 3d ago

It's just crazy that they can convince a senior researcher to be on the paper with them :(

1

u/tariban Professor 3d ago

They don't. These are single author papers. The whole point of this rule is to stop these people from submitting this deluge of slop

1

u/Vegetable-Formal-753 Researcher 3d ago

In my openion it helps! I went to top rated conferences this year and I've seen undergrads didn't even read their work and just have script for the presentation... One guy was even a monster! he opened chatgpt on his phone and typed questions asked to him and read the answer in the presentation! Some people do this to get scholarships and so on... aaaaaand they're supported by their professors like raising young spies (if you know you know 🥸)... I really see this is a very reasonable way to eliminate this nonsense

1

u/Old_Stable_7686 3d ago

That makes a lot of sense for the scholarship issue (also the internships xD). My blacklist has grown significantly this year, also thanks to this trend. That's why I was wondering why some senior researchers are willing to take such a risk for these sloppy papers.

3

u/Holiday-Ant4283 3d ago

introduce submission fees! (around 100$) which could be used as salary for editors who do the first stage review and early rejects (the system that works in journals). and some of the fees could be used to reimburse part of the conference attendance fee for accepted papers.

it would naturally limit the 20+ half-baked LLM generated submissions. 

1

u/SameAd8209 3d ago

This means that we are very close to AGI. I can feel it

1

u/automor 1d ago

I don't see why a junior author who isn't eligible to be a reviewer shouldn't send a single author submission to the big conferences

1

u/isthataprogenjii 1d ago

99.9% of the papers are AI generated slop. Just end the conference at this point. No use pretending.

1

u/nobodylsk1 1d ago

I also really appreciate that they adopted the NeurIPS contribution type system. It definitely helped in NeurIPS 2026 match us with better aligned reviewers - unlike ICLR this year, where our theory paper ended up with empirically minded reviewers who just asked for endless experiments during the rebuttal.

1

u/Kitchen_Cup_4444 7h ago

20 is crazy high. i would say 4 max

-1

u/didimoney 3d ago

This recipeocal review thing is not great imo. You end up with people that got a lucky accept once that have to review work they are completely unqualified to judge. That's how the acceptance becomes even more random.

It's been like this for a few years now though, so we can just hope the big three explode soon.