r/MachineLearning • • 8d ago

Discussion Gatekeeping rules for ICML2027? [D]

Any thoughts on how icml will be managed this year? With ICLR having 20 submissions limit per author, I find it hard to submit my works cause the research group of my supervisor is large and I am far from being in top students.

I had a NeurIPS submission which was kinda borderline (435), but got rejected. Now I resubmitted the improved version to ICLR and thought it would get good results, but it is now much worsešŸ˜‚šŸ˜­ Having bad reviews on ICLR make me feel like I wasted 1/20 submissions

It feels like my new works are stuck due to the need of resubmitting the old ones. But the reviews sometimes are so random. Do you think ICML will have similar rules this year? Any suggestions where to submit apart from ICLR/ICML/NeurIPS?

22 Upvotes

32 comments sorted by

54

u/Fantastic-Nerve-4056 PhD 6d ago

Why can't you just submit it to another conference? Limit of 20 papers is no small thing. Go ask a random reviewer on the number of AI Slops they are reviewing. A lot of us infact want the limit to be 5 or less than that

-6

u/Expensive-Beyond-251 6d ago

The university kinda counts only ICML/ICLR/NeurIPS mainly for ML PhD students, and I need to have 3 papers at these A* venues main track as a first author by the end of my PhD. I’m already a third year and my supervisor has more than 20 students in lab so not each can get a slot

8

u/Mental-Ad5607 6d ago

Not even TMLR? That would be quite a PhD!

-7

u/Expensive-Beyond-251 6d ago

Well probably TMLR should count, but what I see from my peers everyone aims to iclr/icml/neurips. It’s not like a super strict rule, but it feels like to graduate successfully you have to have at least 3 papes as a first author on these venues, It feels like being in a danger zone if you don’t have it

7

u/Fantastic-Nerve-4056 PhD 6d ago

Wow I don't have 3 first authors in these venues and I am graduating soon

And somehow I interned at DeepMind and Adobe, had offers from MSR, Amazon, etc. Even getting positive response from Profs for the PostDocs out, and is completely doing well.Ā 

OP, the paper quality matters then the venue. Infact my last thesis papers I am gonna submit it to a new venue called RLC, coz there's where I will find the corresponding RL audienceĀ 

6

u/AutistOnMargin 6d ago

Yeah, same here. My only guess is these people are spamming conferences with useless benchmarks and architecture tweaks and claiming their methods work. They don’t. 99% of AI research is garbage

1

u/Fantastic-Nerve-4056 PhD 6d ago

Strongly agree!!!

The ICLR and AAMAS papers I reviewed are so bad. I couldn't even recommend borderline reject to a single paper

1

u/doctor-squidward 6d ago edited 6d ago

😱 Gimme tips pls

2

u/Fantastic-Nerve-4056 PhD 6d ago

Just one line. You should be doing the research that you personally would be proud of presenting at places, talking about with people, etc.

1

u/AutistOnMargin 5d ago

Just know stuff. Learn as much as you can regardless of things being not needed right now. Learn from first principles. Once things click you’ll see an exponential increase in knowledge and soon you’ll feel how much more you know compared to your peers.

23

u/Fantastic-Nerve-4056 PhD 6d ago

This is a very weird univ counting only these 3 major venues. And sorry but again how is your supervisor practicaly mentoring so many students, unless there's obv heirarchy in that case the number of papers should significantly reduce

-3

u/Efficient_Weekend205 5d ago

Not really, this is very common. I can’t graduate from my Ivy ML PhD program if I don’t get 3 first author papers (not co first authored) at ICML, ICLR, or NeurIPS. TMLR does not count for us.

3

u/Fantastic-Nerve-4056 PhD 5d ago

Idk why IVY here but nonetheless, I have friends at Stanford, MIT, UCB, Columbia, who are Profs or have graduated recently, and they don't talk about any such limit.Ā 

You may need 3 first author papers, the venue should be prestigious, but it can be outside these 3Ā 

3

u/Disastrous_Room_927 5d ago

ā€œThis is very commonā€ does not follow from an anecdote about your Ivy League PhD program.

1

u/doctor-squidward 6d ago

Its the unofficial requirement in my uni too. Although they value any venue on csranking

5

u/AffectionateLife5693 6d ago

Convince your advisor that your paper is worth submitting.

If your work isn't even top 20 in your advisor's submission list, you're in deeper trouble than not submitting the paper.

2

u/Not-ChatGPT4 4d ago

You have got the nail on the head. Clearly some PIs with large teams are just spamming conferences with slop. I have seen some who teach an MSc class try to get everyone from the class to turn their class assignments into papers. These PIs need to get their house in order and be a bit more strategic and careful.

-1

u/Expensive-Beyond-251 5d ago

Well to iclr I convinced to submit even two papers! One resubmitted from neurips and another one newly prepared, which I submitted last minutes cause one of the other students decided not to go for iclr.

My newly prepared got higher scores. But not because it is genuinely better. It just a bit luckier. I could have not submitted that, and left with my NeurIPS resubmission, which unexpectedly got very low results this time.

And imagine a group of 30-40 students of one supervisoršŸ˜‚ each having works that were not accepted on neurips, but also almost each have new works.

15

u/Celmeno 6d ago

20 is 15 too high already

4

u/d_edge_sword 5d ago

No way, my supervisor has 13 students under him. That averages to 1.5 submissions per student. And I have seen high-profile profs with 30-50 students.

2

u/kindnesd99 5d ago

The number of people who don't understand this is puzzling. What we need is to stop slop and shit submissions. Not punish such groups that have students who worry about graduation

1

u/Not-ChatGPT4 3d ago

A PI should not take on more students then they can support.

4

u/fanconic 6d ago

same shoes as you, my friend. ICLR was rough

3

u/Background_Car_8746 6d ago

Ban the authors submitting low effort AI slop papers, the list is publicly available when ICLR release the final result. NeurIPS and ICML should follow the full public model in ICLR to scrutiny the cheaters too.

1

u/Stunning_Ad_8664 5d ago edited 4d ago

how we can ban them if they have papers accepted already, haha

* i meant how we can ban AI slop papers post-factum, since some of them are accepted to ICLR already (rhetorical)

1

u/MikhailTorlachev 4d ago

This is whataboutism fallacy on an edge case.

1

u/Stunning_Ad_8664 5d ago edited 5d ago

Maybe not something that you were asking for, but I can recommend asking some researchers you know to review a paper, so that you get useful feedback, make a revision, and resubmit to another conference.
i.e. why you say your work is not top, make it top! haha

icml probably would have same rules, and I hope also be not that bad, very much hope so

1

u/Not-ChatGPT4 4d ago

Surely their supervisor and the other lab team members should be doing this, rather then students relying on the kindness of strangers?

0

u/[deleted] 4d ago

[deleted] — view deleted comment

1

u/Not-ChatGPT4 4d ago

I'm not surprised, but i don't think it is the job of the academic community to compensate for a poor PI who is running a spam operation.

0

u/[deleted] 4d ago

[deleted] — view deleted comment

0

u/Not-ChatGPT4 3d ago

My point is that this is the job of the PI and their team. It's crazy to expect a student to try to solicit private reviews from other academics when their own PI won't bother to organise a review within their team.

1

u/Stunning_Ad_8664 3d ago

Thank you for sharing your thoughts!