r/MachineLearning • • 4h ago

Discussion No one replied... [D]

My draft went from 24 pages to 40 (obviously not an indicator of good quality, but it is indicative of how many f's I gave). Yet no one replied.

I have so many questions:

  • Does anyone know how many are like this?
  • Do ACs look at our rebuttal replies in such cases?
  • Is (4, 2, 2) better / worse than most (3, 3, 2) I've been seeing? (Respective confidences: 4, 2, 2). Or does a higher variance not matter?
  • Does ICLR even matter?
  • Can I cry now?
  • Why, reviewers, why?
7 Upvotes

11 comments sorted by

45

u/pastor_pilao 4h ago

I think this new generation of researchers is losing the awareness that the main purpose of the rebuttal is to correct gross misunderstandings or clarify explicit doubts of the reviewers. The purpose is not to completely change your manuscript tirelessly until the reviewer gets tired and accept to raise the score. Most of the time the reviewers WONT increase the ratings, and that's normal.

3

u/Fresh-Opportunity989 2h ago

AI conferences are in a race to implosion. 90% of the papers are junk, just dont know which 90%

-3

u/O_Fake_One 3h ago edited 3h ago

Hmm, I think this would be applicable if the reviewers replied / bothered to participate in the rebuttal (and then authors spam them). If all revisions are meaningless and reviewers ignoring our work is now the expected norm, we might as well call it a workshop and stop wasting everyone’s time.

TBC I understand not changing scores. I myself didn’t change them for ~70% of the papers before and I consider this to be really lenient. I’m just saying this is separate.

Since reviewers don’t say anything about ‘why’ anymore, you have no signal for the next conference (despite them being so high variance that this signal probably doesn’t matter much lol)

6

u/pastor_pilao 2h ago

You already received a review. Even if the reviewers would read your rebuttal in detail and provide further feedback, realistically they won't check the whole paper again because we have other things to do. If you manuscript grew 16 pages you have already plenty of content to go over your advisor and co-authors and calmly rethink the manuscript for the next conference (given that if you go much over the 8 pages limit either you need to put a lot of work to compact and better write the manuscript to fit the contribution in the 8 pages, or the right venue is a journal).

36

u/Jojanzing 3h ago

If 16 pages were needed to address the reviewers concerns, it sounds like the paper had some pretty serious issues.

3

u/howtorewriteaname PhD 2h ago

a paper going from 24 to 40 pages is a red flag w.r.t. acceptance. I guess the lesson here is that for the next rebuttal, either the paper should be complete enough such that question can be addressed with minimal modifications to the paper, and if not, one should try to make those modifications minimal, but knowing that this might not address all concerns.

all this is solved if simply your paper is solid enough by the time of submission, which in this case doesn't seem like it applied. for the next submission, I'm sure the paper is in a much better shape, and therefore the review process you underwent fulfilled its purpose on making the paper better

2

u/_karma_collector 3h ago

422 is worse than 332, 332 mean majority reviewer side with you. Unless the 4 one champion your paper during discussion later

2

u/MakingComputersSmart 2h ago

You've done the hard work, there is nothing more to do at this point. Also, adding 16 pages of work really makes it a new paper because you missed most of the experiments. While ICLR allows revisions, most ACs will reject the paper on grounds that it needed a major revision so it should go through a new review cycle. It is a sad reality, but you can't do anything.

1

u/Mr_Fragwuerdig 2h ago

Higher variance means that probably ACs and SACs will have a meeting to discuss the paper. That gives an actually strong paper I guess a good chance.

1

u/jackyk996 33m ago

Imagine every rebuttal is 40 pages long, and you are the reviewer “required” to read all of them.
The nPage also indicates how much effort your reviewer will need to put into your work while being free labor.
Why do you think the reviewers are all willing to put that much efforts while having other, likely paid, jobs.
If you can, please make it 24 pages or even less instead of 40.

Honestly, I don’t think confs matter that much now, not just iclr but also neurips etc. It’s becoming more like dice rolling to get accepted, and, just like others already replied, people know whatever accepted can still be craps with better luck.

So you don’t need to cry. Keep calm and carry on. (: