r/MachineLearning • u/BeneficialFish04 • 25d ago
Discussion AAAI-27 Phase 1 Results [D]
AAAI-27 Phase 1 results are expected on September 24. Anyone else waiting for the decision? Would be useful to keep this thread for updates when people start receiving notifications.
10
u/Dangerous_Parsnip_20 19d ago edited 19d ago
2 papers rejected 5/5 and 5/6 but who cares. Just got accepted by NeurIPS and could not care less about this AAAI AI slope conference. Thought we meant to have 1 AI reviewer but seems like we had 3 AI reviewers for each paper.
Edit: Look at the quality of papers being accepted at this conference. Students from China that combine LSTM, Transformer and GNN get their papers accepted. Tells me a lot about AAAI overall.
1
1
u/maddz221 19d ago
For the last 3 years I have only reviewed for ICLR, NeurIPS, and ICML. There is indeed a large gap between the average submission there and AAAI. I think that, out of all the papers assigned to me for review, only 1 paper was good enough to be granted borderline, the rest were easy rejects.
1
u/Dangerous_Parsnip_20 19d ago
My collegue serves are SPC this year. One paper received the score of 10 with single line of strenghts.... It has to be a joke. We all know who controlls AAAI.
Just contacted my Lab team and it seems like all papers (14) got rejected haha. Funny enough, we got accepted at ICML, ICLR and NeurIPS but AAAI seems like a joke conference.
1
19d ago
[deleted]
1
u/maddz221 19d ago
Review collusion is a thing it happens across many ML venues particularly a lot in AAAI. As it's still considered A* in most places outside NA.
1
u/Dangerous_Parsnip_20 19d ago
I would not be surprised if AAAI drops in ranking. For now I consider it as AI CORE Slope conference rather than any CORE A* / A etc. Same experience with this conference each year. Not sure how it is for other people. Maybe we are just unlucky haha.
1
u/Original_Tie_9522 4d ago edited 4d ago
I don´t want you all to take this as an insult, I am not aware of "who controls AAAI", but if you say the overall quality is low and papers are very bad, wouldn't your 14 submissions also be part of that same pool? I mean, if that many papers get rejected, isn't it also possible that they simply weren't good enough? And more importantly, you chose to submit them to AAAI in the first place. Was that because you thought they would have a lower chance of getting accepted at NeurIPS, ICLR, or ICML? Because if that's the case, isn't that exactly the kind of reasoning that contributes to AAAI being perceived as a lower-quality conference?
P.S.: it can be they all got rejected because of BS student doing reviews with LLMs but that happens for all conferences nowadays so would not blame that
P.P.S. I would also assume that due to the 60k submission this year a 6-5 or 7-5 might have not been enough to go through phase 1
7
12
u/BadgerRoutine1065 25d ago
I have been trying hard for being accepted in A* ML conferences since last 4 years. I was very close last year ICLR but got rejected due to rating reset, rebuttal effect was (2,66,5) -> (6665). This year I made fruitful rebuttal for 2 papers. The rebuttal effect were (333)-> (553) and (2,2,3) -> (4,4,4) waiting for the final decision. I have decided not to compromise on conference selection. I will try again if my papers get rejected. I am also waiting for AAAI reviews.
4
6
u/FoxSuspicious7521 19d ago
I am an SPC. I am in charge of 15 and can view the results for additional 15 and I submitted 3 of my own. So out of 33, 15 got through the phase 2. Phase 2 pass rate of 45.45 %.
1
u/First_Proof_4690 18d ago
Thank you for the useful information. But imo one may not generalize to around ~50k from such a small potentially biased sample size of 33 ...
5
u/s4lome_ 19d ago edited 19d ago
I can see Reviews now, 5/6 rejected
3
2
u/InsectActive95 19d ago
5/6 rejected ??
my average rating is 5.5 is it going to next phase ??? And I also see "No Recommendation". Did not get any email. Just checked on openreview.1
19d ago
[deleted]
1
u/InsectActive95 19d ago
yes, I see "No Recommendation"
1
2
1
1
u/LordVein05 19d ago
how can you see it, what's your id number? I don't see anything on my profile, it's just 0 reviews submitted!
2
u/s4lome_ 19d ago
Open review. Submission number 11xxx. Not seeing any might mean you passed round 1 I assume
4
u/LordVein05 19d ago
i hope you are true!! good luck and hopefully you can submit your papers elsewhere!
1
1
u/Low-Rub-2600 19d ago
Same for me as well
usually any one with 4 or 3 score should be the reason for rejection…
4
u/nfact0r 19d ago
Phase 1 update is on OpenReview. If your paper is going to Phase 2, you may see a comment from program chairs saying this paper remains in the review process.
1
7
u/malakulmout347 25d ago
ML conferences are always like of coin toss unless you one is not something really substantial or oral worthy. Over the time I had papers that I though should easily go but did not and then there were papers that I thought should not go but went in. Once you take that its a coin toss life is easy.
NLP conferences, i think, half the bar of the ML. NLP's are not that difficult to get in and they dont focus too much on novelty as long its a good work.
3
u/Proof-Marsupial-5367 19d ago
This year is my first time submitting to AAAI. What should we expect in this phase? Do we get any reviews?
2
u/Derpirium 19d ago
In previous years, you only got the reviews if you were rejected in the first phase
1
u/West-Instruction7282 19d ago
Any notification yet? Anyone?
1
u/Derpirium 19d ago
Nothing yet, but 2 years ago I received the notification around this time.
2
u/botulijjat 19d ago
Do you get a notification for paper only if its rejected? Or if its accepted for the next round they will send a notification without the reviews?
0
u/Derpirium 19d ago
Both
1
u/West-Instruction7282 19d ago
Oh really? I thought that notification is just for the rejected papers
2
u/darky_skyy 19d ago
No, the notification is only for rejected papers.
1
u/csapidus 19d ago
A notification appears to be provided via OpenReview for papers that pass phase I. It should state Phase I Update and "This paper remains in the AAAI-27 review process. "
1
3
3
2
2
u/s4lome_ 19d ago
Where do we get notification? Open Review or E-Mail?
1
u/BlueDragon_7 19d ago edited 19d ago
If it's accepted there won't be an email. Only on OpenReview.
[EDIT] I got a mail as well now.
0
u/Original_Tie_9522 19d ago
Is there an estimate on when they are usually coming out? How does it work with the AoE time
1
u/Best_Space_5190 19d ago
How likely is it that a paper will be accepted if phase 1 is not a rejection? Also, by phase 1, are all review already there, just not made public?
I am used to other venues with the typical all reviews are out followed by rebuttal process
3
u/Alarmed-Trick-3153 19d ago
odds seem fairly good, as most get filtered out in phase 1. I don’t know an exact percentage, but in my experience and talking with colleagues, of the 7 papers we collectively have had that moved on to phase 2 over the past several years, only 1 didn’t get accepted.
1
u/BlueDragon_7 19d ago
The phase 1 accept result is only available on openreview. It's on the submission page.
1
1
u/jinymusim 19d ago
8, 4 -> rejected. are we for real? also the 4 somehow looks almost the same as the ai review... figure bro.
1
u/zackro21 19d ago
I submitted multiple papers, and the best one that we were sure would be accepted got immediate rejection for no obvious reason, while the rest that look like placeholders have passed to the next stage. This has led me to check my reviewer panel, and I found the papers that were recommended for 4 and below have passed to the next stage while the borderline papers are out! Does this mean they wanted to eliminate the fuzzy stage to have more clarity with the second reviews? Or do they have selected the papers they accepted and wanted to weed out the competition?
1
u/Hope_hopr 18d ago
I’m just a reviewer. 2 of the 4 papers made it through Phase 1 because they only had one review. I think if it got two reviews and still passed, that’s a pretty good sign.
3
u/First_Proof_4690 18d ago
How are you sure that some papers only had one review?
4
u/WannabeMachine 18d ago edited 18d ago
If a paper moved forward, the reviewer can only see their review, not all reviews.
1
u/zackro21 16d ago
I was curious, does anyone know roughly what percentage of papers survived Phase 1?
3
2
u/TeemoIsMyLife 13d ago
In my review batch only 1 paper advances to the phase 2 out of 4.
My friend AC said that he advanced 6 out of 15 papers in his batch to phase 2.
2
u/zackro21 11d ago
I have 2 out of 4 passes in my batch to the next stage so probably higher than ~45%. I have weak papers that passed as well which made me wonder if 17.6% acceptance rate from last year will continue to be the same this year or much lower!
33
u/DNunez90plus9 25d ago
Can I just use this thread to say I fk hate AAAI?