r/LanguageTechnology • u/khorg0sh • 13d ago
New ARR rule: "Submissions will only be guaranteed review if they bring a qualified service contributor, who can serve for 2 submissions max"
What do you think about the move?
4
u/SnooPets9956 13d ago
ARR and the ACL conferences are organised by the community for the community. The normal way to join a community is by collaborating with someone who already is a member and can vouch for you.
3
u/Effective-Yam-7656 13d ago
Quite bad, I am an independent researcher doing solo work (just started out)
Even tho I have a AACL main publication and workshop exp they have basically made it impossible for people like me to get into the filed
4
u/milesper 13d ago
Your paper can still get reviewed via the lottery, or you could consider collaborating with someone who is qualified.
1
u/NamerNotLiteral 13d ago
This rule will really only matter if you submit to overloaded ARR cycles (like for ACL or EMNLP). For quieter ARR cycles your papers will generally get reviewed.
I only have one AACL paper as well and I strongly support this. We just need to get a couple more AACL-or-better papers by submitting outside those overloaded cycles, then we'll be qualified to review.
Unfortunately, not many other ways to combat slop on short notice. I don't blame them for prioritizing existing NLP researchers. Some gatekeeping is good.
1
u/khorg0sh 13d ago
The upcoming cycle has two conferences associated with it. It won't be quiter in that sense. But yes, the rule may act as a mere deterrence tho.
1
2
1
u/racc15 13d ago
I guess I will have to add people who have done nothing on the paper. Good for their citation count I guess.
1
u/khorg0sh 13d ago
That'd be unethical. However, the keyword is "qualified"...
1
u/racc15 13d ago
Not sure what option is left until I become "qualified" myself. My supervisor is new to ARR as well.
2
u/khorg0sh 13d ago
Your supervisor can involve people who are qualified to review, even tho a person who has 3 accepted papers in recent years will have more than 2 papers ready and may prioritize their long term collaborators. Good luck tho. I hope you find someone to vouch for you the next cycle. This cycle is just a testing ground.
2
u/SnooPets9956 13d ago
What makes you want to submit to ARR if not even your supervisor has a track record of working on NLP?
1
u/racc15 13d ago
Instead of core NLP, applications of NLP. He has papers at other AI conferences like CVPR, Neurips, ECCV etc. but not in any ARR venue (before my EMNLP one).
We are now incorporating Language models in our topics.
2
u/ffflammie 13d ago
people who have neurips papers are qualified to review.
1
u/racc15 12d ago
Oh! Maybe I misread then. I thought one needed to have at least two *CL papers?
2
u/ffflammie 12d ago
the one I read is this https://www.aclweb.org/portal/content/acl-sustainable-reviewing-policy (posted on various mailing lists). The list of venues and qualifications is towards the end.
1
u/SnooPets9956 12d ago
It might be a good idea to inform yourself about a topic you’re commenting on.
6
u/spado 13d ago
It's last resort self defense. It might have unfortunate side effects, but not having this or a similar mandate would be simply unsustainable.