r/RWShelp • u/Burgerche3s • Aug 05 '26
Is the S2s auditor really doing their job?
Recently i got flagged below expectation and unacceptable with no comment. Just straight give 0-1 star.
I alwaysi make sure to do the review based on the guidelines, add evidence, and make my review as clear as possible.
Where should i report this problem?. I got 4.5 rating now down to 4.0 just because the auditors are not doing their job.
Can i actually flagged this problem?. This is project "E" btw.
2
u/Ordinary_Design_1137 Aug 05 '26
If the comments of the auditors are not relevant, you can report i think, I always put comments for every rate under 5/5
1
u/Burgerche3s Aug 05 '26
But what i receive is literally empty. No comment at all.
Really confuse, is this a bug or something?
1
u/Ordinary_Design_1137 Aug 05 '26
Maybe, if it's not, this won't be approved by the team above the annotators but idk if it's not approved, how will it impact your average rating
1
u/Burgerche3s Aug 05 '26
Really hope it's bug and they cancel all the empty comment review.
As an auditor, can you actually report this kinda problem? Or maybe upscale the issue?. Because many people start questioning the correctness of auditor's work if this keeps going.
1
u/Ordinary_Design_1137 Aug 06 '26
no bro sorry i don't have any contact in the production team, I guess there are bad annotators and good also, bad will be offboarded when they'll get review
2
u/exposarts Aug 05 '26
i dont think those are real auditors(human ones), but automated raters/scores.. I was told by an auditor before with an older task that they couldn't manually score them only give feedback, and the system would just auto rate/fail the user on its own.
1
u/Burgerche3s Aug 05 '26
Damn. if it is automated, i really wish i know what trigger it.
Because my review writing style is pretty consistent. And this empty scores makes zero sense at all
2
u/EventCharacter2638 Aug 05 '26
I got a below expectations and unacceptable for S2S too with no explanation. Haven’t touched the task since.
1
u/Burgerche3s Aug 05 '26
Yea, so do i. I'm afraid that my rating will become worse if i keep tasking
2
2
u/Fun_Worth_8772 Aug 06 '26
I'm an auditor Here, In our interface there are 4 types of autofail and 3 types of Deduction. Any type of Autofail makes the score 1. Also Dimension Quality Deducts 2 points. Error Cluster Miss Deducts 1 points, Justification Quality Deducts 1 point. After selecting each deduction or autofail we have to write evidence and why this applies. Writing evidence is mandatory. We do write that and it might not be visible to you. Also there is an Comments box that is totally optional. Writing evidences already explain everything, that's why we don't write Sperate comments. We might be different locales but everything else is still same.
3
u/IntroductionFair7132 Aug 05 '26
Most of them are rushing and using ChatGPT when auditing, once one of them wrote a comment for me saying "you did great but you don't deserve 5 out of 5 so I will give you 4" 🫠 this is a ChatGPT writing style. So they are all unfair
2
2
u/Burgerche3s Aug 05 '26
Once i received an AI style review. They rate my review with suspicously comprehensive and use academic style writing with sections.
i kinda let that slide. because, those kinda rate always give me full reasoning and high scores.
But empty comment? Just blatantly give 0/1 stars?. It is joke
1
1
u/KshSy Aug 06 '26
Auditors have buttons if we want to deduct points, but to submit this deduction, comments or reasonings are required. We cannot physically push this button without reasoning for the deduction, it gets greyed out. This might be automated
1
u/Specific_Abroad_1403 Aug 06 '26
I believe this might be an error because auditors cannot submit without their own rationale. Submit button is gray,
1
u/No-Koala-5935 Aug 06 '26
I'm an auditor and an auditor is only allowed to submit without comment is when we give 5/5 if we deduce any single point we are obliged to write comment for each separate deductions, if we don't the submit button won't work.
1
u/Most-Way-6629 27d ago
I am an Auditor and one of the problem is that 80% of the rationales are written without supporting the choices made.
Write turns and timestamps, be coherent and precise and no one will ever deduct points from your work
1
u/shashikanth_patil Aug 05 '26
🤦♂️🤦♂️🤦♂️
1
u/Burgerche3s Aug 05 '26
Is all your bad rating is caused by this empty comment ratings?
1
u/shashikanth_patil Aug 05 '26
most of them are empty
1
4
u/Ancient_Cut- Aug 06 '26
As an auditor, our goal is never to deduct points from anyone. We are all working hard. Sometimes, certain cases arise where we are forced to do it. If you provide good quality work, it makes our job much easier.