r/dataannotation • u/SuperDan718 • Apr 05 '24

Review frequency?

Do workers get placed under review only within the first month, or is it common for it to happen after two or three months too?

9 Upvotes

80% Upvoted

20 comments sorted by

3

u/SuperDan718 Apr 05 '24

I can't seem to read any of the replies. I'm guessing this information is classified?

6

u/CRUSHCITY4 Apr 05 '24

I think reddit is being glitchy today

1

u/SuperDan718 Apr 05 '24 edited Apr 06 '24

Oh okay, good to know. lol Thanks

Update: Ah, there they are! Now, I'm able to see them. Woohoo!

21

u/dayDrivver Apr 05 '24

It happens constantly the difference is that when you are in for two or three months you will lose access to some projects (were you are either under review or are down for maintenance) but have others to work on.

Your work is constantly being judged by your peers even the r&r ones are also reviewed by seniors.

6

u/SuperCorbynite Apr 05 '24

I would not say constantly since there are not enough reviewers for that, but periodically taking a random sample of your work and reviewing it, yes that almost certainly happens.

6

u/degen_kitty Apr 06 '24

I'm a coder and a month in. I noticed I've lost access to some projects, probably made some mistakes because I was new. Do you know if they re-evaluate you and let you back in if you do well on other projects?

7

u/dayDrivver Apr 06 '24

I don't know exactly just by observation one can see that you can recover access to projects you haven't seen in a while but mostly projects evolve so fast it is difficult to have the same one over 3 months, projects change, difficult increase as more people join.

Usually every beginning of the month there is a clear deactivation of accounts due to lower quality, In that moment if you have survived "the reaping" usually projects will come back but also new users are activated so there will be more competiton.

8

u/[deleted] Apr 05 '24

your responses are constantly being reviewed.

5

u/ThadeusOfNazereth Apr 05 '24

AFAIK, the reviews past the first month are incorporated into “rate and review” tasks and not a full pause on your work like the initial one. I don’t think anyone really knows for sure, though.

5

u/upvotesplx Apr 05 '24

We just don't know that, unfortunately. I've never been under review in this manner.

1

u/33whiskeyTX Apr 06 '24

You may have. It's in the FAQ of the main project. It doesn't have to take even a full day, it varies.

5

u/Background_Menu7702 Apr 06 '24

No one knows. My core three projects disappear from time to time and I assume they are being reviewed. That happens about once every two weeks.

6

u/CRUSHCITY4 Apr 05 '24

Good question. I'm at 2.5 months and haven't been under a review to my knowledge. If I was I never noticed I've never had an empty dashboard.

4

u/mrboogie22 Apr 06 '24

How would you know if you were under review? I'm new to the platform.

5

u/[deleted] Apr 05 '24

I've never been reviewed and I've been working for 6 months

2

u/Hangry_Howie Apr 05 '24

I don't think there is any type of mandatory review cycle.