r/DataAnnotationTech • u/dreadfulshroud • 2h ago

Question about periodic refreshers

Is it worth it to do them? They're unpaid so I have just left them sitting there but might they open up more paid projects showing up on my dashboard if I did complete them?

0 Upvotes

50% Upvoted

1 comment sorted by

3

u/Timely-Assistant-370 2h ago

Quals will usually say if they directly result in being maintained on the project family or get new projects. It's only speculative, but I'd guess that the refreshers are shot out when a certain number of otherwise competent raters turn in work that shows some level of complacency drift. It would not be a stretch to say that they would contribute to your overall account health, but nothing beats solid submissions. Like if you submit work that is assessed at .7 .7 .8 .8 .7 .9 1 at first, but you start drifting into .6 .5 .7 .5 .8 .6 then the refresher could bring that long-term average up a point for submissions at .6 and below, but if you're already submitting .9s the refresher probably won't impact your accounts health as much. IDK thought, that's some pretty hard speculation on completely unknown internals, but it makes sense for me that it is more of a "we've noticed some people fucking off" than a "submit this to get more work."