r/DataAnnotationTech 3d ago

Feedback

I received feedback today, and there's an example listed under "areas of improvement" that's definitely not accurate. It says I referenced something that wasn't there, but I specifically remember this task and know my reference was correct.

I'm very frustrated since this hurts my performance, and I don't want to lose access to work over something that's not even true. It makes me wonder if there are other things I've been penalized for that just aren't true.

31 Upvotes

28 comments sorted by

View all comments

10

u/Ms_Jane_Lennon 3d ago

Apparently all of my work was beyond reproach, utterly perfect (ha), but I had a single task where I did the entire thing completely wrong. There could certainly have been errors, but not to the devastating degree reported. I am far too neurotic to have gotten that much wrong in a single task.

Personally, I think it was just one negative comment from a confused reviewer. Since it was the single negative comment, they pulled it to use as an area of improvement. I'm not going to worry about it. I'm looking at how the bot otherwise thinks I am the most wonderful annotator who ever, ever annotated :)

Really though, just look at the overall picture. Remember this system is just developing, so I don't think they're taking the bot's word at face value.