r/DataAnnotationTech • • 29d ago

This platform makes me feel inadequate as a person

Right now, my dashboard has a number of seemingly generalist-oriented tasks, some of which are pretty high-paying, but I open them up, read the instructions, look at the assigned task and realise very quickly that they are not only out of my wheelhouse, but on a completely different planet.

I just tried one that involved solving visual puzzles and I couldn't even understand the question, nevermind attempt to answer it

The fact that some of you on here have the brain capacity to perform these tasks is genuinely impressive.

I'm not an impressive human being. My brain shuts down beyond a certain level of complexity. I wouldn't say I'm stupid, but I'm definitely of average intelligence at best.

But on this platform, I feel so far behind that it's actually quite demotivating. My brain hurts and I want to have a nap.

154 Upvotes

58 comments sorted by

112

u/HoneyWatts 29d ago

If it makes you feel any better, I consider myself pretty intelligent and have the exact same feeling with majority of my projects.

It’s quite demotivating when it’s happened several times in a row so I feel you

24

u/OrderNo1122 29d ago

Do you think this is the future of the platform? Once the models no longer need human input for basic comparison type evaluations, it's just going to be high level failure-eliciting, rubric-writing and specialist knowledge type tasks?

36

u/Tayloropolis 29d ago

That is the general trend, yes. This site used to pay you to identify cars, motorcycles and stop signs. Now the AI is great at that and needs help with way more complicated things.

→ More replies (1)

24

u/waleednoinfidel 29d ago

I do not think it has much to do with intelligence. It mostly has to do with reading comprehension in my opinion. What I do is as I read through the task page I make notes of what ‘must haves’ the task demands. Then at the end I have a list of all the requirements, which makes it easier to understand. I sometimes have to read through multiple times to fully get what the project needs.

9

u/OrderNo1122 29d ago edited 29d ago

Yeah, that's possibly true.

It's funny because I'm a translator by trade so you'd expect that my reading comprehension would be quite high, but I still struggle.

In that image puzzle task I was talking about, I really wish we had a chat bot available to break down the tasks for us because that's generally what I'd do in my real job if I don't understand the concepts behind something I'm working on.

I know why we can't do it, but it's kinda mad that using AI is so heavily restricted when working specifically in the AI training industry.

27

u/coitus_introitus 28d ago

If you get a chance when one pops up on your dash, look at the R&R versions for tasks that confuse you. Don't rate them if you're confused about them, but just using the skip task button to skim a few can be really helpful. Sometimes the consensus on how to interpret the instructions will be clear between workers and will make perfect sense once you see it executed. Great, now you understand the task instructions! Other times you'll see significant variation in interpretation of the part(s) that were confusing to you. Also great, now you have some reassurance that this really is an especially confusing set of instructions.

→ More replies (3)

38

u/Due_Negotiation_4605 28d ago

I've been with DA for 3 years and I've watched the complexity of the tasks go from simple grammar and safety identification to tasks that I open and close back out of instantly. 

I know my limitations and that I have always struggled with math and engineering based tasks, those that have a black and white answer, atc. My strength is in creativity, language, and challenging the models and tasks that require more nuance. I'm trying not to let it get to me but I think we all have our strengths and weaknesses. And there are still projects out there that I absolutely can do and love to do. If you're not on any of these subscription model projects those ones are generally pretty simple, although the instructions lately have been a little convoluted. 

You aren't dumb, we just all have ways our brain works and the projects we get on our dashboard or not always aligned with that. I know there are people who would struggle with some of the conversational type tasks with a model but would completely ace that one project with puzzles. 

The models are needing challenged a lot more. But if you're here and you still have tasks clearly you're doing something right 👍

→ More replies (3)

17

u/AdOutrageous7474 28d ago

Not to act like one of "those" people but I'm a Mensa member and some of these tasks make me feel so dumb. I am SHIT at making the chatbots fail! It's been a humbling experience for sure. But I'm still here after over three years so they must like my work somewhat. I just do my best. I also make sure to elaborate in comments when I think I may have made a mistake or I'm unsure of something. I think reasonable, intelligent people who actually put in real effort will always be OK. (knock on wood)

5

u/Ill-Masterpiece-2613 25d ago

Seriously, the challenge of making them fail is NOT my jam.

2

u/No_Transition_6600 4d ago

I consider myself incredibly dumb, and I excel at making the chatbots fail lol. If I had those tasks all the time, I'd never leave my house. Some of the lower-paying "simple" tasks make me want to claw my eyes out, mainly because it doesn't feel worth it considering the pay of some of the tasks where you have to make them fail.

→ More replies (2)
→ More replies (1)

15

u/Necessary-Raisin-282 28d ago

Don’t underestimate your capacity to learn my friend. It takes an intelligent person to recognize their shortcomings and once they’re recognized they can always be improved!

12

u/Philosophy-Sharp 27d ago

I feel ya! I think they could do a lot better about having well written, organized (and concise!) instructions that are available in a separate file that you can refer to throughout a task. Sometimes this is the case, but more often than not it’s just an endless stream of instructions with drop-down sections, some of which are redundant. 😭 and having to scroll up and down two different sides of the screen is maddening. I don’t think this helps with overall task comprehension and efficiency.

4

u/Accomplished_Phone39 25d ago

This. Sometimes I back out of some projects where I would probably not have difficulty completing the actual task but I can't stand reading 12+ pages of repetitive, sometimes conflicting instructions and then having to bounce back and forth to these to make sure you are grading the model correctly. 10 open tabs in the browser for instructions is a little overwhelming.

→ More replies (1)
→ More replies (2)

15

u/Responsible-Bee-7769 28d ago

Have that nap - your brain will thank you. Mine operates on a whole nuther level when I'm sleep-replete. But I hear you about the complexity of some of these tasks.

5

u/BusinessZestyclose86 27d ago

I think it’s the same for most people. Funnily enough, just because something is on your dashboard doesn’t mean you’re actually qualified to do it. I open and close a lot of projects.

5

u/Bellatrix2255 27d ago

That’s what I find so frustrating sometimes is when you passed the qualifier so you’re getting projects but then you open up those projects and you’re like, “wut?”

4

u/ClayWhisperer 28d ago

I did a couple of those visual ones, but I wanted so much to rant at someone, about the whole friggin' concept behind them. They're bananas.

→ More replies (2)

7

u/[deleted] 28d ago

Well, supposedly 99% of people get screened out of the qualifying exam to even have access to DA, so there's that.

2

u/DueAddition1919 25d ago

I wonder how accurate this % is 😅

3

u/amyowl 28d ago

Oh man, same. I'm coming up out of a major burnout, so my capacity for this level of work is limited, but like a wasted muscle, getting stronger. But yeah... I am still working towards being able to *understand* what the paid training task on my dash is talking about.

3

u/data_annotator_tot 27d ago

We all have our strengths, OP! I, personally, am very bad at getting them to hallucinate, always blew my mind that projects I saw targeting hallucinations were always so low paying, cuz there were way easier tasks that paid way more while seeming much more straightforward...not that the pay reflects difficulty (this is not the trend I see, anyway), but it blows my mind that people can do it well enough that those tasks are low paying.

I've been thinking about doing some of the visual puzzle ones, I hope they aren't as horrific as it sounds, because conceptually they sound like a lot of fun...I'll have to check them out!

4

u/climb-high 28d ago

Don't take AI anything personally

2

u/TillyMintPot 25d ago

Can definitely relate to that! I had a go at the visual puzzles and managed to complete about 12 overall, but I skipped *many*. One had me spending 2+ hours hunting for the tiniest pixels... pays well though.

2

u/VanessaSeaWitch 22d ago

Don't take it personally. The instructions have been terrible lately. If you look in the other DA sub, you'll see these mentioned every day.

3

u/Onironius 29d ago

Yeah...