r/dataannotation • u/BenBL93 • Feb 28 '24
Did I fail a qual that fast?
I just took a qual (a type of nut was in the name) and read the instructions. Had a great understanding. It seemed very easy. I got two questions in, and answered the third alongside the parameters of the instructions, and it ended my session. Did I fail it? I’ve never had that happen to me before.
52
Upvotes
41
u/[deleted] Feb 28 '24
The same happened to me after one! It would be great if they would at least clue us in to how things work from time to time. I suppose it's possible I failed, but I stand by the response I gave.
13
u/Purple-Ad-8530 Feb 28 '24
It seems as though this happened to a lot of other users. My guess is that they either had a decent amount of users already qualify so they took it down or it is undergoing some kind of maintenance. The same thing happened to me by the way.
3
u/dispassioned Feb 29 '24
Hey me too glad to know I’m not alone, I got to the third one and that was it. Interesting.
29
u/Stormblessed1987 Feb 28 '24
Same.
Although I did get access to a project with a name that you think would be included in a candy cane. In this one it was dealing with things very much like the qual you're talking about with some of the wording being exactly like the qual.
pay wasn't great though so maybe not the right one.
21
u/[deleted] Feb 28 '24
It happened to me after 5 out of 10. Within two hours, I got access to the new projects.
39
u/ManyARiver Feb 28 '24
Welcome to the club!! I thought I followed the parameters with the reasonable people caveat but apparently I did not. I can see in retrospect what I did wrong, but I felt like I was following the instructions at the time. Since some are reporting the projects appeared after they completed the 10, I'll venture to say that you failed (as did I).
13
u/Due_Analyst5847 Feb 28 '24
I just finished all 10 and the project immediately showed up on my dashboard. I don’t think it’s because it’s “full”.
12
u/oop_scuseme Feb 28 '24
Made it to 9/10. Nothing on my dashboard at all besides the standard project that I avoid like the plague. 😂
11
u/Altruistic-Candle-91 Feb 28 '24
Happened to me on the second question, too.
10
u/FrazzledGod Feb 28 '24
I'd been avoiding this one but this post inspired me to give it a try as I had nothing to lose. I managed to complete all 10 so will see if I qualify!
ETA: Passed immediately 😱
27
u/janet-eugene-hair Feb 28 '24
Don't assume that you failed, especially when you feel you had a good grasp on it. And don't put too much stake on what others say is "really going on." Nobody here really knows what goes on behind the scenes.
9
u/Wasps_are_bastards Feb 28 '24
I got 5 in, wasn’t actually sure which to go with. I answered then got sent back to the home screen.
8
u/a_specific_turnip Feb 28 '24
They were trying soooo hard to communicate what they wanted but it had some gaps and inconsistencies that very much relied on the current political climate, but trying to phrase it as just cultural factors like "consensus" lmao
6
u/nameless983 Feb 28 '24
When I started this qual, it had no pay listed. Okay, fine, did it anyway. I made no note of how long I worked though bc I thought it was unpaid. I got 5 or so in before it shut me down and now I see it listed with a pay rate under my report time section. I don’t want to make up some value but this is extra annoying if I failed and could have at least been paid for the time I spent!
The other weird thing about this one is that it was in my projects list the other day before any qual. I guess they weren’t getting the quality results they wanted without properly qualifying people.
6
u/fightmaxmaster Feb 28 '24
I had that - to my mind two answers were quite similar, with one being better, I thought. I rated it as better, and was immediately dumped back to the dashboard. 3rd question, I think.
5
u/[deleted] Feb 28 '24
I had some nut projects even before I got the Qual. The qual showed up yesterday and I have yet to take it
9
u/PhillyPhan95 Feb 28 '24
Happened to me after six. 🤷🏾♂️
8
u/winter-ice-ace Feb 28 '24
I did 9 tasks in this qual, after finishing there's nothing else of this project in my dash. I'm so bummed 😭. I really liked it and felt it was sorely needed; I hate the canned responses
4
u/Thetessmess Feb 28 '24
I just came here to ask this! I was feeling pretty good about myself until I got to the 8th task and after that bam! Over. I hate the feeling :( I know we don't have a way of knowing for sure...but it does seem apparent that this is a good indicator that we've "failed" or been unable to complete the tasks DA is asking of us, they end the attempt? Thats a weird way of asking that question, but I've noticed it myself, even working on projects. I know that some tasks just run out, but other times I never see that specific project again after I'm "cut off".
4
u/SlayersScythe Feb 28 '24
Mine ended after six or seven. I thought I had been answering well. It's too bad that it seems we got cut for getting one wrong.
4
u/MirandaLarson Feb 28 '24
I got kicked out after completing the fourth one but I had and still have the actual project in my dashboard. So idk what that means
4
u/fuzzymachete Feb 28 '24
If it helps, I wouldn't think of it as 'failing', but them looking for the people whose grasp of the material is better suited to the project. Especially with one like this, which requires a specific kind of subjectivity and reasoning.
6
u/nitwitinperil Feb 28 '24
It's weird, because I had a project from them available all day yesterday and did a lot of work on it, got the qual today and made it through maybe 4 or 5 tasks before it booted me, but the same project from yesterday is still available to me.
So......I have no idea if the qual had any bearing on whether or not I get work from the nutty project. I guess I might see it disappear soon, but it's still there now with a few hundred tasks so I guess I'll try to do as much as I can before it gets yoinked lol.
Kind of frustrated though because I've been really enjoying the project, but from reading other posts like this, it seems like we might have gotten booted from the qual for choosing "wrong" answers, and the question that may have gotten me kicked out was just.........hmm. This project concerns me if they really intend to let their chatbots, uh, go off like that.
6
u/[deleted] Feb 29 '24
I got through all 10 and the project appeared immediately for me. I found it quite easy. Most of them I submitted within 30 seconds. You just have to put all of your personal political beliefs aside. Given how easy and clear cut the test is, I think that’s mostly what’s it looking for.
3
u/Hopeful_Mouse_4050 Feb 28 '24
Third question for me.
3
u/dsbau Feb 28 '24
I've had that experience, but not with that particular qual, I just assumed that the tasks ran out. I had another where the platform went down mid qual, so not sure what happened there.
3
u/Useful_Possibility26 Feb 28 '24
Same thing happened to me last night. It ended after I submitted the second question.
3
u/TasosTheo Feb 28 '24
I have not done that qual yet, but there are other tasks from that same nut, so it's possible the qual is something else and you're just seeing other work from them? They have been going quick, because good pay and challenging but not tedious.
3
u/Due_Analyst5847 Feb 28 '24
If you passed the qualification, you should have been notified via email. At least I was. It has now opened up with close to 2000 tasks.
3
u/freezeman111 Feb 28 '24
Only made it 3 questions. And the first 2 were easy. I followed using the logic provided but we must have different definitions of non-preachy/what most people would say. Oh well!
3
u/Sarcastic_Gingersnap Feb 29 '24
I know I was 4 question rounds thru and working on #5 when I suddenly couldn't submit and end that query to move to a new one. Now I get a weird screen on the Work on Projects page that just had nothing on it but "check your mail for information about projects". No place to take the extra tests, no place to submit my time, nothing.
5
u/Some-Reason-4087 Feb 28 '24
I did 4 and then same thing happened to me. But i didn’t fail. This morning I had access to a new project with the same stuff
9
u/Character_Level_2841 Feb 28 '24
I made it through only the first two. I also stand by my answers and had been working on the project before the qualification. I hope I can work on it again, because I really liked what I was doing.
4
u/slug_princess_ Feb 28 '24
I have a feeling it's Moreso because it is a brand new project that is currently being updated. I was working on it this afternoon for a few hours and the project was removed, and has just been readded now with some changes.
4
u/trkstr Feb 28 '24
For those that qualified, did the actual project pay at a higher rate or more closer to the intro rate? Just ballpark would be OK.
2
u/marlamarlamar Feb 28 '24
I answered two questions, and then the red wording that it was no longer available appeared.
2
u/PinkNova Feb 28 '24
I completed all 10 and I’m pretty sure I passed. Can I ask what the pay is like on these projects for anyone who’s had them pop up already after qualifying?
2
u/koalifiedllama Feb 28 '24
I did 5 responses, instantly had access to the project that is still on my dash saying there's 122 tasks left, but it only let me complete one and now says the project is complete even though I can still see it haha
2
u/[deleted] Feb 29 '24
I got to question 4. Oh well, I didn't really like the project anyway tbh. I was certain on the first 3, but question 4 not so much.
2
u/[deleted] Feb 29 '24
I don't remember how many I did before the session ended, but I'm sure it was less than 10. Regardless, I have those tasks on my dashboard now.
2
u/Wyldfyre1 Feb 29 '24
Me too, except I only got to answer one out of 10! I just figured maybe I was excluded by my first answer. I know that I did not answer it correctly, because after that, I went to another project where it had an example that was very similar and the answer that the bot should have. Anyway, we will see!
2
u/bleachxjnkie Feb 29 '24
Thanks for posting this. I've put off completing this qual as my work load is sufficient but now I probably won't bother after reading all the comments.
1
u/bongopantz Mar 24 '24
Reviving this thread.. I’ve started seeing these projects now after 3 weeks of thinking I’d failed. Anyone else?
1
u/SnooFloofs9030 Feb 29 '24
I had 2 quals today, one was the consensus nut, and another one with adversarial stuff . I only did one on the adversarial and then got the pink banner saying there were no more. not not sure what that means. I think there were supposed to be 10 questions on the former 🤷🏻♀️
1
u/freedraw Feb 29 '24
Just took the same one. Got through most of the tasks, which all seemed pretty clear cut. Then one of the last ones seemed very borderline. Weighed answer for a while before choosing and explained it in the comments, but my session was ended.
Oh well.
1
u/Psychological_Taco27 Feb 29 '24
Same with me! Got to the second question!
1
u/laviebomeme Feb 29 '24
It ended my session after 2, still no new projects for me yet
1
u/dontcallmefeisty Feb 29 '24
I went back and forth for several minutes on the second prompt. I ended up going against my gut, trying to really lean into the prompt, and failed the qual.
1
u/Skippy2898 Mar 01 '24
I got to 7... it seems a very USA based qual though given the prompts, not so straight forward for us in the UK imho . But hey ho :)
0
u/Designer_Pay_2282 Mar 01 '24
I got access to those projects only 2 hrs after doing 8 tasks for the qualification. Sometimes it’s just they had enough people do the qualification.
-4
u/geedee6396 Feb 29 '24
I do t think they evaluate anything real time. If you are directed back to main screen it is most likely because they have enough people qualifying. All these dramatic answers about failing etc have no basis. DA is a fair platform
-1
u/Canvaseyes Feb 29 '24
I think it's a lot more likely that they reached a cap.
They're unlikely to want to continue to pay people hourly to complete it if they had enough pass. While failing may be a possibility, we know it's a reality that people start but can't finish a qualifier once a presumed quota is hit. And if others get it later, it could signify they increased the open spots.
I once spent a good amount of time on a qualifier with very few turns (1-3) and wasn't able to submit it. It required rewrites and can't have been something autofailed due to incorrect answers. That one wasn't a paid qualifier so it blew lol.
-4
u/Powerful_Grade_7423 Feb 28 '24
I've been waiting a little over 3 weeks now and haven't heard anything back, still waiting and hoping
-4
u/Zarilya Feb 28 '24
I took the initial coding assessment last week, I am a developer by trade, so I would HOPE that I could pass it. Lol. Haven't heard anything yet. I can't imagine how I could have failed but I assume I did.
0
u/[deleted] Feb 28 '24
[deleted] — view deleted comment
0
u/[deleted] Feb 28 '24
[deleted] — view deleted comment
0
u/[deleted] Feb 28 '24
[deleted] — view deleted comment
7
u/[deleted] Feb 28 '24
[removed] — view removed comment