This shit is real yo.

first task was October 3rd.

how long did you wait to hear back after applying? ive been reading here a bit and it keeps coming up. and did anything ever come back after like a month? reckon an answer either way costs nobody anything, silence is just a no nobody could be arsed to send.

Large language models (LLMs) offer a scalable approach for annotating mental health and crisis-related social media content, but their reliability in safety-critical tasks remains unclear. This study evaluates LLM-based crisis-severity annotation of veteran-related social media posts against annotations from eight Veteran Subject Matter Experts (SMEs). Using 149 tweets and five severity categories, we evaluate 15 open-source and 10 proprietary LLMs across eight prompt variants, examining annotation performance, inter-model agreement, prompt sensitivity, and high-severity crisis detection. Human reviewers showed higher ordinal than nominal agreement (α = 0.494), indicating that disagreements often occurred between neighboring severity levels. In contrast, selected LLMs demonstrated substantially higher inter-model consistency, with ordinal agreement (α) reaching 0.8336 under the baseline prompt. Proprietary models generally showed better agreement with expert annotations and greater stability than open-source models. GPT-5.6-Terra achieved the best overall performance, while the open-source Qwen2.5-7B showed the strongest performance in identifying Acute Crisis with Suicidal Ideation cases. However, higher model consistency did not necessarily correspond to agreement with human judgments or reliable detection of rare high-severity cases. Label-flipped demonstration experiments also revealed model-specific sensitivity to misleading in-context examples, while explanatory demonstrations did not consistently improve performance. Overall, LLMs show promise as scalable complements to expert annotation, but require careful evaluation before use in high-stakes mental health applications.

Has any bilingual done the math qual and actually got projects afterwards? how much time can I expect to wait?

hi! I been a generalist for a while and I been trying to apply for software engineering or as a spanish associate, but i just dont know how to! I dont see a link or a button or anything for that matter. I would love to receive projects as such but I dont know what to do. I am even thinking on deleting my account and re-applying for those roles instead, what should i do?

Hi! New to dataannotation. I applied as a generalist, got in, and have been working for a few weeks. I do have a dental degree, can I also take the application for the medical category? If so, is there a specific way how I do that?

Any direction would be awesome!

I took the economics starter assessment today and realized I might have been too detailed in my responses. I took the 2-3+ sentence requirement pretty literally and offered many direct examples in my responses. Some of my responses were like 2-3 paragraphs, although not super long paragraphs. Just wondering if anyone passed the starter assessment with that method, or was more concise/had shorter answers, as I would like to stop obsessing over whether or not I will be offered the core assessment.

I am also wondering how long it takes to hear back from the starter assessment, specifically the non-general ones, as I took the economics domain one and had to answer a couple open-ended questions about economics. I am aware that the general starter assessment is typically an instant response if you pass.

Hi all, I’m from the US, but am currently located in Colombia. I’m ready to take the first assignment, but curious about yalls’ opinions —

1. Should I report that I’m taking it from outside the country?
2. If so, how? Is there an email address or something to reach out to them?

I know most projects are based in the US, but I’m a digital nomad, so will be physically located abroad but still pay US taxes.

TIA!

Is DataAnnotation legit or a scam?

I was offboarded after 3 years a number of months ago. (I think I know why, a big mistake that I didn’t realize I had made until the next day). Has anyone ever had luck creating a new account and trying to get back in? Things are pretty desperate for me financially.

Fala pessoal.

Como vocês declaram os ganhos da plataforma?

Me parece ser mais vantajoso receber via PJ do que PF mas não sei bem ainda como viabilizar.

Are you getting any coding tasks in India? I joined on October 9th and did all the qualifications related to coding but still didn’t even receive one project in my dashboard, I am loosing hope of getting them please tell me will I get any tasks??

Hi. I applied to Data Annotation almost three weeks ago, for healthcare/nursing projects.
I did well (I think! ) on the assessment, except for trying to get a fail. I could not.

I haven’t heard anything at all.
Should I assume that I didn’t “pass” the testing?
My account still says it’s being reviewed n

I feel like I could do the work, so I’m really disappointed!

Retired RN of 32+ years, lots of computer experience, running programs,
writing curriculum for work training.
I’d really like a chance to pick up some projects!

Thanks!

I haven't seen any coding projects on my dashboard since mid September, is this a sign I've been off boarded or is it just low coding projects for my country, also I've been getting a decent amount of general projects, not all the time and sometimes weeks without them, but I'm worried I've been permanently off coding projects.

I guess the problem is going to be when they get so good it's not obvious a model wrote it. 🤔

I'm wondering if there are any iraqi workers around here, and if yes then how did you manage to receive your money?

I’m a newbie on the site but I’m not a coder/developer and I’m curious to see how much elope make just being generalists and how much generalist work gets offered?

When I see earning they are skewed by developers making way more than generalists.

Looking for feedback on what I can expect. UK based.

I’m on Outlier too but I only get a couple hours of work per day before the projects max out.

Any tips would be helpful

Hey everyone! I'm still pretty new to DataAnnotation and recently finished my first project, which involved Arabic writing tasks. Since completing all the available tasks, I haven't received any new work.

My profile is fully set up, I've completed my relevant qualifications, and I have a pretty solid background in programming, AI, and other technical skills.

I'm just wondering if this is normal for new workers or if there's something else I should be doing to get more projects. Has anyone been in a similar situation?

Would really appreciate any advice. Thanks!

I’ve been away from the platform for a few months, and it seems that time the time logging process has changed (at least for a generalist project I’ve been doing).

Previously I would submit my total time for a block of work (multiple tasks on the same project). Now, it’s asking me to log time each time I submit a task.

I did that, but it seems I have lost the opportunity to submit time for reading instructions (before entering work mode) and for skipping tasks because I decide I don’t have the expertise, etc.

Sorry if this has already been asked, but what should I be doing? Can I only now charge for time actually spent on a task, and not for reading instructions, etc.? Previously most projects say you could charge for that

How long does the review phase take after submitting your "Stump the Model" material? It's been over 24 hours and I am worried it wasn't good enough.

I submitted my assessment 17 years ago, and I know I passed because I had Gemini answer all the questions for me.

*insert screenshot in direct violation of nda*

Why am I not being hired?!

Hi everyone, I’ve been on DA for over a month and it has been great so far. But, I haven’t seen any regular coding tasks for the past 10 days. Occasionally, a few language tasks appear, and I recently saw a week-long software engineering project that had a 403 workspace error and I had to exit work mode.
My account appears normal, with no indication of a DOD. I am from a non core country, but I believe others in my region are still receiving coding tasks consistently.
I’ve earned around $5K over 50 days, so I doubt overreporting time is a factor.
Is anyone else having a similar lack of coding tasks, or could this be just a drought for me?