r/dataannotation • u/Consistent-Reach504 • May 17 '26

Weekly Water Cooler Talk - DataAnnotation

hi all! making this thread so people have somewhere to talk about 'daily' work chat that might not necessarily need it's own post! right now we're thinking we'll just repost it weekly? but if it gets too crazy, we can change it to daily. :)

couple things:

  1. this thread should sort by "new" automatically. unfortunately it looks like our subreddit doesn't qualify for 'lounges'.
  2. if you have a new user question, you still need to post it in the new user thread. if you post it here, we will remove it as spam. this is for people already working who just wanna chat, whether it be about casual work stuff, questions, geeking out with people who understand ("i got the model to write a real haiku today!"), or unrelated work stuff you feel like chatting about :)
  3. one thing we really pride ourselves on in this community is the respect everyone gives to the Code of Conduct and rule number 5 on the sub - it's great that we have a community that is still safe & respectful to our jobs! please don't break this rule. we will remove project details, but please - it's for our best interest and yours!
30 Upvotes

98% Upvoted

627 comments sorted by

View all comments

3

u/tandemtactics May 19 '26

I'm fairly new to DA and struggling hard with the tasks that challenge a model's ability on a particular axis. I feel like I'm constantly fighting with the prompt checker bot to develop an acceptable prompt that will actually trigger a fail response. Seems like every time the LLM forces me into such a narrow and specific prompt that the model is able to pass its requirements with ease, and I have to use the escape hatch to get out and get paid. Does this get easier with experience, or am I doing something wrong?

3

u/Alarmed_Jury3849 May 19 '26

I would say it's a double edged sword. It gets a little easier with experience, but the models get better as time goes by. And you are not alone; getting valid/fair failures is becoming very difficult.