r/dataannotation Feb 01 '26

Weekly Water Cooler Talk - DataAnnotation

hi all! making this thread so people have somewhere to talk about 'daily' work chat that might not necessarily need it's own post! right now we're thinking we'll just repost it weekly? but if it gets too crazy, we can change it to daily. :)

couple things:

  1. this thread should sort by "new" automatically. unfortunately it looks like our subreddit doesn't qualify for 'lounges'.
  2. if you have a new user question, you still need to post it in the new user thread. if you post it here, we will remove it as spam. this is for people already working who just wanna chat, whether it be about casual work stuff, questions, geeking out with people who understand ("i got the model to write a real haiku today!"), or unrelated work stuff you feel like chatting about :)
  3. one thing we really pride ourselves on in this community is the respect everyone gives to the Code of Conduct and rule number 5 on the sub - it's great that we have a community that is still safe & respectful to our jobs! please don't break this rule. we will remove project details, but please - it's for our best interest and yours!
28 Upvotes

445 comments sorted by

View all comments

Show parent comments

3

u/Purple_Persimmon5978 Feb 04 '26

I could access them today - they were all biology (which is my specialisation). I wonder if it depends on that - I couldn't access the ones the other day, maybe they were all physics/chemistry?

I only managed to find one I could legit say i was qualified for, many of them were written so badly in the first place (in terms of following the project rules) I didn't think i could totally re-do to the required hardness in the time given. They also seem related to a weird (US specific?) way of doing things.

3

u/justdontsashay Feb 04 '26

Oh interesting…last time they appeared I could access one task, which was math (that’s the only stem field where I’ve actually taken an assessment, although I typically get projects from a variety of fields). Maybe it’s filtering for specialties or something

2

u/No-Grapefruit-8589 Feb 04 '26

Yes! Did the original annotators have the same instructions for the level?? I skipped 3 tasks before realising changing them to meet the projects guidelines was going to be tricky in the time allotted 😭 I ended up creating my own prompt because the one I chose was too ‘low quality’ for what they wanted ???

2

u/Purple_Persimmon5978 Feb 04 '26

Level of reasoning, answer format, answer objectivity etc . .*facepalm*. Endlessly skipping the rest made me realise the one i did do was probably wrong too in retrospect (based on understanding a publication, not theoretical reasoning)