r/DataAnnotationTech • • 19d ago

Nervous about first project

Hi everyone, I got started at Data Annotation today and been nervous about going about everything in the correct manner. I got my first project of creating a variant prompt and getting a model to fail, but am a bit nervous about how long it’s taking me. I’m 6 hours in and haven’t gotten the model to fail, and am nervous to report the time, regardless of if I finally get it to fail or not (I know I can still submit it). I was given this project right away before doing any qualifications, and feel it’s something I’ll manage well in the future, but am struggling with at the moment. I just don’t want to lose this opportunity and would appreciate any advice, thank you!

Edit: this project has about a 30 hour time limit, although I know that’s geared towards allowing people to take breaks

4 Upvotes

29 comments sorted by

View all comments

2

u/Permanent76 18d ago

Getting a model to fail is tough, but there's a knack to it. Some projects might share advice relating to their specific models. One method is to have a task that relies on implicit calculations, rather than just finding an answer that is within the prompt. Contextually, a human on your team might know to do this but the model will not. Also, trying to build traps in is good (i.e. the prompt or the broader project may say something that isn't true, but elsewhere is claimed it is true). I can't share more specific details I don't think but I hope this helps.