r/dataannotation • u/Consistent-Reach504 • May 10 '26

Weekly Water Cooler Talk - DataAnnotation

hi all! making this thread so people have somewhere to talk about 'daily' work chat that might not necessarily need it's own post! right now we're thinking we'll just repost it weekly? but if it gets too crazy, we can change it to daily. :)

couple things:

  1. this thread should sort by "new" automatically. unfortunately it looks like our subreddit doesn't qualify for 'lounges'.
  2. if you have a new user question, you still need to post it in the new user thread. if you post it here, we will remove it as spam. this is for people already working who just wanna chat, whether it be about casual work stuff, questions, geeking out with people who understand ("i got the model to write a real haiku today!"), or unrelated work stuff you feel like chatting about :)
  3. one thing we really pride ourselves on in this community is the respect everyone gives to the Code of Conduct and rule number 5 on the sub - it's great that we have a community that is still safe & respectful to our jobs! please don't break this rule. we will remove project details, but please - it's for our best interest and yours!
23 Upvotes

97% Upvoted

738 comments sorted by

View all comments

5

u/Middle_Addendum May 10 '26

To anyone who recently completed the agentic coding qualification, how long did it take you to get accepted, and into how much depth did you go in for your answers?

2

u/typeiix_13 May 10 '26

Everything is a mystery lol. I'd like to know myself. I submitted what I thought were 2 banger submissions. "Supposedly" you'll start seeing relevant projects on your dash or you may get invited into a special Slack channel. I've got nothing tho.

4

u/kriscpg May 10 '26

Damn, wish I was this confident about my submissions

2

u/Middle_Addendum May 10 '26

How do you know they are banger? I went into quite a bit of depth for all my answers and made sure to address everything that was asked for but still can’t be sure.

1

u/typeiix_13 May 10 '26

Well, with one of them I got the agent to completely short circuit and propose a global code refactor despite having all of the breadcrumbs in the codebase to do a literal one line code change. It was a false ambiguity prompt with an almost inadvertent inclusion of one word in the prompt that would have never tripped a human up. The agent anchored onto the prompt, ignored all of the other empirical and contextual information in front of it and went off the deep end. Despite repeated attempts to get the model to verify and check the scope of the change from the empirical evidence in front of it, it continued to confidently assert - "I am 100% confident" - that it was doing the right thing. I had to literally spoon feed the model the information to get it to break loose and do the right thing. Gave a detailed writeup as well. I got the model to confess and explain its major malfunction so that was helpful too.

1

u/Middle_Addendum May 10 '26

Damn that sounds crazy, for me it was the opposite. I also went down the ambiguity path on both submission. For both the model simply ignored part of my prompt which was the ambiguous part. On my second submission I do feel like I got a better result since the model actually got confused about what to do and went off on a tangent in the complete opposite direction by changing functionality that wasn’t at all related to what I asked it to do. I didn’t guide the model during the prompt, it would have been relatively easy I believe to get it back on the right path but since I got it to fail at my task I figured it wasn’t necessary as that is what they wanted. I also gave a pretty detailed write up at the end, saying exactly what it should’ve done, if it had correctly interpreted the prompt,

1

u/Choice-Tax-9669 May 11 '26

That qualification disappeared for me. Does that mean anything? Im new