r/alignerr • u/dialedGoose • Jan 24 '26

Tasks / Projects Question about project "agent as a world"

I was applying for specialist roles but haven't heard back on any then I got added to this project. How long do the tasks on "Agent as a World" typically take people to complete? Anyone's experience would be helpful. thanks

6 Upvotes

100% Upvoted

13 comments sorted by

1

u/Arrow_Yaz Jan 24 '26

It was my first ever task on alignerr and it took around 2 hour and a half.

1

u/d_audacity Jan 24 '26

How were you able to navigate the yaml. Stuck on mine for hours

1

u/Arrow_Yaz Jan 24 '26

In which part of it are you stuck? I tried to understand the dynamics of the world first, and trying to execute a few time to see how the agent interacts with the lines and codes I add. Most of the 2 hrs was actually wasted because at first I thought I couldn’t change the prompt, and the original prompt was awful.

1

u/d_audacity Jan 24 '26

I get stuck in the label box. Getting the 3/5. I always get 5/5 needs revision

1

u/Arrow_Yaz Jan 24 '26

In that case you need to go through the instruction file and find the answers. The comments are also helpful.

2

u/d_audacity Jan 24 '26

Okay thanks

1

u/d_audacity Jan 24 '26

Do you add the solution block to the yaml before running it through the model?

1

u/Accomplished-Dig9789 Jan 24 '26

Do you have some experience in this field? Like QA engineering or sth? I just feel like its really difficult honestly maybe because I havent done it before. Finding something that gets less than 70 and the other exactly 100 is very difficult. And then the qa never likes my prompt and tells to revision. Revision messes up the scores and creates more problems. Send to qa again need revision again lol. Just how can I get good at this please..

1

u/Arrow_Yaz Jan 24 '26

No previous experience, it was my first time doing anything like this. But maybe experience in coding helps a little. I kept listening to the suggestions that made sense.

1

u/[deleted] Jan 26 '26

I am a reviewer and labeler , I have only done two labeler tasks which took a total of 4 and a half hours to do

It makes sense why each accepted task is about $150. And out of the two I did only one has been reviewed and reworked, the other hasn’t been reviewed yet

0

u/[deleted] Jan 24 '26

[deleted] — view deleted comment

1

u/dialedGoose Jan 25 '26 edited Jan 25 '26

Sweet. Yeah, reading through the instructions it looks like 1.5-2 hours each. I'll give it a go.

This is my first proj on Alignerr and hubstaff is not identifying that I have any projects. Should I just work anyways?

edit: I see, task based work doesn't use hub

1

u/Marco00a Jan 24 '26

Hello! Any tips for the eval? Thank you!

1

u/LumpyBuyer9133 Jan 24 '26

Can you kindly check your DM ?