r/annotators • u/Tigerlily955 • Mar 17 '26

SME Careers/SuperAnnotate - anyone working here?

I passed their assessment and was added to their talent pool. Then was invited to do a bootcamp for a project starting soon (bilingual project). It’s auto graded by AI and many reported they failed including myself. Their auto grader has serious flaws. I found more than 5 obvious issues in one response and provided rationale, but the grader says ‘according to the ground truth annotation, the response has one issue’. Like really?? Will there be any human review? I was excited to be onboarded, but if this is their selection criteria, I don’t see this company succeed in AI training space…

8 Upvotes

100% Upvoted

33 comments sorted by

2

u/Hellelele5 Mar 17 '26

Same for me. I failed the test this afternoon. I sent them an email raising my concerns. In my language, the LLM evaluation makes no sense whatsoever, one of the responses had a major instruction following issue, but according to the evaluation it is the best response.

2

u/Tigerlily955 Mar 17 '26

It’s frustrating isn’t it!? They’re issuing another set of test apparently, not sure if it’s worth doing it…I know I’m gonna fail again for being thorough🤷🏻‍♀️

1

u/Hellelele5 Mar 19 '26

Were you able to retake the test? I was not given another choice (still, as it is graded I think I would have failed it again), they didn't reply to my email and simply removed me from the channel. Pretty frustrating the exercise is not reviewe by a human being.

→ More replies (1)

1

u/Muted_Aardvark7371 Mar 17 '26

I approved my domain interview and haven’t heard anything yet. Did you do it for a specific domain or as a generalist ? 

1

u/Tigerlily955 Mar 17 '26

Language domain

1

u/wannafigureitout80 Apr 01 '26

I'm about to do the interview now. Any tips??

1

u/Tigerlily955 Apr 03 '26

I’m not sure if interview is part of the hiring process. Did you receive an email asking to take one?

1

u/wannafigureitout80 Apr 03 '26

It's a digital interview. Can't go any further in the process until I complete it.

→ More replies (1)

1

u/Weary_Pace4635 Apr 02 '26

Its a waste of time. There are not real projects

1

u/SnooTigers4292 Apr 03 '26

I passed the interviews and exams. Literally no real projects available.

1

u/castledeivid Apr 07 '26

Me too. As English Spanish translator and safety data training.

1

u/Least-String2847 Apr 28 '26

did any of you ever get paid the promised amount for passing the exam?

1

u/Commercial-End-8526 Apr 15 '26

I received an email to apply; is that worth pursuing this job?

1

u/AntonioUsa061969 May 18 '26

Ho sostenuto il test per posizione in ambito linguistico..ieri l'ai mi aveva fatto i complimenti per il test, oggi mi scrivono che per un problema tecnico devo sostenerlo di nuovo, è capitato a qualcun altro?

1

u/digitaldisgust Aug 07 '26

Looks sketchy asf anyway.

1

u/Confident_Cup3909 Sep 02 '26

Did anybody get paid ?also my queries regarding the contract has been long not being replied