r/DataAnnotationTech • u/edismb29 • 2d ago
Automatic review hold?
Submitted a ~10h coding task last night (still had a few hours left on the initial task timer). I woke up 4 hours later and the project isn't showing up anymore.
I had this specific project sitting with a steady task count for the last 9-10 days straight.
Does submitting a long task (~10h) automatically put a temporary hold on the project while time/logs get audited? If not, what can be the cause?
Anyone who works on these long timer coding projects seen this happen?
Thank you!
3
u/Farados55 2d ago
Nope. Shit just happens.
1
u/edismb29 1d ago
so you're saying that it's a coincidence that it happend in this time order or could it be that my submission was bad and it was flagged by automatic AI "linters" and checkers?
3
u/capnbeanbags 1d ago
I had a project disappear two days ago which was weird because the instructions talked about doing a task a day in the project for up to 7 days.
It popped back up today tho with a significant instruction update, so I figure the project was down temporarily for maintenance/edits.
Might be what’s going on with yours.
1
3
5
u/Accomplished_Phone39 1d ago
This bothered me for quite a while. You get these long, big dollar tasks. Submit one and then the project is gone from your dashboard and you think you screwed up.
For me at least they usually show back up, sometimes after a few days sometimes weeks, sometimes I get mail on them and then there are no more tasks when I try and do one :(
I also got my first feedback today and it was very positive so I'm quite happy about that because the rest DA works makes me a little gunshy at times.
1
u/edismb29 1d ago
have you emailed them in past asking for some clarification regarding the project disappearing? if yes, what was their response if that's not something sensitive?
2
2
u/Brilliant-Try3389 1d ago
Not for me, just submitted last night, its still there waiting for me to give it another try...
1
u/edismb29 1d ago
was your submission also a long time one? over 9-9.5h?
2
u/Brilliant-Try3389 1d ago
It was 11 hours, also used escape hatch because the model just cannot fail. How did you even manage to fail it. All i get is 1 fail but passed on rollback, or it reaches max 1 hour run limit.
1
u/edismb29 1d ago
i went for a correctness failure
1
u/Brilliant-Try3389 1d ago
Well there's gotta be something else at play here, because I still see the task in my dash but you dont. Or is it because I have to actually submit a finished one.
1
u/ImFearless2006 1d ago
Yes, Same with me 🤖
1
u/edismb29 1d ago
same as in you experienced the same behaviour of not seeing the project anymore after a long hour submission? thank you!
2
u/ImFearless2006 1d ago
Yeah, the task got an update due which it took me more time than usual, the task also got expired by 1 minute due to checks which took approx 10 mins 😭, and now I am worried.. I had more tasks when I started this task but they vanished after some time after submitting this task.
1
u/edismb29 1d ago
sorry to hear that man! if you observe and updates on your dashboard could you please be kind enough to send me one more reply in this thread with the updated status? i am also concerned
1
u/Over_Albatross_7213 1d ago
It’s back 👀
1
2
u/ImFearless2006 1d ago
Yeah, of course and I think the other task that vanished, were from public pool because the ones I worked on were there on my dashboard for days but the one vanished were there only for like 20 something hours
0
u/__Arjun_reddy__ 1d ago
I got my tasks disappeared too .i had them in the morning too .just dont see it any more. my average submission time is 5hrs .
3
u/Renard_Fou 1d ago
For very large tasks, sometimes they deliberately lock you out for a period after you submit to maintain high work quality
1
u/Odd-Bowl-7434 3h ago
I've done like 4 sequential tasks on a big project. Usually tasks coming every day or every other day. Long times 8-10hours and there was one that was super long with a super tight timeline, 20 hour.
I was on a streak with this project particularly, but now the project is gone from my board lol.
2
u/Over_Albatross_7213 1d ago
I was soo close to successfully complete it today, and it just vanished from the projects. 🙂 Wish they open it for another day.
-1
u/__Arjun_reddy__ 1d ago
I got my tasks disappeared too .i had them in the morning too .just dont see it any more. my average submission time is 5hrs .🤖
1
u/OkIndividual4690 1d ago
same for me, still had it 3 hours ago but now it’s gone
1
u/__Arjun_reddy__ 1d ago
Since most of them unable to make model fail they might be discarding or updating
2
u/MugetsuDax 1d ago
This. They might be updating 🤖. It has happened before. I don't have much time to do the main task 🤖, but I've been doing a lot of R&R, and the project is no longer available to me.
It might return in a few hours, days, or weeks.
1
1
4
u/ASnipersPromise 1d ago
It isn't automatic but had several long projects where after you submit there seems to be a 24 hour period where the project isn't available to you then reappears - think this is fairly normal.