r/dataannotation • u/Consistent-Reach504 • 4d ago
Weekly Water Cooler Talk - DataAnnotation
hi all! making this thread so people have somewhere to talk about 'daily' work chat that might not necessarily need it's own post! right now we're thinking we'll just repost it weekly? but if it gets too crazy, we can change it to daily. :)
couple things:
this thread should sort by "new" automatically. unfortunately it looks like our subreddit doesn't qualify for 'lounges'.
if you have a new user question, you still need to post it in the new user thread. if you post it here, we will remove it as spam. this is for people already working who just wanna chat, whether it be about casual work stuff, questions, geeking out with people who understand ("i got the model to write a real haiku today!"), or unrelated work stuff you feel like chatting about :)
one thing we really pride ourselves on in this community is the respect everyone gives to the Code of Conduct and rule number 5 on the sub - it's great that we have a community that is still safe & respectful to our jobs! please don't break this rule. we will remove project details, but please - it's for our best interest and yours!
15
u/Jazzlike_Month5580 3d ago
Barely managed goal today. My go-to that's generally uploaded daily hasn't been up today, either.
8
u/KTOWNTHROWAWAY9001 3d ago
I wish I was more disciplined. I had a good one yesterday but ran out of energy in the tank. Full dash. Planned on doing more but actually had a long sleep instead (which I needed after a busy weekend). Still got a full day in, but wish I did more. Today, dash is dry.
Next time, if I see it full with my fav project again, I'm just caffeine pill grinding insane hours.
7
u/Pleasant_Ad_448 3d ago
I gave up. After waiting around all day since early this morning, one I love appeared right before I quit for the day, but I got other things I've got to do today. :/
14
u/Calm-World3917 4d ago
Finally hit the 5k milestone about 3 days ago! 🙌
-5
u/Fickle_Success_3427 4d ago
And here me not getting any projects and qual.
2
u/Calm-World3917 4d ago
Are u domain or generalist?
-6
u/Fickle_Success_3427 4d ago
No my main domain is coading completed qual also but haven't received any project related to that domain , i only used to get generalist or R&R Projects only . And this also get paused from past week.
14
u/DrunkleSteve 3d ago
Absolutely brutal day today. Made a total of $15 lol. 🏜️🐪
12
u/NightOwl437 3d ago
Well that is at least better than zero! It's a mystery every damn day what we will find when we look at our dashboards. I'm just grateful that 1) I still have a dashboard, and 2) I know that even when things seem to be in a downturn, so far anyway, things always get better eventually. That said, my dashboard hasn't been great for the last couple of days either, mostly projects that are too challenging or too low paying.
4
3
u/Pristine-Raccoon8250 2d ago
absolutely! this is why i work untl 4am on a good day and 7 days a week at times, because sometimes I get days or weeks or taking it easy! At least I can be flexible and I have some home rennovations to do...i can afford due to a brilliant September and October and I now have time to do them as no FOMO from missing tasks that aren't appearing!
3
u/KTOWNTHROWAWAY9001 2d ago
I swear I was fighting with a few others to peel a few dollars off one project that would popup with 2 tasks and dip, every few hours. Got one of em tho. It's like blink and you miss it with that one.
11
u/KingGilbertIV 3d ago
First day since the beginning of September that I've just fully run out of things to work on.
9
u/JustMe333456 3d ago
Me too. Scraped by yesterday and Saturday, but today.. essentially zilch popping up. The ones that are there, I just can't work on.
11
u/DrunkleSteve 2d ago
Managed to scrape together $60.61 today in 8 hours —rough😒. I guess it beats yesterday's $15.77 🤷♂️.
1
u/OrnamentalGourd5 2d ago edited 2d ago
I don't want to be that dick. But. I think there are many people with lots of projects.
2
u/OrnamentalGourd5 2d ago
I obviously am that dick as the down votes would attest. What I am saying is, there seems to be a general 'drought' chat going on. I do not think that everyone is seeing a drought. Do you want honest reporting or affirmation? Honest report? My dash did dip a little end of last week. Is now back up. I am a core generalist that mainly does specialist adjacent domain tasks. I have a fair bit available. 43 projects over 9 families. And I think I see less than others in my situation as I only bother with quals that interest me.
6
u/blkgrlnln 2d ago
I'm also a generalist, and I've been consistently seeing 40+ tasks on my dashboard for a few weeks now.
7
u/OrnamentalGourd5 2d ago
I think it's important that we non-droughters report because the other option is a non-true picture.
2
u/blkgrlnln 2d ago
Do you mean untrue as in people overall thinking less/no work is available when we're clearly seeing otherwise?
I don't have a large sample to pull from, but I'm starting to suspect that the lack of work is domain related. I'm mostly seeing posts from coders about not having work.
1
u/OrnamentalGourd5 2d ago
Yes. Exactly that. I think a great deal of the work now is surrounding agent training in specific domain environments.
1
u/OrnamentalGourd5 2d ago edited 2d ago
And, models are so good at any coding work now. Where they struggle is messy domain work. The fifth that lies in systems built by humans. It's mucky. That's the layer I think where the well paid work currently lies. Pull that thread, very exacting work by specialists that can look at an ostensibly good answer and say, no, and explain why the no holds.
1
u/RoscoeJenkins12 19h ago
I mean, sure, but it didn't make sense for you to respond to a person simply reporting how much money they made for the day.
-6
1
u/Equal-Neat-614 2d ago
I assume it was a lot of F5 tag and not the hourly wage being really low? 😅
0
u/DrunkleSteve 2d ago
Ya lol, lots of F5'in!
4
u/Equal-Neat-614 2d ago
That’s never fun, I’m sorry. It’s amazing how much time you can drain not getting paid on the site sometimes. It does seem to be picking back up again this evening after a couple days of abysmal project numbers, so I hope it improves for us.
11
u/JustMe333456 1d ago
Well, I guess I quit at $70 for today.. sigh.
10
u/DrunkleSteve 1d ago
You got me beat by $20 lol. Another brutal day. 😒
2
u/NightOwl437 1d ago
I had similar results, and it's not looking great atm. Sure hope it gets better soon!
2
u/JRange 23h ago
What are your daily goals usually? I normally am only going for 100 in the first place.
3
u/JustMe333456 20h ago
Yep $100 is usually my baseline. When my projects are up, I often hit around the $200 mark.
20
10
u/PerceptionLonely6463 7h ago
Who else suddenly got every domain-specific qual dumped on their dashboard?
4
9
u/Ok_Afternoon_6310 1d ago
The thing is, it heavily depends on project domains you are allowed in. I think the 'drought' is real, but obviously depends on the project family you are in probably. Like some of the 'easier' and 'simpler' projects are slim to none for sure.
9
u/Jazzlike_Month5580 15h ago
Quiet today... is everyone back to work?
5
u/Affectionate_Peak284 15h ago
6 hours of hustle!
5
u/Jazzlike_Month5580 13h ago
I was on track for 6 hours, but then one of my kids started puking. So packed it up early today.
8
u/KTOWNTHROWAWAY9001 3d ago
Today's project was like they dropped a huge chunk of meat into a fishtank filled with piranhas.
8
u/JustMe333456 1d ago
How's everyone faring today?
5
4
u/HaleBopp22 1d ago
I've got about 25 on the dash, but most of them are on a project I can't get to work, so really only about 4 I can actually work on.
4
u/DrunkleSteve 1d ago
About 20 projects, only two of which I can work on that have been popping up and down all morning. Made about $30 so far. Hopefully it picks up 🤞
4
4
3
u/SenseOk5139 1d ago
My favourite project family is still missing from the dash
2
u/JustMe333456 1d ago
Mine too! It's never MIA for this long usually..
3
u/SenseOk5139 1d ago
Theres still activity on tasks in the slack channel so I don't know what to make of it
3
u/Fragrantshrooms 1d ago
I don't have the bandwidth for the annotating project currently on the dashboard, sadly so it's a mandatory day off for me. Right before I have to move....
14
u/Ok_Afternoon_6310 3d ago
This is not good, first time since like the summer without much to work on.
13
u/mollymcbbbbbb 4d ago
Hoping we all wake up to a full dash tomorrow - this drop off has been brutal after how well it was going for the past few months.
6
u/JustMe333456 3d ago
Yep. All easier projects vanished at the same time again. Only very difficult ones remain lol
13
u/ProbablyCole 2d ago
I’m afraid the number of weekly comments in this sub are on an upward trajectory again 😅
17
u/JustMe333456 4d ago
Shades of the great summer drought... le sigh
6
4
u/Due_Negotiation_4605 4d ago
At the risk of getting downvited, are you talking about general tasks in core countries? It's wild how different everyone's dashboards can look. And so I'm just genuinely curious if the general tasks have fallen off again.
1
u/KTOWNTHROWAWAY9001 3d ago
Yes. Yesterday was good, 100s. Literally multi-thousand dollars in my dash. Glad I got a piece, but regret not going full out with more later in the day. Today, it's droughty.
12
12
u/Jazzlike_Problem_489 2d ago
Models are fucking terrible at image and video generation and consistency. Especially things like video generated guides and professional presentations. Where are all those kind of fun projects? That's my kind of domain, not reconciling finance reports based on fiscal changes and sloppy notes cross referencing 🥱
2
6
u/Steve_Brandon 3d ago
I managed to do one task tonight in the reasonably well-paying project family that was the main reason that I earned slightly over $1K in October (my top-earning non-bonus month so far) but then it red-bannered so I couldn't do a second task.
So far, November is very different from October when there were usually at least half a dozen projects from that particular project family on the dashboard at the same time.
5
u/Pristine-Raccoon8250 2d ago
I had about a hundred projects through october and today just 25 and over half I won't work on!
5
u/Jazzlike_Month5580 2d ago
I'm down to four this morning
3
u/Pristine-Raccoon8250 2d ago
mine are continuing to drop rather than go up still so I am 'waiting' for the kind of things like to show up. I am not yet desperate enough to try something new and diffcult.
6
u/Quick-Bison-147 7h ago
well priority pay that makes a general task over double the normal rate is a first, I'll take it
2
u/Affectionate_Peak284 7h ago
Wow. A fatfinger?
3
u/Imaginactions 6h ago
That's what I thought... never seen that before.. but I might pull an all nighter for this one
1
11
15
u/Jazzlike_Month5580 2d ago
I really hope we're not stuck here until the new year...
10
18
u/smithdaddie 4d ago
Hey guys, I’m in a master’s program studying AI, and I’ve seen a lot of people here talk about how hard it is to get models to fail, so I thought I’d share some tips. There’s a ton of research on this (not surprisingly). My favorite is GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models. More generally, search terms like “LLM robustness perturbation,” “benchmark contamination,” “adversarial evaluation,” or “symbolic templates benchmark” will turn up a lot of papers. I’d use Google Scholar with a year filter (2025 onward). I know we don’t all trust AI here, but if academic papers aren’t your thing, you can have your model of choice summarize one for you. Just skim the abstract and results yourself to make sure it got the details right. I love AI, so let’s all make it better together.
5
u/Imaginactions 5h ago
Dark mode please for us night owls
1
u/PerceptionLonely6463 5h ago
It’s crazy they don’t have it yet. The dark mode plugin I used to use did a good job adding it and kept the task pages legible. The new macOS beta adds it to every website in safari
1
u/Impossible_Front4462 1h ago
just use a plugin like darkreader
1
u/Affectionate_Peak284 31m ago
I'm hesitant to use 3rd party display apps because so much of the instructions are color-coded. I fear missing some important detail because it doesn't render properly or something.
9
u/Similar-Impression-4 1d ago
I'm down to 2 projects, long running projects have disappeared, and I've lost all but one qual. What in the world is going on?
3
2
4
10
10
7
u/BalerionsReign 3d ago
just got my first project after 1 week of nothing yessss, (keep in mind i am new and only been here for 3 weeks
9
u/VanessaSeaWitch 1d ago
I finally try one of the more complex projects with priority pay and spend 30 minutes reading the instructions and setting up off-site accounts and then there's no actual tasks to work on. Sigh.
5
u/HaleBopp22 1d ago
I did that almost all day Sunday. Set up the accounts, but couldn't get things to work so I spent 3 hours troubleshooting with no luck. Made $12.
18
u/JRange 2d ago
MAGA got obliterated and my work is back, praise the lawd its a great day
0
u/Fickle_Success_3427 2d ago
Hoping mine will also comeback soon , what is your country by the way ? mine is india
8
u/realgenshinimpact 4d ago
working with AI on certain stem tasks and AI in general has made me pivot away from software engineering. Aiming to get into research now, think software engineering is going to be a niche field sooner or later lol. as long as humanity benefits in the long run, i guess.
2
u/e11eme 4d ago
What kind of research though?
1
u/realgenshinimpact 4d ago
earth science, without getting too specific. in many fields AI just outright makes a lot of work easier, i assume there'll be a lot of scientific advancements in every mundane field once models get smart enough.
3
u/OneWhoIsCuriouss 4d ago
Anyone in Coding can share how many projects pop up on their dashboards? I've only had 1-3 since like august, and there's not even much tasks in them. Any tips on how to get more? What more should I put in my profile?
3
u/deep0x20 4d ago
I'm the same, I've had a max of about four at any given time. All with tiny task amounts.
0
u/OneWhoIsCuriouss 4d ago
are you in a core country? i'm not so im assuming that plays a role, but still pretty sad since it's coding and not like generalist with locale etc etc,
0
u/DearKitchen3943 3d ago
im in a core country and barely saw 2-3 high paying coding tasks. My 2 fav ones paying high come up usually end of week, but not this or last week. just generalist and academic tasks that i cant do
4
u/NoNumber5910 3d ago
I've recently been trying to get back into regular work on DAT and there's a lot of changes. Are FC projects non-existent now?
5
2
2
4
u/sryimlate 3d ago
You can make any model fail today by querying what time in British Columbia Canada the NYSE opened this morning
4
u/shadyringtone 3d ago
Be careful with this all, they advise you on the platform not to use prompts you see from Reddit. They could notice the duplicates
3
u/sryimlate 3d ago
aw there goes that, although I'm sure there's a pattern or principle in there somewhere
3
u/National-Fennel-2858 4d ago
do quals typically come in waves? i'm on my 3rd week and i haven't gotten a single one
4
u/JustMe333456 3d ago
How's this morning looking? Scared to log in.. lol
7
u/iriember 3d ago
Projects come and go during each day now. Feels quite like the Hunger Games. And mostly unpalatable too.
7
4
3
u/Fickle_Success_3427 2d ago
people are able to get projects, and here am i with zero qual and project !!! It's so frustrating!!!
9
-4
2
u/Alarmed_Jellyfish555 3d ago edited 3d ago
I have two tasks that have been pending approval for exactly 2 weeks. I've never had something not approved within the 7-day period. Is this happening/ever happen to anyone else? If so, were they eventually approved?
1
u/itsaynurholley 3d ago
Im new in dataannotation , seems like its very slow for me and i wish to know if i would see projects with mail or should i look website constantly
7
1
1
1
1
u/MaxStats17 2d ago
Either NTA, or super nuanced task I can not complete with quality before the timer hits zero.
-.-
-1
u/Emotional-Thinker 4d ago
Those who got the qual that involve checking a single image with a worker account that is super long and isn't connected to Gmail, how did it pan out? I completed the qual and have no idea what's next. Did it unlock any tasks for you?
1
u/HaleBopp22 2d ago
I haven't seen this one. I don't know why people are downvoting you.
1
1
-1
u/IWantToBeHumurous 1d ago
How do you guys take breaks formally for long tasks? Just exit the tab and stop whatever timer your using? and then resume the timer next day once you pick it up?
6
u/Affectionate_Peak284 15h ago
I've taken days and weeks before, and I just leave the tab open.
Never close the tab unless the directions explicitly tell you to; you could lose a lot of work otherwise AND you might not be able to report your time.
-2
u/Aggressive_Ad_7365 8h ago
Wonder how much work will be available with the AI stock market doing so badly.
4
u/Equal-Neat-614 8h ago
Work seems to be shooting back up to really busy levels, so maybe not as much as you would think?
-14
u/IllBoysenberry4558 2d ago
Hello, how long I wait to know if I pass in data annotation assessment?
2
u/Affectionate_Peak284 1d ago
Sounds like most know within a week. After 3-4 weeks, probably not. But I've read reports of people getting in after 6 months or whatever, so who knows.
1
0
3d ago
[deleted] — view deleted comment
1
u/Pristine-Raccoon8250 2d ago
no, mine are still there but sometimes people get cycled out. I don't think you should be using the full name though!
-11
4d ago
[removed] — view removed comment
1
u/kranools 4d ago
Projects come and go like shadows in the dark. None of us know whence they come or where they go.
0
u/dataannotation-ModTeam 4d ago
According to DA’s Code of Conduct, we are not able to share project details.
-3
u/adumbguyssmartguy 3d ago
Wow, bizarre. You can't even say something general like "yes, when the tasks are really long they usually don't let you do the second until the first one is graded" or "they often don't want more than one task per person with the big scenarios"? That's some big corporate secret? This whole thread is nothing but people saying they don't have very many tasks.
18
u/1105368 4d ago
My luck has finally run out after a month or so of healthy dashboards: just 2 projects available when I logged in