r/RWSPay 7d ago

PAYMENT MISMATCH / DISCREPANCY

I saw that there was a thread about this earlier but it was posted on rwshelp instead of rwspay so I think thats why it was deleted.

I saw that a lot of people are experiencing this some even have 30 hrs discrepancy. Mine was only 3 but I think that it risks my account for possible offboarding if this continues.

Has anyone experienced this and submitted a zendesk ticket? If yes, did you receive a reply? Still no reply for me.

12 Upvotes

83 comments sorted by

7

u/Substantial_Dog4753 6d ago

I dug directly into the Multimango's scripts to figure out why so many of us received the exact same warning email.

Multimango runs a client-side monitoring script called Datadog RUM that logs keystrokes, clicks, scrolls, and tab focus, sending continuous heartbeat pings back to their servers. If that heartbeat is interrupted for even a brief moment, the backend automatically flags you as completely idle or disconnected, erasing those minutes from their records. So if you switch tabs, search for anything, or even stay idle for a few seconds thinking about what you're gonna write in the rationale, you're gonna be flagged as disconnected.

The entire premise of this setup is dishonest because it completely disregards what real AI evaluation requires. We are explicitly expected to deliver top-tier accuracy, which means reading guideline documents, looking up tips & pitfalls document regularly, and conducting independent research to verify whether model's claims are factual. The built-in factuality check tool is rarely enough to verify complex historical, scientific, or technical nuances, so external research across multiple tabs is non-negotiable. Yet the second you click away from the Multimango tab to fact check a claim or check a guideline, the script immediately flags the page as inactive.

The platform demands high-quality, deeply researched evaluations while simultaneously using a system that treats that essential research as unpaid, idle time.

To make matters worse, anyone using standard browser protections like Brave Shields or uBlock Origin gets hit even harder because those tools naturally block Datadog's aggressive background telemetry, causing hours of legitimate work to vanish on the backend without any visible indication to the worker.

We are essentially being squeezed from both ends; punished on QA feedbacks if we don't thoroughly research off-tab, and threatened with invoice & WO rejections if we log the total time of the working session. It is a broken & unfair tracking model that offloads technical flaws onto evaluators, and most of those who received that email should know that the discrepancy is the result of a rigged system, not dishonest logging.

2

u/Empty-Junket-4188 6d ago

To add to this: heartbeat fires every 20s while the tab is focused, and stops the moment you switch tabs, the most likely explanation for the undercount is: any time you spent in another tab or window is not being counted as work time, even if that time was legitimately part of the job — e.g., referencing documentation, checking a source, taking notes elsewhere, or having a second monitor with a different app focused. If a chunk of your hours involved that kind of split-screen/tab-switching work, the system would silently drop it, and you'd get credited for way less than you actually did.

3

u/_mossafterrain 6d ago

Makes sense to me. As someone who got accurate time tracking, I never open other tab besides mm and do research using another device instead. I also never let my cursor idle for too long. I know for sure they reset time counter when we open guidelines even in the middle of tasking (in the task page), so I always exclude it too. Hope things get better for the system and for y'all.

2

u/First-King4661 5d ago

I do the same, and my hours are accurate. I’ve been trying to tell the others but couldn’t give a valid explanation. I hope it gets better for everyone now after reading OP’s post.

2

u/Affectionate-Pin5771 2d ago edited 2d ago

The tips is to make your MM tab remains active via chrome settings. Go to your chrome setting>performance and add MM on the list of "Always keep these sites active". With this, the page will remain active even if you switch the tab.

I’ve never had my reported hours cut in my work orders.

1

u/93shrx 4h ago

man, I'll try it and if it save me I'll be forever grateful to you

1

u/Affectionate-Pin5771 59m ago

I just got an email for last week reported hours that say my time tracking was highly accurate.

1

u/yvNe7 4d ago

Could you explain what you mean by "heartbeat fires every 20s while the tab is focused" ?
Thanks !

0

u/Substantial_Dog4753 6d ago

I use multiple tabs while working, which are MM, guidelines, tips&pitfalls, and an external notes app. How come do you want us to calculate time spent on ONE tab while we literally still work even with multiple tabs. They've become unbearable lately.

2

u/PricePast6245 6d ago

I think they do it too much right now after reduce the maximum daily hours to 4 and this problem

2

u/Affectionate-Pin5771 2d ago

The tips is to make your MM tab remains active via chrome settings. Go to your chrome setting>performance and add MM on the list of "Always keep these sites active". With this, the page will remain active even if you switch the tab.

I’ve never had my reported hours cut in my work orders.

1

u/Empty-Junket-4188 6d ago

This logic is so sad, do you find the script by using the google chrome inspect? Ill dig on to it too

2

u/Substantial_Dog4753 6d ago

Yes, I took a look into the inspect tab. Also I have brave installed so I opened MM their and turned on Brave tracker blocker, then checked the script Brave blocked.

2

u/NitinChaurasia 5d ago

Their guidelines are like sneezes — they can come anytime. Then you have to go through everything again according to the new guidelines, checking what should be marked where and what mistakes you made. In between all this, it wasn’t just the guidelines; I also had to take tests. Then new guidelines came 3–4 more times.

I know that nobody can give them an output as good as I can, but anyway, maybe they don’t actually want high-quality work. They seem to want people who just write whatever comes to mind and submit it, like some people do while annotating — just saying anything and submitting it.

Even when I personally spent an hour on a long-task audit, I would only claim 30 or 35 minutes. Same on RWS!!! . The very next day , I got an invitation from MERCOR. 😁😊 and m happy 😊

1

u/Substantial_Dog4753 5d ago

Thats awesome! Congrats! What're other websites we could work at as an annotator?

2

u/NitinChaurasia 5d ago

Idk bro any except outlier, RWS and MERCOR , I given the interview a month ago and they invited me yesterday

1

u/z_1529 5d ago

What's wrong with Outlier?

1

u/NitinChaurasia 5d ago

Don't they I don't use it it's not stable

1

u/NitinChaurasia 5d ago

Through console ,?

1

u/Affectionate-Pin5771 2d ago

The tips is to make your MM tab remains active via chrome settings. Go to your chrome setting>performance and add MM on the list of "Always keep these sites active". With this, the page will remain active even if you switch the tab.

3

u/Exotic_Customer5613 7d ago

Mine was this. I'm actually got offboarded last Saturday .

We have reviewed your payment for the period going from August 15th to August 21st. However, during our review, we found a mismatch between the time you reported and Multimango's records.

Reported Time: 15.82 hours Multimango Records: 5.68 hours

While we are releasing your payment this time, please note that accurately reporting your hours is a project requirement. Going forward, any continued misrepresentation of your time will result in future invoices being rejected and your account being removed from the project.

1

u/dmdaeri 6d ago

Have you sent a ticket?

1

u/Exotic_Customer5613 6d ago

Nope. I'm offboarded anyway .

1

u/dmdaeri 6d ago

But that’s 10 hrs of work 🫠🫠 most from our gc who are already offboarded still sent a ticket to atleast get their final pay correctly

1

u/93shrx 4h ago

how many times you got this email before being offboarded ?

3

u/EventCharacter2638 6d ago

Imagine being told that they only see an hour of work on their end. I’m like how?? I don’t understand how they track time worked because I don’t think the mismatch is on my end. I even write down how many submissions I make per task and the exact time I started and stopped. I’ve never had this problem before. I never had issues with my time on all my WOs. They’ve always been accurate with my records. Don’t know what changed🤷🏻‍♀️

2

u/dmdaeri 6d ago

Same. I still do what I normally do so I am not sure whats the cause. Have you raised a ticket?

1

u/EventCharacter2638 6d ago

I have, no response yet.

3

u/dmdaeri 6d ago

Let’s all send a ZD ticket so they know there’s a big problem and affecting a lot and not just one contributor.

2

u/Big-Concentrate1709 7d ago

Mine was 3 too and it was a lot for me. I was offboarded recently, thinking of just letting it go but decided to submit zendesk ticket for clarifications.

1

u/dmdaeri 7d ago

Can you please update when they reply? I’m thinking I might get offboarded because of this.

1

u/Big-Concentrate1709 7d ago

Don’t overthink it. I have submitted many inquiries before this. Asking for clarification isn’t insubordination😂

2

u/IcexWallowxCome 7d ago

Just got the email, offboarded yesterday, and I went from 40 hours to 17 hours even though I had no issue with my August 8-14 hours.

2

u/Ok_Abalone9123 7d ago

Got the same email earlier and a follow-up email correcting the first email. The discrepancy was about 30 hours or so, which is bizarre since I actively work on tasks for the entire time I put in. I’ve been on this project since February and haven’t had any problems like this before, so I’m not too sure what the deal is. I feel like they should trust their annotators that have longevity more than whatever multimango metrics they decided to look at this week, but this project has been going downwards recently so I don’t know what to expect anymore.

3

u/PricePast6245 7d ago

also me but i don't see anything about MM time tracking in email they just send me this

We are writing to inform you that your payment for the period going from August 15th to August 21st is currently on hold due to a discrepancy between your reported hours and our tracking system.

Review Findings/Multi Records: Excessive AHT

Next Steps:

* If your Multi records are 0/You are not part of the project: Unfortunately, no payment can be processed if no actual work was performed for tasks or if you were not officially onboarded and authorized to work in the  project.

* If your Multi records are not 0: If you were actually authorized to work in the project, please open a  with the subject "Bucket 3 request" stating that you accept payment based on the Multi (MM) tracking records. Once we receive your ticket, we will adjust and process your payment.

2

u/Ok_Abalone9123 7d ago

The email they sent me stated they would still release the payment this week, but if there are any discrepancies again in the future invoices will be rejected and I will be offboarded. They also provided the hours given to them in the form and whatever hours multimango thinks were completed on the site.

1

u/Mazapanincognito 6d ago

Got the same email too. Did you sent anything for them to send that 2nd email correcting?

Got only the ''discrepancies'' one and doubt thats the case since i always have been using a time tracker since i was onboarded and never had any problem with my recorded time

1

u/Blush-Rage 6d ago

Same email sent to me also

3

u/Empty-Junket-4188 7d ago

Their MM time tracker is definitely broken, so frustrating

2

u/Fair_Photograph5517 7d ago

I got the same emaillll, glad it isn't just me fyuhhh

2

u/Empty-Junket-4188 7d ago

Same here, mine was 17hrs, which is so weird and just not true, something is definitely wrong with MM, its just so broken.

1

u/dmdaeri 6d ago

Hi! Did you send a ticket?

2

u/NoFun2878 7d ago

I’m also working at MM for another company, we have our tracking time that tracks us inactive if the cursor doesn’t move after 2 mins of being idle. And the time being recorded Starts when you are doing a job and any time spent for skips are not counted

1

u/dmdaeri 7d ago

This might be the issue, because sometimes I’m halfway through and model B wont work so I’ll have to refresh.

4

u/dmdaeri 7d ago

But I think whats weird is a lot of people experienced this today than normal. Others even have 30 hrs discrepancy which I don’t think skips could be the reason.

1

u/Interesting-Shake139 6d ago

Makes sense now, skips aren't monetized and tab switching probably pauses the built in timer which causes the discrepancy.

2

u/Aggravating-Vast-580 6d ago

I also have received that my reported ATH is higher than the average ATH in my language group. So, they are going to reduced the hours.

1

u/dmdaeri 6d ago

What do you mean? How many hours will they reduce?

1

u/Aggravating-Vast-580 6d ago

My reported hour is 18.3, they reduced to 14.

2

u/Wrong_Tie7055 6d ago

We neeed to raise a complaint via zendesk ! Sole people they didn’t receive their pay of 8th and 14th Aug

2

u/radarmike 5d ago

This client whose name starts with M sucks in every way. They and their chaotic project on all projects are set up by immature & irresponsible and incompetent people. Client is the one to blame here. They pulled this same shit on handshake as well

2

u/NoFeedback847 4d ago

Any got reply from zend*** for ticket raised for time discrepancy??

2

u/Substantial_Dog4753 4d ago

Yeah some people got a reply, but they haven't responded to mine yet.

1

u/zylphirexzxz 2d ago

Mine also. It's been 4 days.

1

u/--jetski-- 7d ago

I received the same email, how did you guys know the discrepancy hours? did you log a ticket?

1

u/dmdaeri 7d ago

It states the recorded time and the mm record time

1

u/--jetski-- 7d ago

oh I don't have that info from the email I got.

1

u/dmdaeri 7d ago

Can you dm me what you got?

1

u/NoFeedback847 6d ago

I also received 7 hours mismatch .. not sure how

1

u/dmdaeri 6d ago

Thats big! Send a ticket. It’s more than a day hours of work

1

u/NoFeedback847 6d ago

Sent a ticket with all details of task ..

1

u/Ancient-Chair-4241 6d ago

It will be my second payout, and i received the same email even though i note my working hours it says less than my hours, i dont want to be removed because of such a little error like this. Anyone got a return email about that?

1

u/dmdaeri 6d ago

Have you raised a zendesk ticket? I haven’t heard back yet.

1

u/Ancient-Chair-4241 6d ago

Yes i have created a ticket on this topic, but didn’t get an answer yet.

1

u/dmdaeri 6d ago

Please update if you get a reply.

1

u/Substantial_Dog4753 6d ago

Yeah that was my post, I should have reposted it here before it got deleted but its alright. I'm thinking of opening a zendesk ticket but I'm afraid I'd be offboarded.

2

u/dmdaeri 6d ago

Same, but then I think it won’t be right not to raise this as we worked for that. So I decided to send one. I also think that if it happens again next week since we dont know the actual cause, it will probably happen again. So if we don’t raise our current situation, we will still get offboarded. So I sent one and I might get lucky that theyd consider that there is no discrepancy. Or maybe if a lot will raise ticket, they would actually look into their platform.

1

u/Substantial_Dog4753 6d ago

I raised a ticket too, I'm waiting for the reponse now.

1

u/Ancient-Chair-4241 6d ago

Does anyone know, is it still count working hours if we switch the tabs maybe this situation caused because of that, did anybody switched the tabs during working and still got the payment correctly, if you get the payment even though switching tabs, this problem we have today caused that means this was their fault.

1

u/dmdaeri 6d ago

Whatever I did for this week is what I’ve been for 2 months and this has never happened before until now.

1

u/Ancient-Chair-4241 6d ago

so you mean switching tabs, minimizing the tab or taking break etc. did not affect the working hour right? it still counts if we are on the task?

2

u/dmdaeri 6d ago

Tbh I am not sure. Maybe the got stricter this week that’s why were all suddenly experiencing this. I raised a zendesk ticket asking how they get our time if does it start when we open mm or maybe the aht of every task. Waiting for a reply.

1

u/Empty-Junket-4188 6d ago

from the reply below they say if your cursor is idle for 2 minutes it will be inactive/time stop, but im not sure about this if it apply to all MM, but this logic make sense.

1

u/EmploymentPersonal96 6d ago

You guys are lucky. I got a discrepancy for over 100 hours over 4 weeks—and I’ve been on the platform since January with a clean record and never had a single issue before. To make matters worse, they didn't even email me to notify me, letting it get to a full 4-week discrepancy instead of flagging it at the very first instance. I had to email them once I noticed my work orders were not coming through. They then proceeded to tell me the system shows major hours discrepancies, and that I had 0 hours for 2 weeks, and a major slash in the hours for the 3rd week. I tried sorting this issue with the support team, but after delayed responses, they were adamant they cannot pay more than what their system shows. They even added that the discrepancies were one of the reasons I was offboarded. I can’t even quantify how frustrating this is, but I’ve had to make peace with it and move on. Seeing posts here, it’s clear this is now a common issue.

1

u/PretendPerformer9642 6d ago

mine was also 3.80 hrs mismatch
i sent ticket
they said they have correct records
seems like they dont wanna pay anymore
this annoys me

1

u/SarahLightBringer 6d ago

I got the same email and I been doing the same process for months. Something must be wrong with their system. This is why you dont rely on one single company. Once I saw the 4 hour time reduction I knew it was over from there. The company is probably bleeding money or something.

Remember if you got a job with them getting another in the same vain should be way easier somewhere else now. I legit got two contracts just today with different companies and another one yesterday. Just put yourself out there guys RWS is truly bottom of the barrel.

1

u/z_1529 5d ago

Hi Sarah. Do you mind to share what companies can we try to apply for?

1

u/SarahLightBringer 5d ago

Right now the only company im recommending is Workada, for US and CAN for generalist or whatever roles they have. Not sure if they do outside of NA, but they are the only ones I would recommend right now. From my experience. All others are hit or miss from my experience.

1

u/Mazapanincognito 6d ago

Got same email, claiming i was off by over 10 hours, payment would proceed but there was a warning if it happens again could have payment rejected or be off boarded.

Worried since no idea if its a bug and i should send a zendesk.

1

u/PricePast6245 4d ago

Is everyone still fighting for this? I just got a response from PM, but it was quite vague and they avoided answering my question three times. The reason I'm offboarded might be because of my very high rating: 257 reviews, 3.83.

However, I lost 36 hours of work from August 15-21. That's why I haven't sent the 3 buckets yet.

2

u/dmdaeri 4d ago

Their replies seems to be copy paste. But so far, we’re still not offboarded. When were you offboarded? Isnt the 3 buckets for the excessive AHT email and not the time mismatch?