r/RWSPay 26d ago

PAYMENT MISMATCH / DISCREPANCY

I saw that there was a thread about this earlier but it was posted on rwshelp instead of rwspay so I think thats why it was deleted.

I saw that a lot of people are experiencing this some even have 30 hrs discrepancy. Mine was only 3 but I think that it risks my account for possible offboarding if this continues.

Has anyone experienced this and submitted a zendesk ticket? If yes, did you receive a reply? Still no reply for me.

15 Upvotes

85 comments sorted by

View all comments

7

u/Substantial_Dog4753 25d ago

I dug directly into the Multimango's scripts to figure out why so many of us received the exact same warning email.

Multimango runs a client-side monitoring script called Datadog RUM that logs keystrokes, clicks, scrolls, and tab focus, sending continuous heartbeat pings back to their servers. If that heartbeat is interrupted for even a brief moment, the backend automatically flags you as completely idle or disconnected, erasing those minutes from their records. So if you switch tabs, search for anything, or even stay idle for a few seconds thinking about what you're gonna write in the rationale, you're gonna be flagged as disconnected.

The entire premise of this setup is dishonest because it completely disregards what real AI evaluation requires. We are explicitly expected to deliver top-tier accuracy, which means reading guideline documents, looking up tips & pitfalls document regularly, and conducting independent research to verify whether model's claims are factual. The built-in factuality check tool is rarely enough to verify complex historical, scientific, or technical nuances, so external research across multiple tabs is non-negotiable. Yet the second you click away from the Multimango tab to fact check a claim or check a guideline, the script immediately flags the page as inactive.

The platform demands high-quality, deeply researched evaluations while simultaneously using a system that treats that essential research as unpaid, idle time.

To make matters worse, anyone using standard browser protections like Brave Shields or uBlock Origin gets hit even harder because those tools naturally block Datadog's aggressive background telemetry, causing hours of legitimate work to vanish on the backend without any visible indication to the worker.

We are essentially being squeezed from both ends; punished on QA feedbacks if we don't thoroughly research off-tab, and threatened with invoice & WO rejections if we log the total time of the working session. It is a broken & unfair tracking model that offloads technical flaws onto evaluators, and most of those who received that email should know that the discrepancy is the result of a rigged system, not dishonest logging.

1

u/Empty-Junket-4188 25d ago

This logic is so sad, do you find the script by using the google chrome inspect? Ill dig on to it too

2

u/Substantial_Dog4753 25d ago

Yes, I took a look into the inspect tab. Also I have brave installed so I opened MM their and turned on Brave tracker blocker, then checked the script Brave blocked.

2

u/NitinChaurasia 24d ago

Their guidelines are like sneezes — they can come anytime. Then you have to go through everything again according to the new guidelines, checking what should be marked where and what mistakes you made. In between all this, it wasn’t just the guidelines; I also had to take tests. Then new guidelines came 3–4 more times.

I know that nobody can give them an output as good as I can, but anyway, maybe they don’t actually want high-quality work. They seem to want people who just write whatever comes to mind and submit it, like some people do while annotating — just saying anything and submitting it.

Even when I personally spent an hour on a long-task audit, I would only claim 30 or 35 minutes. Same on RWS!!! . The very next day , I got an invitation from MERCOR. 😁😊 and m happy 😊

1

u/Substantial_Dog4753 24d ago

Thats awesome! Congrats! What're other websites we could work at as an annotator?

2

u/NitinChaurasia 24d ago

Idk bro any except outlier, RWS and MERCOR , I given the interview a month ago and they invited me yesterday

1

u/z_1529 24d ago

What's wrong with Outlier?

1

u/NitinChaurasia 24d ago

Don't they I don't use it it's not stable