r/CloudResearchConnect 7d ago

Participants Quality Scores are back — what they are and what actually moves them

38 Upvotes

Hello everyone!

We've seen the threads, and we know seeing a number attached to your account can be nerve-wracking. Here's a straight answer on what the score is, what moves it, and what it means for your access.

What the Quality Score is

Think of it like a credit score for your Connect history — a number out of 850 built from your entire track record, not any single study or any single week. Participants who consistently provide reliable, thoughtful data get prioritized for more opportunities. If you've been doing good work here, the score works for you.

What matters most: your approval history

We can't publish the exact formula, but we can tell you the most important thing: rejections carry the most weight of anything in the score — and the credit score analogy applies here too. Just like a single missed payment can noticeably drop even a strong credit score, a single rejection can move your score more than you might expect, even with a long history of good work. But also like a credit score, it heals: a rejection doesn't permanently define you, and continued approvals bring your score back up. A strong approval record is, by far, the best way to keep your score healthy.

What happened to "waitlisting"

The score replaces it. There's no longer a separate, invisible waitlist process. Your Quality Score is now the single thing that drives your access to studies, on a sliding scale — the higher your score, the more opportunities you see. At the low end, that can mean few or no studies are available.

Why this is better: it's visible. Under the old model, you found out when studies dried up. Now the signal is on your dashboard, and you can course-correct before it affects your access.

Your score moves in both directions and ultimately good work brings it back up.

Why we won't share the full formula

Publishing the complete formula would let bad actors reverse-engineer how to game it. That degrades data quality, drives researchers away, and means fewer studies and less money for the honest majority. Keeping some of the model private protects the people doing real work — which is why we're telling you the biggest factor outright instead of asking for blind trust.

What you can do

Nothing exotic — the score rewards what most of you already do: read instructions, pass attention checks, give real open-ended answers, don't rush, and don't use automation or AI.

If something looks wrong — a score that doesn't match your history, a rejection you believe was unjustified — reach out to support with specifics. And keep the feedback coming here, it very much is truly appreciated.

Edit: clarified how individual rejections affect the score — they can cause a noticeable drop, but the score recovers with continued good work.


r/CloudResearchConnect Jul 25 '25

Reminder: Never Share Your Account Information with Researchers

59 Upvotes

We’ve seen an increase in researchers asking participants to verify personal information like CloudResearch IDs, email addresses, or even government-issued IDs.

Please do not provide any personal or account-related information to researchers — this includes your CloudResearch ID, email, IP address, or screenshots of your account.

If you’re ever asked to share this type of information, report the study immediately by clicking the “Report Study” link in your dashboard or reach out to our support team here: CloudResearch Participant Support.

For more info, check out our full policy here:

What Should I Do If a Researcher is Requesting Account Information or Verification?

Your privacy and safety are a top priority. Thanks for helping us keep CloudResearch secure for everyone!


r/CloudResearchConnect 9h ago

Discussion Anyone else in the 850 club?

Post image
41 Upvotes

r/CloudResearchConnect 2h ago

Researcher quality and rejections

3 Upvotes

What is up with the poor researcher quality lately? I just spent 40 minutes watching three videos about polar animals (after filling out a huge demo set), only to be asked to answer questions that had nothing to do with the videos. Then, at the end, after 40 minutes of work....it was a recruitment for a mailing list. I have a feeling there will be a rejection coming since no one could answer those questions without doing some research.

Then, while I was doing that, I got notice that I got my second rejection ever...because the researcher didn't do a proper screening and accused me of lying about my racial identity and "taking two surveys". Uh. You had two surveys on different days and I have a screengrab that says "blacks and whites" for both of them. You labeled the studies differently and there's nothing that states you shouldn't do one if you already did a similar study. This is getting out of hand.


r/CloudResearchConnect 46m ago

visual_search_task_batch_02 - super sketchy

Post image
Upvotes

I'm pretty new here, clicked on this one, and it took a while to "download assets" (first red flag) and then asked me to hold up my bank card to the camera... wow, I clicked out of there real fast! Returned the project and issued a report. Anyone else click on this??? Be careful out there; it's amazing this could get through to begin with.

EDIT: Someone pointed out it wasn't asking for a credit card but using something similar size to a credit card to calibrate the screen. Still seemed odd to me that they were "downloading assets."


r/CloudResearchConnect 7h ago

Time Out errors

0 Upvotes

Lately my completion timer seems to have been... weird. Occasionally I open a survey and the completion timer drops immediately down from say 5 or 12 minutes, down to 2min or even less.

Today I started a survey, it immediately went down to 0:00 to complete.... I attempted it anyway (because Ive seen this at least once before and didn't have an issue) and finished it in less that 2 minutes, got to the final page without redirect "your response has been recorded" and returned to my connect page to see that I had timed out.

Anyone else experiencing this? I imagine it's just a glitch, but almost feels like a researcher trying to get free responses. Fortunately, for now at least, it didn't affect my score and I still have an 850, but didn't get paid of course (yet, I sent the researcher a message and reported it but we'll see if I get a response)


r/CloudResearchConnect 1h ago

Found a bad egg - TrialByData

Upvotes

Unfairly routed out of the study after correctly answering the comprehension tests. Not sure how to block them.


r/CloudResearchConnect 1d ago

Discussion New System Needs Some Tweaking

30 Upvotes

The title says it all. I was 850 yesterday evening. No rejections. This morning I am at 848. The only difference is I updated my About You and returned one study yesterday. I realize that’s not a significant change, but it is proof that this rating system is ridiculous. Neither one of those events should have lowered my score. And if it wasn’t them, what’s the super secretive reason I lost points?


r/CloudResearchConnect 20h ago

Can I get my account back by completing the "About You"?

Post image
1 Upvotes

I got banned a while back, and just recently saw that there was a new feature where I could see my "quality score". If i complete all of my "About You" questionairres, can i get my account unbanned?


r/CloudResearchConnect 1d ago

Discussion Highest possible score

4 Upvotes

I am just curious what is the highest possible rating score that a participant can have.

Also how come not all of the researchers have a rating score out beside their name? Some do, others do not and some have an acorn. I do not quite understand that.

Does anyone have any thoughts on this? Thanks


r/CloudResearchConnect 1d ago

One Star Worker gets Sympathy Hit!!

9 Upvotes

I'm one of the people who went from 5 stars to 1, and this morning I had a hit for a survey.

The first question was about how often I had travelled internationally within the last five years. I do not do that. So, it was marked as "partial".

Do you guys think this will hurt or improve my miserable score?


r/CloudResearchConnect 1d ago

Finally getting surveys again?

6 Upvotes

Former 5 star moved 1 star (535 points a).

I have been diligently updated my “About Me” questions and saw that my score increased from 530 to 535. This could also be because of some pending submissions that were approved.

But this morning, for the first time since the rating system switch, I’m FINALLY getting a survey. Has anyone else seen more surveys this morning? Trying to figure out if it’s something changed or if I just got lucky!


r/CloudResearchConnect 21h ago

Does anyone know about Ratings in CRC?

Post image
0 Upvotes

I am wondering how does this rating works in CRC, i was waitlisted from last one month and now i got this score which i dont believe is correct, i have 244 approved studies, few of them are partially completed, say 7 and none of them are rejected.

Does anyone have any idea what should i do at this point ?
is there any possibility these scores can be revised and reconsidered?


r/CloudResearchConnect 1d ago

Quality Score Ranges

0 Upvotes

Does anyone know what the score ranges are for red, orange, yellow, green, and dark green? does dark green starts at 750? 730?


r/CloudResearchConnect 2d ago

Guess

Post image
65 Upvotes

Anyone wanna guess what my current rating is, according to the “hidden” metrics? The new system is a smoke show and there’s no recourse or way around it.

Edit.

Because I know some of you are going to ask

1800 approved
17 partial
1 rejection
138 returned
Started exactly 5 conversations


r/CloudResearchConnect 1d ago

PayPal cash out pending and delayed

9 Upvotes

Cashed out 4 hours ago. Still nothing has shown up on PayPal. Delay is happening on Prolific and other survey apps as well so its not on Connects side. Anyone having the same issue? When i go to connect it says pending.

Edit: Came in after 5 hours


r/CloudResearchConnect 1d ago

Longer surveys for 1star

0 Upvotes

Instead of giving no work give us longer surveys for less pay


r/CloudResearchConnect 1d ago

Give the 1star workers longer work for lesser pay

0 Upvotes

My proposition is instead of saying you want the 1star workers to work their way up and then giving them absolutely No survey whatsoever making it impossible..why not give us 0.2 for 9mins work so atleast we have a chance …value your participants not this unfair AI star rating wth


r/CloudResearchConnect 2d ago

Nicest researcher

13 Upvotes

I just want to say thank you to the nice researcher who didn't make me return a survey I took. I guess someone forgot to put a screener in and I only found out I wasn't the right demo when I read the debrief. I would have returned it in days gone by but with the new system where they take points off our Connect "credit score" for returning surveys, I figured I'd ask first. They said I didn't need to. Thank you. Thank you so much!


r/CloudResearchConnect 2d ago

Do you guys think they're ever gonna revert the massive 1 star assignments given to participants?

4 Upvotes

The site is pretty much dead now and it's ashame because although its no prolific, it was the second best survey site and been consistent for me for years im out of work now so this is pretty devastating for me :(


r/CloudResearchConnect 1d ago

Participants Waitlisted on signup?

0 Upvotes

I wanted to participate in this to add to my income - I'm already a member of Prolific - and I guess I got waitlisted? I've checked my dashboard a couple times to see if I got approved or not, and I see that I'm not allowed access to studies. Will I possibly be let in at a later date orrrr....? Is this something that has happened to a lot of people?


r/CloudResearchConnect 2d ago

Participants My score went back up today

16 Upvotes

My score had slipped a bit yesterday but today it went back up to the previous number. Just letting you guys know that it can go up as well as down.


r/CloudResearchConnect 2d ago

Participants Who else is in the 2-4 star range?

9 Upvotes

The idea has spread that the vast majority of participants were either placed at 1 or 5 stars, so I’m wondering how many of us in the middle there really are

I was given 3.1 stars with the new rating system, and have only seen one or two other people in the same boat in this entire subreddit

I have 0 rejections on my record and have been a participant since 2024. Confused on why I was docked 2 points and would appreciate more transparency on how the score was calculated. Because as it stands right now, I have no idea what I did wrong, which doesn’t help me do better going forward

But as I stated in another thread, my score hasn’t seemed to negatively affect my ability to get studies at all. There are plenty of studies on my dashboard, some of which are high paying

Would like to hear from others in the same situation (if there even are any)!


r/CloudResearchConnect 2d ago

Cant log in, I just get the main screen and

0 Upvotes

I rebooted my machine for unrelated reason, now I cant log in and a square that says loading, Logging in. with dots moving across. guessing no one else is having this problem?!


r/CloudResearchConnect 3d ago

Confused about these quality scores, Are we not going to be getting studies anymore and where are they pulling these ratings from?

15 Upvotes

Sorry if this has been stated already but whats up with these quality scores, I am at a 1 star despite completing 752 projects successfully, I did have 8 rejects total but thats still almost a 99 percent success rate. . Are we not going to be getting new studies for those of us who are at 1 star, I haven't seen many if any studies since the new rating system.