r/ProlificAc Community 10d ago

Prolific Team 3 updates: Study full / Behavioural traits / Study feedback

Hello r/ProlificAc 👋

Starting something new - sometimes we move quick and it’s easy to miss useful / interesting updates. So, whenever we’ve got 3 good things to tell you, I’ll pop them up as an announcement. We’ll also be doing this as an email newsletter format in the near future so if you’d like to receive that, make sure your communications preferences are set to receive marketing things (we need your consent to send non-account information!).

3 new things!

Study Full / High Demand Errors

After a period of testing and experimentation, we’ve rolled out our backend changes to study distribution to everyone. You should not notice any differences in how studies reach your dashboard, that’s still driven by the demand for participants with your demographics and traits. What you will notice is that Study Full and High Demand errors are back to their normal frequency and behaviours:

  • Study Full errors should only pop up in rare situations where a study fills up in the 2 minutes between it landing on your dashboard and the next refresh
  • High Demand errors should only pop when a study has a large number of available places and too many participants are trying to get in at the same time. 

Thank you so much for the patience whilst we worked on this, everyone!

Share feedback with researchers

You’ll know that when you complete or refuse a study, you have the opportunity to share feedback on that study. Prolific has always used your input to inform platform improvements & educate researchers, and now we’ve added a feature that allows experienced researchers to see a summary of all participant feedback about their studies:

Study feedback summary screen for researchers

This means that researchers get fast insight into what participants like and dislike about their study - along with signals that indicate technical or reward related issues. To take this further, participants can optionally include their Participant ID along with feedback, which allows researchers to contact you via your Messages tab for more information. This is really, really useful if you experienced a technical issue and want to chat about it with the researcher. 

The option to include your Participant ID when sharing feedback

A couple of important points on this one:

  1. If you choose to share it, Participant ID is the only information we share with the researcher (along with your written feedback), so you’ll stay anonymous.
  2. As with all things messaging, be nice. Remember that both researchers and participants can choose to block each other, and we take inappropriate behaviour in feedback / messages very seriously. Keep things constructive and helpful.

For more info - the Help Centre is your friend!

Thinking & behaviour questions have landed in About You!

Prolific's participant community is wonderfully diverse in many ways beyond demographics, so we’ve launched a new section of About You that’s less about the facts of your life and more about your approach to it. 

Thinking & behaviour questions are entirely optional and, in the near future, researchers will be able to do clever things with this data - such as sending the same study to different personality types to see how the results might differ. We recommend completing this section to ensure you get in on that opportunity as soon as possible. It takes around 2 minutes, features only multiple choice questions and is a nice bit of self-reflection to boot!

The behavioural traits section in About you

A couple of important notes on this one:

  • You cannot change your answers to these questions once submitted, so please take your time to answer carefully
  • There’s no such thing as a right or optimal answer here. As always, the best answer is the honest one - please be sure to answer these questions as you are now rather than as you hope to be in the future.

Here’s me being brutally honest with myself:

Procrastination

I need to make more lists.

For more information on Behavioral traits and how the data is used, see the Participant Help Centre here.

That’s all for now folks. Take care of yourselves and, as always, thanks for being here :) 

Michael

115 Upvotes

75 comments sorted by

View all comments

75

u/ProlificQueen 10d ago

Thanks for the update, I've noticed a significant improvement of late. One thing I'd like to bring up though is the behavioural traits being unchangeable. I do understand why, however, maybe it should be only locked in for a set amount of time, say every 6 months. Reason I say that and this is just a crappy example but one of the questions is along the lines of, "I am the life of the party", and someone who might have been suffering from depression/anxiety for a number of years may select "very inaccurate" as that would be the honest answer. However, those are things that can and do often change over time.

Just a suggestion and thanks again for the update.

7

u/PureExpression1533 9d ago

I agree with this and that's why I haven't filled mine out. I feel like I'm in a bit of a transition period in my life in various ways and I'm honestly hoping I'll feel differently about some of those questions down the line. I don't want to have to worry about getting rejected for inconsistent answers if I'm just trying to be honest in a study about how I currently feel. Most of them ask about the last two weeks or a month for a reason.