At a Glance
Rating contributors is an effective way for you to help UserTesting ensure that contributors provide meaningful, actionable insights. This article demonstrates how to submit a rating and provides best practices for posting comments and follow-up questions for the contributor.
With UserTesting, you have access to a large network of contributors who are diverse in demographics (i.e. age, gender, income), experiences, and interests. Providing feedback to contributors who take your test ensures that contributors provide useful insights to the experiences and products you are testing. Let’s review some things you should know.
Click on the following header titles to skip to that section of the article:
How it works
To rate a contributor, find the contributor from either the session view...
…or the video player, then select the appropriate number of stars for the contributor.
2. If you give a one- or two-star rating to a contributor, a dialogue box will allow you to provide a reason for your rating.
Star rating system
We provide the option to rate a contributor’s performance based on how helpful they were for your test. To provide you with the best possible feedback, your tests will be distributed to highly-rated contributors first. For this reason, we encourage you to rate contributors often.
Rate contributors using our five-star rating system:
5 - Extremely Helpful
4 - Very Helpful
3 - Somewhat Helpful
2 - A Little Helpful
1 - Not Helpful
Five-star ratings are for contributors who provide honest and thorough feedback and successfully complete all of the tasks while speaking their thoughts out loud.
One-star ratings should be reserved for contributors who completely failed to provide you with usable feedback. If you give a one- or two-star rating, you will be prompted to select one of these main reasons for the rating:
- Instructions weren’t followed
- Speech was unclear or feedback was insufficient
- Demographics or screener requirements were not a match
- Trouble using UserTesting app or technical issue
- Personally Identifiable Information (PII) visible
If you select None of the reasons listed, you will be required to describe the reason and offer any optional comments.
After giving your rating, we will then ask how we can resolve the problem: refund the session, replace the contributor with a different one, or keep the session and report the problem only.
Note: If you replace the contributor or refund the session, you will no longer have access to the session video or its data. If you are a viewer or collaborator, you cannot refund the session. Viewers and Collaborators cannot request a refund.
Confidential ratings and comments
You always have the option to keep your rating, description, and comments behind it confidential. If you are leaving any feedback you do not want the test contributors to be able to read, please select this option. If you do not select this option, your rating and other comments can be seen by the contributor.
All one- and two-star ratings will be reviewed by UserTesting staff and appropriate coaching will be given as needed. Test contributors sincerely appreciate positive comments or even constructive criticism, so feel free to leave these useful comments visible. If your feedback skews more negatively, the UserTesting staff will be happy to handle relaying coaching and feedback for you.
If you’re a subscription customer and have a quick follow-up question for your contributor, you can contact the contributor after they complete your test
How it works
1. Contact contributors from the session view. First, click on the username to initiate a new message.
2. You can also begin a conversation from within the video player. Click on the contributor’s username at the top of the player and then click Contact [username].
The message center holds all of your communication with contributors who have completed tests for you.
How it works
1. To view your messages, click the dropdown next to your account email address, then select Messages.
2. Click View Conversation to see your message history with a test contributor.
Contributors are usually happy to provide additional feedback but are not compensated for answering follow-up questions through the Message Center. It’s the contributor's discretion on whether or not they respond. Find more information about how to message contributors here.
Need more information? Read these related articles.
Want to learn more about this topic? Check out our University courses.