Moderated vs. Unmoderated Tests

At a Glance

Gather real human insight using moderated and unmoderated tests to support and facilitate your goals. This article provides some clarification and guidance on when to choose a moderated or an unmoderated test.

What Is a Moderated Test?

When to Use a Moderated Test

What Is Unmoderated Usability Testing?

When to Use Unmoderated Tests

Moderated vs. Unmoderated Tests

What Is a Moderated Test?

A moderated test is a real-time interview with someone who tests your product or service (or the concept/prototype/design of that product or service). This type of test can be done remotely or in person. If done remotely, as a Live Conversation, your interaction with the contributors occurs in real-time, in the same “virtual” space. Contributors connect with you using a remote conferencing tool such as Web conferencing, VoIP, phone, chat, or a combination of methods.

When to Use a Moderated Test

Moderated usability tests are great when you would like to...

  • Ask individualized follow-up questions in real-time.
  • Ensure that contributors do not get stuck while doing something technically difficult, like dealing with a complex or low-fidelity prototype when testing concepts or ideas.
  • Ensure quiet contributors are more vocal since the moderator can prompt them to share what they are thinking.
  • Observe body language and pick up on the subtleties of contributor behavior.

Resource: What does a moderated test look like?

What Is Unmoderated Testing?

An unmoderated test is when contributors complete predetermined tasks on their own, without the guidance of a moderator. The contributor decides when and where they would like to complete the test, and provides feedback as they record their session.

The contributor thinks out loud as they complete the tasks, and the researcher reviews the recorded sessions at a later time. Unlike a moderated test, the researcher does not communicate with the contributor in real-time; they may include follow-up questions as part of the test or, after viewing the session, they may follow up with the contributor. Unmoderated tests may require more effort upfront since modifications cannot be done in the moment with a contributor.

When to Use Unmoderated Tests

Unmoderated tests are useful when you would like to...

  • Gather feedback quickly. A test can often be completed by UserTesting contributors on the same day!
  • Ensure you’re getting a contributor’s unbiased feedback. Sometimes a moderator’s presence can influence the response or behavior of a contributor, who may be inclined to want to please the person conducting the test.
  • Complete other tasks while contributors work on their structured activities. This is possible since a moderator does not need to be present during each session.

Resource: Remote unmoderated usability test 

Moderated vs. Unmoderated Tests

Moderated Test Unmoderated Test

Allows for individualized follow-up questions in real-time

Often features a quick turnaround in receiving contributor feedback

Real-time assistance from the moderator

Suitable for obtaining larger sample sizes

Can be conducted remotely or in person

Is self-guided and unmonitored

 

The primary difference between moderated and unmoderated tests is that with moderated tests you (or a moderator) have to be present to guide the contributors through the tasks. With unmoderated tests, you do not need to be present, and contributors are in their natural environment. Whether you require a high level of interaction with your contributors or need contributors to do self-paced tasks, the UserTesting Platform accommodates both approaches.

Learn More

Need more information? Read these articles:

Want to learn more about this topic? Check out our University courses:

Please provide any feedback you have on this article. Your feedback will be used to improve the article, and when you submit your survey you'll be entered into a drawing for a $50 Amazon gift card. This survey should take 5 minutes to complete. Article evaluations will remain completely confidential.

Was this article helpful?
13 out of 15 found this helpful