Moderated vs. unmoderated tests

This article applies to: UserTesting 

On this page:

• What is a moderated test?
• When to use a moderated test
• What is an unmoderated test?
• When to use unmoderated tests
• Moderated vs. unmoderated tests

What is a moderated test?

• A moderated test is a real-time interview with someone who tests your product or service (or its concept, prototype, or design). Such interviews can also focus on user behavior and decision-making.
• Moderated tests can be done remotely or in person.
• Remote interviews with UserTesting are called Live Conversations.
  • Your interactions with participants occur in real time in the same virtual space. 
  • Participants connect with you using a remote conferencing tool that allows you to communicate through video, phone, chat, or a combination of methods.

When to use a moderated test

Use moderated tests when you need to:

• Ask individualized follow-up questions in real time.
• Ensure participants do not get stuck while doing something difficult, like interacting with a complex or low-fidelity prototype.
• Ask follow-up questions based on real-time facial expressions or body language, keeping in mind that participants may not always act naturally when they know they're being observed.
• Have an in-depth, back-and-forth conversation to explore participants' mindsets during discovery-stage research.
• Test prototypes that cannot leave an internal or secure environment, using remote control to allow participants to interact in a controlled setting.
• Tests with complex dependent tasks, where users need to complete one task before moving to the next.
• Help quieter participants feel comfortable enough to share more candid feedback.
   

See what a moderated test looks like.

What is an unmoderated test?

• An unmoderated test is when participants complete predetermined tasks without the guidance of a moderator.
• The participant decides when and where they would like to complete the test, and they provide feedback out loud as they record their session. You review the recorded session at a later time.
• Unlike a moderated test, an unmoderated test involves no communication with the participant in real time.
• Instead, you can ask predetermined follow-up questions in the test or follow up with the participant after viewing their session.
• Because modifications cannot be done in the moment with the participant, unmoderated tests may require more effort up front.

When to use unmoderated tests

Use unmoderated tests when you need to:

• Gather feedback quickly, with tests often completed the same day.
• Collect feedback from larger sample sizes in a short amount of time without scheduling live sessions.
• Reduce potential moderator influence to capture more natural participant responses and behavior.
• This is sometimes called the Hawthorne effect — the tendency for people to change how they behave when they know they're being observed. Learn more about the Hawthorne effect in user research.
• Capture visual engagement data such as click maps or heat maps to understand how participants interact with your design.
• Observe more natural participant behavior over time, such as in a multi-part diary study.
  Work on other tasks while participants independently complete structured activities.
   

Check out how to test a prototype, website, or app on the platform.

Moderated vs. unmoderated tests

Here are the main differences between the two:

Related content