Balanced comparison feature

Turn on Balanced comparison in your test plan when you want to compare two parts in your study. The order of the compared sections alternates for each contributor.

This article applies to: ut logo tiny.pngUserTesting 

Balanced Comparison is available on the following subscriptions:

Flex plan Seat-based plan
Essentials Startup
Advanced Professional
Ultimate Premium


On this page:



About the Balanced comparison feature

  • When you use Balanced comparison, you create two sections in your study, Part A and Part B.
  • The order in which contributors see the two parts is automatically alternated: the first contributor will see option A first and B second, the next will see option B first and option A second, and so on.
  • The Balanced comparison feature is designed to reduce the risk of that bias.
  • You can use Balanced Comparison to test any website, prototype, or app. You can also go to the Template gallery for further guidance.
  • A recommended sample size is 12.

Note: Card sort tasks and Tree test tasks don't work with Balanced Comparison.



Add Balanced comparison to your test

  1. Create a new test and select your contributors.
  2. Add your tasks and questions
  3. Choose the Balanced comparison task from the Task groups section.
  4. After a new part of your study labeled Group A and Group B populates, drag tasks and questions into these areas. You can also put questions and tasks before and after the balanced part of the study.  
    Test-Plan-Editor-UserTesting (8).png
    Note: When comparing two different URLs we recommend beginning on a blank page, then placing the first URL in section A and the second URL in section B.
  5. Launch your test.



Review your videos

  • Completed tests will appear on your dashboard as they would normally.
  • The order of tasks in an individual study is displayed in the Tasks tab in the video player.



Related content

information icon.png

knowledge icon.png

Want to learn more? Check out these Knowledge Base articles... 

Interested in growing your skills? Check out our University courses...

video icon 2.png

team icon.png

Need hands-on training?

Can't find your answer?


Please provide any feedback you have on this article. Your feedback will be used to improve the article and should take no more than 5 minutes to complete. Article evaluations will remain completely confidential unless you request a follow-up. 

Was this article helpful?
0 out of 0 found this helpful