Quick Answer: Compare Two Websites

Overview

Quick Answers allow you to collect recorded video feedback of customers or prospects as they complete tasks and answer questions. The tasks and questions are written for you by UserTesting, and designed to answer the most common marketing challenges. You can read more about Quick Answers in the Overview of Quick Answers.

Compare two websites is one of the Quick Answers available on the platform. With it, you can see which of the two websites participants prefer to use to complete a specific task.

When to use Compare two websites

Use Compare two websites in the Discover and Iterate phases of the development process to:

  • Compare websites’ strengths, weaknesses, and ease of use.
  • Test your website against a competitor’s.

How to Set up Compare two websites

1. Quick Answer Inputs
Depending on which dashboard you have, click Get Quick Answers.

Quick_Answers_4.png

Or click the New dropdown menu and select Create a test from a template.

Quick_Answers_3.png

From the template gallery, click the Quick Answers filter.

mi_quick_answers_1.png

Then, find and click Compare two websites.

Compare_two_websites_1.png

2. Describe the task you want participants to do on both sites. Start your description with a verb, but don’t include exact steps, such as “Click on this button. Then this link. Then go….”
The description is added to a pre-written sentence, so it’s a good practice to use a lowercase letter for the first word and not end with a period or other punctuation. Quick Answers converts your description into the test questions, so the wording you enter is what people see.
Some examples include:

  • sign up for the newsletter becomes Take as much time as you need to sign up for the newsletter.
  • find out when to report for jury duty becomes Take as much time as you need to find out when to report for jury duty.
  • change your profile picture becomes Take as much time as you need to change your profile picture.

Enter the links and generic names for both websites.

Compare_two_websites_2.png

Then name your test so it’s easy to recognize from other tests on the dashboard. 

At this point, you'll need to determine who should take your test.

3. Click Next.

Compare_two_websites_01.png

  • To see a list of all the questions the test asks participants, click the link under Tasks and Questions. To see what your test looks like to participants, click Preview Test to the right of the Test Plan Summary, then click Preview Test. When you finish the preview, click the Close button.

Note If you realize you need to add or remove a participant, or you find something you need to change in your test plan—for example, you used the wrong URL or you find a typo, do either of the following:

  • Click Participants to add or remove test participants.
  • Click Edit Details in the upper right. When you are done editing the test, click Save and Go to Order Page.

Click Launch Test to send the test to your participants.

How you get Quick Answers

After you click Launch Test, we send the test to people in our UserTesting Panel who match the demographics you chose. These people then answer any screener questions you added in order to qualify to take the test.

Here’s what we ask participants based on the questions you answered when you created the test:

Introduction

You’ll be performing the same activity on 2 different websites and then asked to rate your experience. Please remember to clearly explain your thoughts and actions out loud. Don’t pretend to be someone else; we care about your needs and thoughts.

  1. Launch URL: TESTA
    You have been taken to a new page. When you see the page, move on to the next step.
  2. Take as much time as you need to TEST.
  3. Overall, how difficult or easy was the activity? Explain your answer. [5-point Rating Scale: Difficult to Easy]
  4. You have been taken to a new page. When you see the page, move on to the next step.
  5. Take as much time as you need to TEST.
  6. Overall, how difficult or easy was the activity? Explain your answer. [5-point Rating Scale: Difficult to Easy]
  7. Which website do you prefer? You will be asked to explain your answer in the next question. [Multiple Choice: TESTANAME, TESTBNAME]
  8. Please explain your previous answer. [Verbal Response]
  9. What, if anything, do you think TESTANAME does better than TESTBNAME to help you TEST? [Verbal Response]
  10. Summarize your previous answer in a few words. What do you think TESTANAME does better to help you TEST? [Written Response]
  11. What, if anything, do you think TESTBNAME does better than TESTANAME to help you TEST? [Verbal Response]
  12. Summarize your previous answer in a few words. What do you think TESTBNAME does better to help you TEST? [Written Response]

As participants finish, the software uploads the recorded video to our system and notifies you by email that the videos are ready to watch. 

Understanding the Results

For each test, the dashboard displays the test name, who created it, when it was last updated, and how many participants have and have not taken the test.

After all the participants finish, a summary of the results appears on your main dashboard.

Website_A_01.png

 Click a test title on the dashboard to go to the Results tab on the Results page.

Results Tab

The Results tab is a great place to start for Quick Answers. It summarizes the answer to your question: Which website do people prefer?

We get the answers from Question 7: Which website do you prefer? You will be asked to explain your answer in the next question. [Multiple Choice: TESTANAME, TESTBNAME]

The results table below the highlight reels provides a quick and easy way to scan through the results in greater detail. We’ve summarized the key findings in the following sub-tabs:

  • Website A experience
  • Website A ease of use
  • Website B experience 
  • Website B ease of use
  • Website A pros
  • Website B pros

Most sub-tabs have brief written responses (provided by participants) to help you identify interesting responses more quickly. Once you’ve found feedback you’d like to dig into further, you can watch the video response from that participant by clicking on the written responses. This will take you to that specific moment in the video to hear what else they had to say about that particular experience. Alternatively, you can watch their entire response by clicking on Watch Session below their screen name.
The results table on the Results tab is where you are likely to find the most useful feedback and insights because it lets you focus on the most important questions and zero in on specific answers from individual participants without having to watch their complete sessions.

You will also see tabs for:

  • Sessions: a list of the session videos for all participants
  • Metrics: a list of answers and links to videos for each task and question
  • Details: demographic overview, tasks, and questions from the test

 See this article for more details about the Results of Quick Answers tests.

See also
Quick Answer: Test website usability
Quick Answer: Choose between two options
Quick Answer: Validate a prototype
Quick Answer: Validate an Idea
Quick Answer: Discover needs and frustrations
Product Insight: Getting Started

Was this article helpful?
1 out of 2 found this helpful