Quick Answer: Compare Two Websites

This article applies to: UserTesting 

On this page:

• When to use Compare two websites
• How to set up Compare two websites
• Launching a test
• What we ask participants
• Reviewing the results

When to use Compare two websites

Use Compare two websites in the Discover and Iterate phases of the development process to:

•  
  • Compare websites' strengths, weaknesses, and ease of use
  • Test your website against that of a competitor's

How to set up Compare two websites

Quick Answer Inputs
1. Click the Create test dropdown menu and select Templates Library.

2. Navigate to the Quick Answers filter.

3. Find and click Compare two websites.
 

Note: Depending on your subscription, you may not have access to all the Quick Answers shown above.

4. Describe the task you want participants to do on both sites.

Start your description with a verb, but don't include exact steps, such as "Click on this button. Then this link. Then go…."

The description is added to a pre-written sentence, so it's a good practice to use a lowercase letter for the first word and not end with a period or other punctuation. Quick Answers converts your description into the test questions, so the wording you enter is what people see.
Some examples include:

• sign up for the newsletter becomes Take as much time as you need to sign up for the newsletter.
• find out when to report for jury duty becomes Take as much time as you need to find out when to report for jury duty.
• change your profile picture becomes Take as much time as you need to change your profile picture.

Enter the links and generic names for both websites.
 

Then name your test so that it's easy to recognize from other tests on the dashboard. At this point, you'll need to determine who should take your test.

• Contributors from the UserTesting Network
  • Learn more about the UserTesting Network
• Using Invite Network 
  • Learn more about Invite Network

Launching a test

• To see a list of all the questions the test asks participants, click the link under Tasks and Questions.
• To see what your test looks like to participants, click Preview Test to the right of the Test Plan Summary, then click Preview Test. When you finish the preview, click the Close button.
• ⓘ Note If you realize you need to add or remove a participant, or you find something you need to change in your test plan—for example, you used the wrong URL or you find a typo, do either of the following:
• • Click Contributors to add or remove test participants.
  • Click Edit Details in the upper right. When you are done editing the test, click Save.
• Click Launch Test to send the test to your participants.

What we ask participants

Here's what we ask participants based on the questions you answered when you created the test:

Introduction

You'll be performing the same activity on two different websites and then asked to rate your experience. Please remember to clearly explain your thoughts and actions out loud. Don't pretend to be someone else; we care about your needs and thoughts.
 

1. Launch URL: TESTA

   You have been taken to a new page. When you see the page, move on to the next step.

2. Take as much time as you need to TEST.
3. Overall, how difficult or easy was the activity? Explain your answer. [5-point Rating Scale: Difficult to Easy]
4. You have been taken to a new page. When you see the page, move on to the next step.
5. Take as much time as you need to TEST.
6. Overall, how difficult or easy was the activity? Explain your answer. [5-point Rating Scale: Difficult to Easy]
7. Which website do you prefer? You will be asked to explain your answer in the next question. [Multiple Choice: TESTANAME, TESTBNAME]
8. Please explain your previous answer. [Verbal Response]
9. What, if anything, do you think TESTANAME does better than TESTBNAME to help you TEST? [Verbal Response]
10. Summarize your previous answer in a few words. What do you think TESTANAME does better to help you TEST? [Written Response]
11. What, if anything, do you think TESTBNAME does better than TESTANAME to help you TEST? [Verbal Response]
12. Summarize your previous answer in a few words. What do you think TESTBNAME does better to help you TEST? [Written Response]

As participants finish, the software uploads the recorded video to our system. It notifies you by email that the videos are ready to watch (to configure notifications, see "Email notification preferences"). 

Reviewing the results

• After running this Quick Answer test, the Results tab shows participants providing open-ended qualitative feedback describing their most recent experience on a particular task or activity you ask them to complete.
• The Results tab is a great place to start for Quick Answers. It summarizes the findings from the test: Do more participants find the activity likable? Did the participants express any frustrations? Videos of your participants' open-ended feedback will display as Key Takeaways under the Results tab.
• To read more about the Results tab, check out our Results from Quick Answer Tests article.

Related content