Quick Answer: Compare Two Websites

At a Glance

This article looks at the Compare two websites Quick Answer, which you can use to compare the strengths and drawbacks of two competitor sites or your site and that of a specific competitor. 

 

Quick Answer: Compare Two Websites is available on the following subscriptions:

Flex plan Seat-based plan
Essentials  Startup ✓ (marketing & product insight)
Advanced Professional ✓ (marketing & product insight)
Ultimate Premium ✓ (marketing & product insight)

 

Click on the following header titles to skip to that section of the article:

Quick Answers allow you to collect recorded video feedback of customers or prospects as they complete tasks and answer questions. The tasks and questions are written for you by UserTesting and designed to answer the most common marketing challenges. You can read more about Quick Answers in Quick Answers: Overview.

Compare two websites is one of the Quick Answers available on the platform. With it, you can see which of the two websites contributors prefer to use to complete a specific task.

When to Use Compare two websites

Use Compare two websites in the Discover and Iterate phases of the development process to:

  • Compare websites' strengths, weaknesses, and ease of use
  • Test your website against that of a competitor's

How to Set Up Compare two websites

1. Quick Answer Inputs
Click the Create test dropdown menu and select Customize a template.

customize_template.png

From the Template gallery, click the Quick Answers filter.

quick_answers.png

Then, find and click Compare two websites.

Screen_Shot_2022-02-03_at_4.32.14_PM.png

Note: Depending on your subscription, you may not have access to all the Quick Answers shown above.

2. Describe the task you want contributors to do on both sites.

Start your description with a verb, but don't include exact steps, such as "Click on this button. Then this link. Then go…."

The description is added to a pre-written sentence, so it's a good practice to use a lowercase letter for the first word and not end with a period or other punctuation. Quick Answers converts your description into the test questions, so the wording you enter is what people see.
Some examples include:

  • sign up for the newsletter becomes Take as much time as you need to sign up for the newsletter.
  • find out when to report for jury duty becomes Take as much time as you need to find out when to report for jury duty.
  • change your profile picture becomes Take as much time as you need to change your profile picture.

Enter the links and generic names for both websites.

Compare_two_websites_2.png

Then name your test so that it's easy to recognize from other tests on the dashboard. At this point, you'll need to determine who should take your test.

Launching a Test

Screen_Shot_2021-12-14_at_11.25.22_AM.png

To see a list of all the questions the test asks contributors, click the link under Tasks and Questions. To see what your test looks like to contributors, click Preview Test to the right of the Test Plan Summary, then click Preview Test. When you finish the preview, click the Close button.

Note If you realize you need to add or remove a contributor, or you find something you need to change in your test plan—for example, you used the wrong URL or you find a typo, do either of the following:

  • Click Contributors to add or remove test contributors.
  • Click Edit Details in the upper right. When you are done editing the test, click Save and Go to Order Page.

Click Launch Test to send the test to your contributors.

What We Ask Contributors

After you click Launch Test, we send the test to people in our UserTesting Contributor Network who match your chosen demographics. These people then answer any screener questions you added to qualify to take the test.

Here's what we ask contributors based on the questions you answered when you created the test:

Introduction

You'll be performing the same activity on two different websites and then asked to rate your experience. Please remember to clearly explain your thoughts and actions out loud. Don't pretend to be someone else; we care about your needs and thoughts.

  1. Launch URL: TESTA
    You have been taken to a new page. When you see the page, move on to the next step.
  2. Take as much time as you need to TEST.
  3. Overall, how difficult or easy was the activity? Explain your answer. [5-point Rating Scale: Difficult to Easy]
  4. You have been taken to a new page. When you see the page, move on to the next step.
  5. Take as much time as you need to TEST.
  6. Overall, how difficult or easy was the activity? Explain your answer. [5-point Rating Scale: Difficult to Easy]
  7. Which website do you prefer? You will be asked to explain your answer in the next question. [Multiple Choice: TESTANAME, TESTBNAME]
  8. Please explain your previous answer. [Verbal Response]
  9. What, if anything, do you think TESTANAME does better than TESTBNAME to help you TEST? [Verbal Response]
  10. Summarize your previous answer in a few words. What do you think TESTANAME does better to help you TEST? [Written Response]
  11. What, if anything, do you think TESTBNAME does better than TESTANAME to help you TEST? [Verbal Response]
  12. Summarize your previous answer in a few words. What do you think TESTBNAME does better to help you TEST? [Written Response]

As contributors finish, the software uploads the recorded video to our system. It notifies you by email that the videos are ready to watch (to configure notifications, see "Email notification preferences"). 

Reviewing the Results

For each test, the dashboard displays the test name, who created it, when it was last updated, and how many contributors have and have not taken the test.

After all the contributors finish, a Result summary appears below the test title.

Website_A_01.png

From here, you can share the results, create a similar test, or move the test to a different location. From the Dashboard, click on a test title to be taken to the Results page

Results Tab

After running this Quick Answer test, the Results tab shows contributors providing open-ended qualitative feedback describing their most recent experience on a particular task or activity you ask them to complete. 

The Results tab is a great place to start for Quick Answers. It summarizes the findings from the test: Do more contributors find the activity likable? Did the contributors express any frustrations? Videos of your contributors' open-ended feedback will display as Key Takeaways under the Results tab. 

To read more about the Results tab, check out our Results from Quick Answer Tests article.

 

Learn More

Need more information? Read these related articles: 

Want to learn more about this topic? Check out our University course:

Please provide any feedback you have on this article. Your feedback will be used to improve the article and should take no more than 5 minutes to complete. Article evaluations will remain completely confidential unless you request a follow-up. 

Was this article helpful?