Quick Answers: Compare two websites

Overview

Quick Answers allow you to collect recorded video feedback of customers or prospects as they complete tasks and answer questions. The tasks and questions are written for you by UserTesting, and designed to answer the most common product and marketing challenges. You can read more about Quick Answers in the Overview of Quick Answers. 

When to use “Comparing two websites”

The “Comparing two websitesQuick Answer can be useful for:

  • Compare two competitors’ sites to identify opportunities for how to present information on your site.
  • Comparing websites’ strengths, weaknesses, and ease of use.
  • Testing your website against a competitor’s.
  • Understanding how participants complete any activity on your site vs a competitor’s site today.
  • Compare two versions of your site - perhaps an older version and a newer one to compare how customers react to new layouts and designs.

How to set up “Comparing two websites”

Quick Answers Input

1. From the dashboard click Get Quick Answers, and select the option for testing websites.

Compare_two_websites_.png

2. Provide a link to the website that has the activity you want participants to try. You don’t have to start at the homepage.

Next, describe the activity you want participants to try. Start your description with a verb, but don’t include exact steps, such as “Click on this button. Then this link. Then go….”

The description is added to a pre-written sentence, so it’s a good practice to use a lowercase letter for the first word and not end with a period or other punctuation. Quick Answers converts your description into the test questions, so the wording you enter is what people will see.

Some examples include:

  • sign up for the newsletter becomes 
    • Take as much time as you need to sign up for the newsletter
  • find out when to report for jury duty becomes 
    • Take as much time as you need to find out when to report for jury duty
  • change your profile picture becomes 
    • Take as much time as you need to change your profile picture.

Give each website a simple name. Remember, you can point participants to any page on the sites. For example, if you want to test a store locator on two sites, you could have participants start at the store location page. The name you give the websites will be used to distinguish the two sites to participants within the test.

Then name your test so it’s easy to recognize from other tests on the dashboard.

At this point, you'll need to determine who should take your test.

Participants from the UserTesting Panel
Learn more about the UserTesting Panel

Using My Recruit
Learn more about My Recruit

3. Click Next

Tv_Purchasing_.png

  • To see a list of all the questions the test asks participants, click the link under Tasks and Questions. To see what your test looks like to participants, click the Options Menu (three dots) to the right of the Test Plan Summary, then click Preview Test. When you finish the preview, click the Close button.
    • To add or remove participants, click Participants.
    • If you need to edit the URL or you entered text that included a typo, click Edit Details in the upper right. When you are done editing the test, click "Save and Go to Order Page."

4. Click Launch test to send the test to participants.

After you click Launch Test, we send the test to participants who match the demographics you chose. These participants then answer any screener questions you added in order to qualify to take the test.


Here’s what we ask participants based on the inputs you provided when you created the test:

  1. Launch URL: [URL 1]  
    You have been taken to a new page. When you see the page, move on to the next step.
  2. Take as much time as you need to [activity]
  3. Overall, how difficult or easy was the activity? Explain your answer. [5-point Rating Scale: Very difficult to Very easy]
  4. Launch URL:[URL 2] 
    You have been taken to a new page. When you see the page, move on to the next step.
  5. Take as much time as you need to [activity].
  6. Overall, how difficult or easy was the activity? Explain your answer. [5-point Rating Scale: Very difficult to Very easy]
  7. Which website do you prefer? You will be asked to explain your answer in the next question. [Multiple Choice: Site A, Site B ]
  8. Please explain your previous answer. [Verbal Response]
  9. What, if anything, do you think Site A does better than Site B to help you [activity]? [Verbal Response]
  10. Summarize your previous answer in a few words. What do you think Site A does better to help you [activity]? [Written Response]
  11. What, if anything, do you think Site B does better than Site A to help you [activity]? [Verbal Response]
  12. Summarize your previous answer in a few words. What do you think Site B does better to help you [activity]? [Written Response]

Understanding the Results

For each test, the dashboard displays the type of test—using the same icon from each Quick Answer button—the test name, the day you created it, and how many participants have and have not taken the test.

Compare_two_websites_icon.png

After all participants finish, a summary appears in the Results column. From the dashboard, click on a test title to be taken to the Results page.

Results_Compare_two_websites.jpg

The results table on the Results tab is where you are likely to find the most useful feedback and insights because it lets you focus on the most important questions and zero in on specific answers from individual participants without having to watch their complete sessions.

The results are split into two categories based on who preferred site A and who preferred site B. This comes from Question 7 where we ask participants which site they prefer. The automatic highlight reels comes from Question 8 where we ask participants to explain their answer to Question 7. 


You will also see tabs for:

  • Sessions: a list of the session videos for all participants
  • Metrics: a list of answers and links to videos for each task and question
  • Details: demographic overview, tasks, and questions from the test

 See this article for more details about the Results of Quick Answers tests.

Was this article helpful?
0 out of 0 found this helpful