Quick Answers: Validate a prototype

Overview

Quick Answers allow you to collect recorded video feedback of customers or prospects as they complete tasks and answer questions. The tasks and questions are written for you by UserTesting, and designed to answer the most common product and marketing challenges. You can read more about Quick Answers in the Overview of Quick Answers.

When to use “Validate a prototype”

Use “Validate a prototype" in the Design phase of the development process to:

  • Test a prototype or wireframe before building the product.
  • Understand if a prototype or wireframe solves people’s problem.

How to set up “Validate a prototype”

Quick Answers Input

1. From the dashboard click Get Quick Answers and select the option for validate a prototype.

Validate_prototype_01.jpg

2. Provide a link to the prototype with which you want participants to interact. The prototype can be any file viewable in a browser, ranging from a static image to a fully interactive prototype.

Important: Make sure the link to the document is set to View, so participants can’t make any changes. For help with sharing your document, see Limit how a file is shared

Next, describe the activity you want participants to try. Start your description with a verb, but don’t include exact steps, such as “Click on this button. Then this link. Then go….”

The description is added to a pre-written sentence, so it’s a good practice to use a lowercase letter for the first word and not end with a period or other punctuation. Quick Answers converts your description into the test questions, so the wording you enter is what people will see.

Some examples include:

  • sign up for the newsletter becomes 
    • Take as much time as you need to sign up for the newsletter
  • find out when to report for jury duty becomes 
    • Take as much time as you need to find out when to report for jury duty
  • change your profile picture becomes 
    • Take as much time as you need to change your profile picture.

Then name your test so it’s easy to recognize from other tests on the dashboard.

At this point, you'll need to determine who should take your test.

Participants from the UserTesting Panel
Learn more about the UserTesting Panel

Using My Recruit
Learn more about My Recruit

3. Click Next.

Prototype_test_summary.jpg

  • To see a list of all the questions the test asks participants, click the link under Tasks and Questions. To see what your test looks like to participants, click Preview Test to the right of the Test Plan Summary, then click Preview Test. When you finish the preview, click the Close button.

Note If you realize you need to add or remove a participant, or you find something you need to change in your test plan—for example, you used the wrong URL or you find a typo, do either of the following:

  • Click Participants to add or remove test participants.
  • Click Edit Details in the upper right. When you are done editing the test, click "Save and Go to Order Page."

4. Click Launch Test so send the test to participants.

After you click Launch Test, we send the test to participants who match the demographics you chose. These participants then answer any screener questions you added in order to qualify to take the test.

Here’s what we ask participants based on the questions you answered when you created the test:

For this test, don’t pretend to be someone else; we care about your needs and thoughts.

  1. The design you’re looking at is a prototype: a design that's not completely finished yet, so not everything will work like expected. If something does not work, explain what you would expect to happen and move on. Go to the next question to start.

  2. Take as much time as you need to [activity description].

    Note: The answer to this question is where we get the highlights for the video on the Results tab.

  3. [Rating] Overall, this activity was …? Explain your answer. 1=Very difficult…5=Very easy

  4. [Verbal] What part of the prototype made it *easy* to accomplish that activity?

  5. [Written] Summarize your previous answer in a few words; what part of the prototype made it *easy*?

  6. [Verbal] What part of the prototype made it *frustrating or hard* to accomplish that activity?

  7. [Written] Summarize your previous answer in a few words; what part of the prototype made it *frustrating or hard*?
     
  8. [Written] In one sentence describe the purpose of this solution. What problem does it solve or make easier? Describe it in your own words, not using language from the pages you saw.

  9. [Rating] How valuable is this solution to you? Explain your answer. 1=Not at all valuable…5 = Very valuable.

    Note: The answer to this question is where we get the data for the graph on the Results tab.

  10. [Verbal] Describe how you might benefit from using this. What will it help you do?

  11. [Written] Write 1–3 words that summarize your previous answer in the box below. How might you benefit?

  12. [Multiple Choice] From this list select 1 word that describes the *biggest improvement* you would make to this prototype: Aesthetics, Navigation, Trustworthiness, Understandability, Usefulness, or none of the above.

As participants finish, the software uploads the recorded video to our system and notifies you by email that the videos are ready to watch. Watch each participant’s entire video on the Session tab or wait for the fifth video session to be uploaded, at which point the highlight reel is available. 

Understanding the Results

For each test, the dashboard displays the type of test—using the same icon from each Quick Answer button—the test name, the day you created it, and how many participants have and have not taken the test.

After all participants finish, a summary appears in the Result column.

QAPrototype8.png

Click a test title on the dashboard to go to the Results tab on the Results page.

The Results tab provides a graph of how many people found your prototype or wireframe useful and valuable for completing an activity and provides a video of them discussing their answers and explaining why they answered the way they did. Here’s an example of five people describing why they did or did not find the prototype to buy an Eames chair valuable.

Unknown-5.png

 

Review the graph

The graph displays the answer, either:

  • More people found the solution valuable.

Or

  • More people did not find the solution valuable.

QAPrototype9.png

We get this information from the rating scale in Question 9 below. We ask participants, “How valuable is this solution to you?” 1=Not at all valuable…5 = Very valuable.

Then we count how many of the five participants did or did not find the idea valuable.

  • A score of 1, 2, or 3 = Not valuable
  • A score of 4 or 5 = Valuable

Watch key moments

The summary video shows all five participants discussing whether or not they find your solution valuable.

QAPrototype10.png

We get this information from Question 2 below. We tell participants: “Take as much time as you need to [activity description] and we record their comments as they do the task.


Note: Until all participants finish, the graph shows a running total as participants complete the test and displays the number of participants yet to finish, but there is no highlight video until all participants finish.

The results table on the Results tab is where you are likely to find the most useful feedback and insights because it lets you focus on the most important questions and zero in on specific answers from individual participants without having to watch their complete sessions.

You will also see tabs for:

  • Sessions: a list of the session videos for all participants
  • Metrics: a list of answers and links to videos for each task and question
  • Details: demographic overview, tasks, and questions from the test

 See this article for more details about the Results of Quick Answers tests.

 

 

 

Was this article helpful?
0 out of 1 found this helpful