Quick Answer: Validate an Idea

Overview

Quick Answers allow you to collect recorded video feedback of customers or prospects as they complete tasks and answer questions independently and remotely. The tasks and questions are written for you by UserTesting.  You can read about the other Quick Answers in Using Quick Answers.

When to use Validate an idea

Validate an idea is one of the available Quick Answers. The focus is on learning how customers react to an idea for a product or service. Think of this as a concept test, something you do before creating a full prototype. We ask customers a series of questions about your concept, and they also say if they think it is valuable.

Use Validate an idea in the Discover phase of the development process to:

  • Get reactions to a product or feature idea
  • Identify potential questions from customers

How  to Set up Validate an idea

Quick Answer Inputs

1. Depending on which dashboard you have, click Get Quick Answers.

Quick_Answers_4.png

Or click the New dropdown menu and select Create a test from a template.

Quick_Answers_3.png

From the template gallery, select the Quick Answers filter.

mi_quick_answers_1.png

Then, find and click Validate an idea.
Validate_an_idea.png

2. Provide a link to a publicly accessible page or document that shows or describes the content. The link needs to point to a single document, hosted online. The link can be to a Microsoft or Google doc, a Slides or PowerPoint presentation, a PDF, image, text, or anything similar.

Validate_an_idea_2.png

ImportantMake sure the link to the document is set to View, so participants can’t make any changes. For help with sharing your document, see Limit how a file is shared.

Then name your test so it’s easy to recognize from other tests on the dashboard.
At this point, you'll need to determine who should take your test.

3. Click Next

Validate_idea_02.png

  • To see a list of all the questions the test asks participants, click the link under Tasks and Questions. To see what your test looks like to participants, click the Options Menu (three dots) to the right of the Test Plan Summary, then click Preview Test. When you finish the preview, click the Close button.
    • To add or remove participants, click Participants.
    • If you need to edit the URL or you entered text that included a typo, click Edit Details in the upper right. When you are done editing the test, click Save and Go to Order Page.

Click Launch Test to send the test to the UserTesting Panel.

How you get Quick Answers 

After you click Launch Test, we send the test to participants who match the demographics you chose. These participants then answer any screener questions you added in order to qualify to take the test.

Here’s what we ask participants based on the inputs you provided when you created the test:

  1. In one sentence describe the purpose of this idea. Describe it in your own words, not using language from the page you see. [Written Response]
  2. How valuable is this idea to you? You will be asked to explain your answer in the next question. [5-point Rating Scale: Not at all valuable to Very valuable]
  3. Please explain your previous answer.  How valuable is this idea to you? [Verbal Response]
  4. Describe how you might benefit from using this. What will it help you do? [Verbal Response]
  5. Write 1-3 words that summarize your previous answer in the box below. How might you benefit? [Written Response]
  6. Which part of the idea is the **most** compelling to you? [Verbal Response]
  7. Write 1-3 words that summarize your previous answer in the box below. Which part is **most** compelling? [Written Response]
  8. Which part of the idea is the **least** compelling to you? [Verbal Response]
  9. Write 1-3 words that summarize your previous answer in the box below. Which part is **least** compelling? [Written Response]

As participants finish, the software uploads the recorded video to our system and notifies you by email that the videos are ready to watch. 

Understanding the Results

For each test, the dashboard displays the test name, who created it, when it was last updated, and how many participants have and have not taken the test.

 After all the participants finish, a summary of the results appears on your main dashboard.

Test_Summary.png

Click a test title on the dashboard to go to the Results tab on the Results page.

Results Tab 

The Results tab is a great place to start for Quick Answers. It summarizes the findings from the test: Do more people find this idea valuable or not valuable? Videos of your participants' open-ended feedback will display as Key Takeaways under the Results tab. 

Whether a participant finds the concept valuable or not at all valuable comes from Question 2. We ask participants, “How valuable is this idea to you? Explain your answer." [5-point Rating Scale: Not at all valuable to Very valuable].

  • A score of 1  or 2 means they found the concept not at all valuable.
  • A score of 3 is neutral.
  • A score of 4 or 5 means they found the concept very valuable.

Then we count how many of the five participants did or did not find the idea valuable.

The results table below the highlight reels provides a quick and easy way to scan through the results in greater detail. We’ve summarized the key findings in the following sub-tabs:

  • Purpose
  • Benefit
  • Most compelling
  • Least compelling

Most sub-tabs have brief written responses (provided by participants) to help you identify interesting responses. Once you’ve found feedback you’d like to dig into further, you can watch the video response from that participant by clicking on the written responses. This will take you to that specific moment in the video to hear what else they had to say about that particular experience. 

The results table on the Results tab is where you are likely to find the most useful feedback and insights because it lets you focus on the most important questions and zero in on specific answers from individual participants without having to watch their complete sessions.

You will also see tabs for:

  • Sessions: a list of the session videos for all participants
  • Metrics: a list of answers and links to videos for each task and question
  • Details: demographic overview, tasks, and questions from the test

 See this article for more details about the Results of Quick Answers tests.

 

 

Was this article helpful?
1 out of 2 found this helpful