What are Quick Answers?
Quick Answers are recorded video feedback of customers or prospects as they complete tasks and answer questions. The tasks and questions are written for you by UserTesting, and designed to answer the most common product development problems. You can read more about Quick Answers in the Product Insight: Getting Started.
“Discover needs and frustrations” is one of seven types of Quick Answers in Product Insight. With it, you can explore customers’ experiences and frustrations with an experience or activity you specify. The test explores how they perform that activity today, and whether they find it likable or not.
After running this Quick Answer test, the Summary tab shows how many test participants found the experience likable or unlikable, and provides two automatically generated highlight reels of them discussing their answers and explaining why they answered the way they did. Here’s an example of five test participants describing their thoughts on watching live-streaming news.
If you want to dig into the findings, there are several options. The results table below the highlight reels provides additional feedback from participants about how they feel about that particular experience or activity. The Metrics and Session tabs provide the full recordings broken out by question or participant respectively.
When to use “Discover needs and frustrations”
Use “Discover needs and frustrations" in the Discover phase of the development process to:
- Empathize with customers to understand how they complete activities today
- Uncover needs and opportunities that resolve their pain points and frustrations
- Prioritize feature sets based on how customers describe their pain points
- Develop more robust requirements based on real customer feedback
How to set up “Discover needs and frustrations”
- From the dashboard click Get Quick Answers, then click “Discover needs and frustrations.”
Give a short description of the experience or activity you want participants to discuss.
Important: You must start the short description with a verb ending in -ing. The description is added to a pre-written sentence, so it’s a good practice to use a lowercase letter for the first word and not end with a period or other punctuation. Quick Answers converts your description into the test questions, so the wording you enter is what people see.
Some examples include:
- booking a flight becomes: Describe your most recent experience booking a flight.
- running becomes: Describe your most recent experience running.
- paying the bills becomes: Describe your most recent experience paying the bills.
Then name your test so it’s easy to recognize from other tests on your dashboard. Product Insight displays your entire account’s tests on your dashboard. At this point, you'll need to determine whether you'd like to test with participants from the UserTesting Panel, or your own customers, via My Recruit. For this example, we'll be using the UserTesting Panel.
When you’re done, click Next.
- Select Participants
The UserTesting panel is a diverse and global on-demand group of people who take tests. The panel is made up of real people, carefully selected after a thorough application process, who are continually rated by our customers, assuring the highest quality results. To find participants you’ll be able to select device type, set demographic filters, and create custom screener questions. These are detailed in Product Insight: Find the Right Participants.
Launching a Test
To see a list of all the questions the test asks participants, click the link under Tasks and Questions. To see what your test looks like to participants, click Preview Test to the right of the Test Plan Summary, then click Preview Test. When you finish the preview, click the Close button.
ⓘ Note If you realize you need to add or remove a participant, or you find something you need to change in your test plan—for example, you used the wrong URL or you find a typo, do either of the following:
- Click Participants to add or remove test participants.
- Click Edit Details in the upper right. When you are done editing the test, click "Save and Go to Order Page."
Click Launch Test to send the test to the UserTesting Panel.
4. Reviewing Results
As participants finish, the software uploads the recorded video to our system and notifies you by email. To configure notifications, see Email notification preferences.
Open the email and click the “account dashboard” link in the order summary to go to the dashboard.
For each test, the dashboard displays the type of test—using the same icon from each Quick Answer button—the test name, the day you created it, and how many participants have and have not taken the test.
After all participants finish, a summary appears on your main dashboard.
Click a test title on the dashboard to go to the Summary tab on the Results page.
The Summary tab is a great place to start for Quick Answers. It summarizes the findings from the test: Do more participants find the activity likeable or unlikeable? The answer is split into two automatically generated highlight reels (Watch key moments) to help you summarize and organize the findings based on the participants preferences.
Whether a participant finds the experience or activity likable comes from Question 8. We ask participants, “How satisfied are you with [activity] in general?” 1=Not at all satisfied…5 = Very satisfied. A score of 1, 2, or 3 means they found the experience unlikable. A score of 4 or 5 means they found the experience likable.
The automatic highlight reels show participants describing their most recent experience trying to perform this activity. We get this information from Question 3 below. We ask participants: “Describe your most recent experience [activity]” and we record their comments as they explain their answers.
The results table below the highlight reels provides a quick and easy way to scan through the results in greater detail. We’ve summarized the key findings in the following sub-tabs:
- Frequency of activity
- What made it easy
- What made it hard
- Most recent experience
- Typical experience
Most sub-tabs have brief written responses (provided by participants) to help you identify interesting responses more quickly. Once you’ve found feedback you’d like to dig into further, you can watch the video response from that participant by clicking on “Watch Session” below their screen name. This will take you to that specific moment in the video to hear what else they had to say about that particular experience.
The results table on the Summary tab is where you are likely to find the most useful feedback and insights because it lets you focus on the most important questions and zero in on specific answers from individual participant’s without having to watch their complete sessions.
Click the Sessions tab to watch each participant’s complete video as they answer all the questions in order. Sessions are available as each participant finishes. There is a text field on the right for you to add a summary of the video. The Summary field is also useful for adding timecodes for moments of interest, such as a participant expressing delight with an experience, or complaining about a difficult interface.
Click the Metrics tab to watch participants’ videos broken down for every single question so you can easily skim the results. It’s essentially an expanded view of the results table on the Summary Tab.
Click the Details tab to see the demographics breakdown and an overview of the test plan’s tasks and questions.
How you get Quick Answers
After you click Launch Test, we send the test to participants in the UserTesting Panel who match the demographics you chose. These participants then answer any screener questions you added in order to qualify to take the test.
If you’d like to see what answering screener questions looks like from the participants’ view, watch this video.
Once they qualify, we ask participants to record themselves while describing the recent experience you specified. For “Discover needs and frustrations,” we ask that participants to show their faces, so we ask them to turn on their webcam. Then we ask them a series of questions about the experience or activity you provided. We use the exact phrase you provide in the first step in the questions below. This is why it’s important to use a verb ending in -ing.
Here’s what we ask participants based on the questions you answered when you created the test:
- As we ask you questions during this test we'd like to see your face. Go to http://bit.ly/turncameraon to find instructions on how to do this based on the device you are using now." If you are not comfortable doing this, please end the test now.
- [Multiple Choice] How often are you [activity]? Select the option that best matches your answer and explain your answer verbally. Go back to the camera to explain your answer so we see your face.
- More than 1x a day
- Every day
- Several times a week
- Once a week
- Every few weeks
- Once a month
- Every few months
- Once or twice a year
- Less than once a year
[Verbal] Describe your most recent experience [activity]. Be specific and describe what worked well and what didn’t. Go back to the camera to explain your answer so we see your face.
- [Written] What made it **easy**? Don't write a whole sentence, summarize your answer in a few words. Go back to the camera to explain your answer in more detail, while we see your face.
- [Written] What made it **frustrating or hard**? Don't write a whole sentence, summarize your answer in a few words. Go back to the camera to explain your answer in more detail, while we see your face.
- [Written] Describe what you used during your most recent experience. Be specific. Write a few words that summarize your answer in the box below. Go back to the camera to explain your answer in more detail, while we see your face.
- [Multiple Choice] How similar is your most recent experience [activity] to how you typically do that? Go back to the camera to explain your answer in more detail, while we see your face.
- My most recent experience is just like it always goes
- My most recent experience was better than usual
- My most recent experience was worse than usual
- This was my first time
- I don’t know
- [Rating] How satisfied are you with [activity] in general? Go back to the camera to explain your answer in more detail, while we see your face. [5-point Rating Scale: Not at all satisfied to Very satisfied]
Note: The answer to this question is where we get the data for the graph on the Summary tab.
As participants finish, the software uploads the recorded video to our system and notifies you by email that the videos are ready to watch. Watch each participant’s entire video on the Session tab or wait for the fifth video session to be uploaded, at which point the highlight reels and results table are available.
Product Insight: Getting Started
Quick Answer: Discover needs and frustrations
Quick Answer: Compare two websites
Quick Answer: Test website usability
Quick Answer: Validate an Idea
Quick Answer: Validate a prototype
Quick Answer: Choose between two options
Product Insight: Live Conversation