Quick Answer Builder Guide

Seat-based_PI_MI_FlexAdvUlt.png

At a Glance

Quick Answer Builder lets you create Quick Answer templates to empower your colleagues to run tests based on your organization’s needs and best practices. This article walks through the three steps to build a Quick Answer template that anyone on your team can use.

 

Creating a Quick Answer Template

Step 1: Test Title

Step 2: Test Plan

Step 3: Quick Start Form

Best Practices for Building Your Quick Answer

 

Creating a Quick Answer Template

Quick Answers allow anyone to get fast feedback from customers on the UserTesting platform. With the Quick Answer Builder, you can create your own Quick Answer templates customized for your team’s needs. To get started creating a custom Quick Answer:

1. Choose Template Library from the Account menu on the UserTesting dashboard.
QAB_guide_1.png

 

2. Click on the Quick Answers tab, then select Create new.QAB_guide_2.png

 

3. Next, you will be taken to a screen with three steps to create your custom Quick Answer:QAB_guide_3.png

  • Step 1: Test title: Enter a title and description so that colleagues know when to use the Quick Answer template. This is how people will find your Quick Answer in the Template gallery.
  • Step 2: Test plan: Write the tasks and questions participants will answer when taking the Quick Answer test.
  • Step 3: Quick start form: Create the form where colleagues enter test details, such as links or descriptions of activities they want to test.

You can work on these steps in any order, and your work is saved as you move back and forth between them. 

💡Tip: You may find it helpful to collaborate with other researchers on your team and to draft a research plan before you start building your custom Quick Answer. Refer to “Tasks: An Overview” and “Ways to Collect Insights: Quick Resource Guide” for inspiration on how to frame your test plan.

Let’s look at each step separately.

 

Step 1: Test Title

In this step, you create the template card people click on in the Template gallery to use the custom Quick Answer. When colleagues see templates in the Template gallery, they look like this:

Template-gallery-with-filters-QA_builder.png

1. Begin the Test title step by entering a test title to identify the Quick Answer Template. For example, “Compare two websites.”

QAB_guide_26.png

 

2. Next, enter a test purpose that briefly explains to colleagues why they might want to use this template. For our example, we’ll write: “Understand which website users prefer based on how easily they complete the same activity on each site.”

QAB_guide_27.png

Note: As you enter text, a preview of the template card appears in the sidebar. 

3. Enter the help text. 

  • This test is good for: Explain possible uses for this test related to understanding people’s needs and identifying opportunities for new features. Example: “Comparing websites’ ease of use, strengths, and weaknesses” and “Testing your website against a competitor’s site.”
  • What you need for this test: Enter requirements to use the template, such as a publicly accessible link or the product a colleague wants to test. Example: “Links to the two websites that you want to test and a description of the task you want users to compare on both sites.”

QAB_guide_28.png

Now that you have the card colleagues use to launch the test let’s create the test plan. Remember that you can come back and change anything in this step at any time.

Step 2: Test Plan

In this step, you add the instructions, tasks, and questions participants will see when they take the Quick Answer test.

1. Enter the scenario. As with standard unmoderated tests, this lets participants know how to approach the test. For example: “Describe your experience as you use two websites. Remember to explain your thoughts and actions out loud.”

QAB_guide_4.png

 

2. In the Test plan area, add the tasks and questions you want participants to do and answer by dragging them to the drop area, just as you would with a standard unmoderated test. You can also turn on Participant View to record participants’ faces as they complete the tasks.

QAB_guide_5.png

 

3. Because this is a Quick Answer template, you can add placeholders to tasks and questions. These placeholders are “fill-in-the-blank spaces” you add to the template, and colleagues provide the specific information to go in the blanks before launching a Quick Answer test.

As you write tasks and questions, insert placeholders where these details should appear. You can provide a placeholder in any task and use any words, as long as you use the placeholder format described below.

In this example, we use %{website_a} and %{website_b} as placeholders for the two websites we’re comparing.

QAB_30.png

Here are some rules to keep in mind when using placeholders:

  • Format placeholders with a percent sign % and two curly brackets { } with text inside. 
  • Placeholder text can use numbers, lowercase letters, and underscores.
  • Placeholder text can’t use spaces, uppercase letters, or special characters.
  • You can use placeholders in all assets, tasks, and questions. You cannot use placeholders in the starting instructions scenario.
  • You can use the same placeholder more than once. For example, a single test might include “How satisfied are you with %{website_a}?”, “What did you prefer about %{website_a} over %{website_b}?” and “Rate the difficulty of navigating {%website_a}.”

Correct

  • %{product_name}
  • %{description}
  • %{competitor_a}
  • %{competitor_b}
  • %{my_url_1}

Incorrect

  • %{space between words}
  • %[straight_brackets]
  • {missing_percent_character}
  • %{Using_Capitals}
  • %{$pecialch@rac+ers}

 

As you add placeholders, they appear in the sidebar on the right.

QAB_guide_7.png

Note: The warning symbol shows that you have not yet used the placeholders in an input block on the Quick start form, which is the next step.

In your Test plan, you can create a series of related tasks using the same placeholder. You can also pair a verbal response with multiple responses, ratings, and written responses. To pair these, add the same placeholder to each. For example:

  • Verbal response: Talk about your experience booking a flight on %{website_a}.
  • Rating scale: Rate your experience booking a flight on %{website_a}.

4. Mark at least one question as the Key takeaway. Only multiple-choice, rating scale and written response questions can become Key takeaways. Check the Make this the Key takeaway box to make one the Key takeaway.

  • If a multiple-choice question is the Key takeaway, it must have exactly two answers.
  • If a rating scale is the Key takeaway, it must use a 5-point scale.

Note: At least one task must be marked as a Key takeaway; otherwise, your template will have an error, and you won’t be able to publish it.

This is what the Key takeaway looks like on the Results tab:

QAB_guide_10.png

 

5. To display other results on the Results tab, add a Sidebar label to your tasks as shorthand for the question or task.

QAB_32.png

Sidebar labels allow you to organize participant responses to specific tasks. They are located on the left-hand side of the Results tab:

QAB_31.png

 

Here are some tips to follow when creating a Sidebar label in the Test plan step:

  • Summarize the task or question in 3 to 5 words to remind people what prompted the answers.
  • Add the same Sidebar label to pair the data from two questions or tasks together. For instance, you want to be able to view “website pros” and “website feelings” on the same tab on the Results page.
  • To provide richer video content, you can add the same Sidebar label to a verbal response as to a task marked as a Key takeaway (since Key takeaways cannot be applied to verbal tasks).
  • You can use placeholders in Sidebar labels (as shown below).

QAB_guide_11.png

Note: Results without a Sidebar label appear only on the Metrics tab.

When you finish the Test plan, move on to the Quick start form. Remember that you can come back and change anything in this step at any time.

Step 3: Quick Start Form

In this step, you create the template’s quick start form and briefly explain to colleagues why they might want to use this template.

Quick start forms appear when you click the Quick Answer card in the Template gallery.

QAB_guide_12.png

The Quick start form is where you ask colleagues to provide the variable content to “fill in” the placeholders you added in the Test plan. For example, this is where you ask colleagues for the link for %{website_a}, and the link they enter gets placed in the Test plan everywhere you added %{website_a}.

You will build your Quick start form using input blocks, which are instructions to your colleagues and contain a placeholder, a text entry field, and a label for the text entry field. You can also add hint and helper text, if needed. 

Let’s see how this works. 

1. Complete the first input block for your colleagues to name the test when they use your template. The placeholder and label are already provided, so you can enter any Hint text or Helper text you need.

QAB_guide_25.png

 

2. Next, you need to add an input block for each unique placeholder in your Test plan.

Click Add input block to create more input blocks to fill out. In this example, we would end up adding three more input blocks, one for each of the three placeholders we have in the sidebar on the right.

QAB_guide_13.png

3. Fill out Placeholder text for this information block for each input block. Every placeholder in the Test plan needs to be added to the Quick start form. 

As you add a placeholder to an input block, the warning symbol changes to a checkmark.

QAB_guide_15.png

If your placeholder is for a link, change Text to URL in the dropdown menu to the right of the placeholder. 

QAB_guide_21.png

 

4. Enter the field’s Label text. Labels appear above a text field and tell colleagues what to enter.

QAB_guide_16.png

 

5. Enter Hint text to provide help on how to word the variable content.

QAB_guide_18.png

 

6. Enter Helper text to provide help about the variable content itself.

QAB_guide_20.png

 Repeat steps 3-6 for each input block.

 

7. If you need to make changes to the Quick start form itself, do either of the following:

  • To delete an input block, click Delete.
  • To reorder input blocks, use the Move handle to drag it up or down the list.

QAB_guide_22.png

 

8. To preview the Quick start form, click Preview Form.

QAB_guide_23.png

 

9. Lastly, click Review. This checks all three steps to make sure there’s nothing missing.

QAB_guide_24.png

If there is an error, then select Close and edit the step that’s been flagged. Double check that all fields in the step(s) have been properly filled out, and that each placeholder is in an input block. If everything looks good, click Publish.

Lastly, if you ever need to edit a Quick Answer template after it’s been published, click the “...” menu next to the template and select Unpublish.

Screen_Shot_2021-10-28_at_2.03.05_PM.png

 

Best Practices for Building Your Quick Answer

The best Quick Answers are:

  • Actionable - Help colleagues make a decision or act upon the information they learn. Choose Key takeaways that generate actionable results.
  • Reusable - Quick Answer templates can be used over and over. Create templates that are likely to be used often, like “Validate a prototype” or “Compare two websites.”
  • Specific - Tailor templates for particular situations. Instead of creating a template for usability testing, consider focusing one Quick Answer on testing prototypes and another on testing graphics on a live webpage.

Here's another best practice to keep in mind as you create your custom Quick Answer.

Add flexibility to the template

People who use your template can’t update the scenario or add tasks or questions. To add flexibility to the template, add a task with a placeholder such as %{content} or %{task_to_be_done}, or even %{openquestion}. Then use these placeholders so people launching the test can add details to the scenario or an extra task. For example:

Add the placeholder in the Test plan. In this example, we add %{content} as a task.

QAB_guide_8.png

Learn More

Need more information? Read these related articles.

Want to learn more about this topic? Check out our University courses.

Was this article helpful?
1 out of 1 found this helpful