Quick Answer: Understand Behavior in Mobile Apps

At a Glance

Use the Understand behavior in mobile apps Quick Answer to learn whether people can smoothly navigate your mobile app and complete tasks.

 

Quick Answer: Understand Behavior in Mobile Apps is available on the following subscriptions:

Flex plan Seat-based plan
Essentials  Startup ✓ (marketing & product insight)
Advanced Professional ✓ (marketing & product insight)
Ultimate Premium ✓ (marketing & product insight)

 

Click on the following header titles to skip to that section of the article:

Quick Answers allow you to collect recorded video feedback of customers or prospects as they complete tasks and answer questions. The tasks and questions are written for you by UserTesting and designed to answer the most common marketing challenges. You can read more about Quick Answers in Quick Answers: Overview.

Understand behavior in mobile apps is one of the available UserTesting Quick Answers; for some users, this template is named Understand behavior in mobile apps. With Understand behavior in mobile apps, you can discover whether people can easily complete a task in a mobile app and understand the behavior behind your metrics and analytics.

When to Use Understand behavior in mobile apps

Use Understand behavior in mobile apps to:

  • Explore customer behavior in your mobile app and ensure customers are finding it easy to use
  • Test your app to make your customers understand how to use it and the information you're trying to convey
  • Test navigation elements to make sure your customers can find what they're looking for
  • Observing how easy or hard people find completing a specific task in your app and understanding what is driving the behavior reflected in your data and analytics
  • Identifying opportunities to improve conversion rates

How to Set Up Understand behavior in mobile apps

1. Quick Answer Inputs

Click the Create test dropdown menu and select Customize a template.

customize_template.png

 

From the Template gallery, select the Quick Answers filter.

2.png

Then, find and click Understand behavior in mobile apps.

Screen_Shot_2022-02-03_at_4.36.57_PM.png

2. Start by describing the activity you want contributors to try on your app.

Start your description with a verb, but don't include exact steps, such as "Click on this button. Then this link. Then go…."

Important: The description is added to a pre-written sentence, so it's a good practice to use a lowercase letter for the first word and not end with a period or other punctuation. Quick Answers converts your description into the test questions, so the wording you enter is what people will see.

Some examples include:

  • sign up for the newsletter becomes 
    • Take as much time as you need to sign up for the newsletter
  • find out when to report for jury duty becomes 
    • Take as much time as you need to find out when to report for jury duty
  • change your profile picture becomes
    • Take as much time as you need to change your profile picture.

Then name your test so that it's easy to recognize from other tests on your dashboard. This makes it easy to share tests with other stakeholders. At this point, you'll need to determine who should take your test.

3. Link or upload your app

You have two options to make your app available to the contributors. You can either upload an IPA or APK file directly into the platform or provide a link to your app in the Google or Apple app stores. If you choose to upload your app directly, we'll securely distribute it to your contributor's devices (no provisioning required). This is helpful if you're testing a mobile app that hasn't been released yet.

 

SecureApp.png

If you chose to provide a link to the Google or Apple app stores, and aren't sure how to locate the URL, please read Finding the app URL.

Test_mobile_05.png

Launching a Test

Screen_Shot_2021-12-14_at_11.25.22_AM.png

To see a list of all the questions the test asks contributors, click the link under Tasks and Questions. To see what your test looks like to contributors, click the Options Menu (three dots) to the right of the Test Plan Summary, then click Preview Test. When you finish the preview, click the Close button.

  • To add or remove contributors, click Contributors.
  • If you need to edit the URL or you entered text that included a typo, click Edit in the upper right. When you are done editing the test, click Save and Go to Order Page.

Click Launch Test to send the test to the UserTesting Contributor Network.

What We Ask Contributors

After you click Launch Test, we send the test to contributors who match your chosen demographics. These contributors then answer any screener questions you added to qualify to take the test.

Here's what we ask contributors based on the inputs you provided when you created the test:

  1. If you are asked to log in or create an account please do so now. If not, move on to the next step. Don't use the app yet. The video of this step will be blurred so we won't capture your personal information.
  2. How familiar are you with this app? [Multiple Choice: Never heard of it, Heard of it, but never used it, Used it once, Used it a few times, Use it regularly, None of the above]
  3. Take a look at the home screen, but **don't scroll or tap anywhere yet**. How difficult or easy do you **expect** it to be to [activity]? Explain your answer. [5-point Rating Scale: Very difficult to Very easy]
  4. Take as much time as you need to [activity].
  5. Overall, how difficult or easy was the activity? Explain your answer. [5-point Rating Scale: Very difficult to Very easy]
  6. What part of the app made it **easy** to accomplish that activity? [Verbal Response]
  7. Write 1-3 words that summarize your previous answer. What part of the app made the activity **easy**? [Written Response]
  8. What part of the app made it **frustrating or hard** to accomplish that activity? [Verbal Response]
  9. Write 1-3 words that summarize your previous answer. What part of the app made the activity **frustrating or hard**? [Written Response]
  10. In one sentence describe the purpose of this app. What problem does it solve or make easier? Describe it in your own words, not using language from the screens you saw. [Written Response]
  11. How valuable is this app to you? Explain your answer. [5-point Rating Scale: Not at all valuable to Very valuable]
  12. From this list select 1 word that describes the *biggest improvement* you would make to this app [Multiple Choice: Appearance, Navigation, Trustworthiness, Understandability, Usefulness, None of the Above]

As contributors finish, the software uploads the recorded video to our system. It notifies you by email that the videos are ready to watch (to configure notifications, see "Email notification preferences"). 

Reviewing the Results 

For each test, the dashboard displays the test name, who created it, when it was last updated, and how many contributors have and have not taken the test.

After all the contributors finish, a Result summary appears below the test title.

Test_Summary.png

From here, you can share the results, create a similar test, or move the test to a different location. From the Dashboard, click on a test title to be taken to the Results page.

Results Tab

After running this Quick Answer test, the Results tab shows contributors providing open-ended qualitative feedback describing their most recent experience on a particular task or activity you ask them to complete. 

The Results tab is a great place to start for Quick Answers. It summarizes the findings from the test: Do more contributors find the activity likable? Did the contributors express any frustrations? Videos of your contributors' open-ended feedback will display as Key Takeaways under the Results tab. 

To read more about the Results tab, check out our Results from Quick Answer Tests article.

 

Learn More

Need more information? See these related articles:

Want to learn more about this topic? Check out our University courses:

Was this article helpful?
0 out of 0 found this helpful