Tree Testing with UserTesting

 

At a Glance

This article explains how to use UserTesting’s tree testing tool, a usability feature that can help you evaluate the findability of topics on a website.

 

Tree testing is available on the following subscriptions:

Flex plan Seat-based plan
Essentials Startup
Advanced ✓ (add-on) Professional ✓ (add-on)
Ultimate Premium ✓ (add-on)

 

We recommend most users start with the IA - Tree Testing template available in the Template gallery (in the Information architecture category). To learn more about tree testing, including why it’s useful and when you should do it, read What is tree testing?  

Note: UserTesting Information Architecture features, such as tree testing, are included in Ultimate plans and can be purchased as add-ons for Professional, Premium, and Advanced plans.

Why should you run a tree test via UserTesting?

How to Set Up a Tree Test in the UserTesting Platform

Results of Your Tree Test

Why should you run a tree test via UserTesting? 

Running your tree test via UserTesting can deliver both qualitative and quantitative insights.

  • The tree test results help you understand how many people could find the right information, how many people failed, and the paths people took through your information before settling on an answer. You can use the results of your tree testing to make more informed decisions related to the organization and labeling of information on your website or app. 
  • The recordings of the contributors' sessions will give you behavioral insights into those who complete your tree test and answers to questions such as “Did people find any task particularly confusing?” and “Why did people go into the tree one way and not another?”
  • Tree testing is included with our Ultimate Edition subscriptions. For customers on our Advanced, Pro, and Premium Editions, our Information Architecture Testing package - which also includes card sorting - can be added for an additional cost. Please contact your account team for more information.

Note: Tree testing is not optimized for mobile.

How to Set Up a Tree Test in the UserTesting Platform

1. Create a new unmoderated test in UserTesting.

One of the tasks you will be able to add to your test is a tree test task. To start your test, select New > Create an unmoderated test.

Screen_Shot_2022-05-05_at_10.40.35_AM.png

Next, click Website.

website.png

You'll have two options to reach your audience: Build audience (recruiting contributors from the UserTesting Contributor Network and creating your own network) and Create link (generate a link to share with anyone outside the UserTesting Platform).

Rebrand_Two_Doors.png

2. Select your sample size and target audience in UserTesting. 
When running a tree test, it’s best to opt for a larger sample size than for a standard test looking for qualitative feedback. This is because you want to derive meaning from the number of contributors who complete each task in a particular way. We recommend distributing the test to 30-50 contributors to have some statistical confidence in your data (see MeasuringU's website for resources about statistics and User Experience). Additionally, you’ll get quite a bit of value from watching the videos of a handful of those contributors.

If your account limits you to 15 contributors per test, launch one test with 15 contributors, then create a copy of that unmoderated test (Create similar test) and launch to 15 more contributors. Alternatively, you can keep all the results in one test by inviting 30-50 of your own Invite Network contributors to take the test.

(Remember: It’s always best practice to pilot the study to a couple of contributors first to validate that you’ve set up the test correctly.)

For more information about finding your ideal contributors, see our other Knowledgebase articles about targeting your audience.

3. Include starting URL and provide some context. 

In the Starting Instructions section of UserTesting, choose a URL to send contributors to. If you don’t have any specific site you want your contributors to start on, use the A blank page option. Note that this Starting URL will not be the link to your tree test—that will be added in the Test Plan section of your test—because you want to provide more context and instruction before users get to the tree test activity.

Screen_Shot_2022-02-07_at_9.37.04_AM.png

Also, provide some context in the Scenario field, such as:

“Please note: One of the activities in this test will be conducting a tree test. This activity helps companies determine how they should structure and organize items.”

4. Build out your test plan, adding a tree test at the appropriate point in the flow of the test. 

You may want to ask some background questions before the tree test. For example, you may want contributors to rate their familiarity with the topic that the tree test is focused on. Do not include too many tasks before the tree test because (1) you don’t want to inadvertently bias the contributor’s thinking before they take the test and (2) you want to give the contributor ample time to complete the tasks.

Screen_Shot_2022-02-07_at_9.46.32_AM.png

5. Set up the tree test.

In the tree test task, follow the link to the tree testing app. The link will open in a new tab where you can create a new tree test and enter your test details.

Tree_Testing_Test_Details_06.png

After entering your test details, you can begin building your tree.

  • You can include many levels in your tree, but a maximum of 300 nodes can be included.
  • There is a text limit of 100 characters for the text of each node.
  • If you would like to copy a tree from a previous test, go to the Test Details for that test, and click Clone Test at the bottom of the tab.

Tree_Test_Add_Tree_07.png

Tree_Test_Save_Tree_08.png

Once you’ve set up your tree, you can add questions. These will be questions that contributors are asked to answer about the tree you just created.

Tree_Testing_Tasks_09.png

We recommend a maximum of 10 total questions for a single tree, though there is no limit to the number you can ask. Remember the more tasks someone completes with the same tree, the more the results will be biased by their familiarity with that particular tree.

Tree_Testing_Save_Tasks_10.png

Select the right answer for each question - you can have multiple correct answers to account for the fact that the same information may be available in different parts of your site or app. 

Tree_Testing_Solutions_11.png

6. Once you are done drafting the questions your test is ready to publish.

By publishing the test you are generating a URL that you can distribute to test contributors.Tree_Testing_Publishing_12.png

After your test is published, you should see the page below.

Tree_Testing_Public_Link_13.png

From here you can edit test details, clone the test, or unpublish it so that contributors can no longer access it. Setting project results to Public will generate a standalone results page you can share with other stakeholders with a separate URL, including stakeholders that do not have a UserTesting account.

Note: Creators can access, edit, and view results for their own tests. They cannot view or access tests launched by others on the account. Admins can publish and unpublish tests created by others, just as the creator can. However, admins cannot edit tests created by others. Once a test is deployed, admins can also view and share results as necessary.

7. Next, copy your link and paste it into the Tree Test URL box within the Tree Test Task.

Screen_Shot_2022-02-07_at_9.46.32_AM.png

8. Include follow-up questions to get additional insights from users.

Finally, add tasks for any follow-up questions you want to ask to evaluate the contributor’s experience as they completed the tree test activity.

You might ask people:

  • How easy or difficult did you find this tree test?
  • Which labels, if any, were difficult to understand? 
  • In general, did the labels help you quickly and easily locate the information you wanted?

Results of Your Tree Test 

Once the contributors complete your test, you can see the results in your Dashboard, just as any UserTesting test, and watch videos of contributors completing the tree test.

Screen_Shot_2022-02-07_at_9.49.09_AM.png

Click View Tree Testing Results to view the quantitative results of your test within the tree testing app (i.e. where you initially created the tree). 

Tree_Testing_My_Projects_15.png

You can find your results under My Projects.

Tree_Testing_Results_16.png

Selecting the Results tab will reveal the summary of your results as well as the individual tasks. This includes correct and incorrect answers, paths taken, and average time on task. You are also able to export this data as a .csv or .xls file.

Tree_Testing_Results_17.png

You can also view results for individual contributors by selecting the contributors tab:

tree_testing_participants_tab.png

 

Learn More

Need more information? Read these related articles.

Want to learn more about this topic? Check out our University courses.

Please provide any feedback you have on this article. Your feedback will be used to improve the article, and when you submit your survey, you'll be entered into a drawing for a $50 Amazon gift card. This survey should take five minutes to complete. Article evaluations will remain completely confidential.

Was this article helpful?
6 out of 13 found this helpful