Card Sorting with UserTesting 1: Using the Tool

 

At a Glance

This article explains how to use UserTesting’s card sorting tool. We recommend most users start with the IA - Card Sorting template available in the UserTesting Platform's Templates Gallery. To learn about card sorting, including why it’s useful and when you should do it, read the Knowledgebase article "What Is Card Sorting?"

 

Card sorting is available on the following subscriptions:

Flex plan Seat-based plan
Essentials Startup
Advanced (add-on) Professional (add-on)
Ultimate Premium (add-on)

 

Click on the following header titles to skip to that section of the article:

Why should you run your card sort via UserTesting?

How to set up a card sort in the UserTesting platform

Learn More

Why should you run your card sort via UserTesting?

Running your card sort via UserTesting can deliver both qualitative and quantitative insights.

  • The card sort results will help you understand how people think your content should be grouped. You can use the card sort results to quickly spot popular groupings and categories and use this information to build a better website.
  • The recordings of the contributor sessions will give you behavioral insights from watching and listening to contributors complete the card sort and answers to questions such as “Did people find any task particularly confusing?” and “Why did people group the cards one way and not another?”
  • You can use card sorting in both unmoderated and moderated tests. Add a card sort as you build your unmoderated test plan, or share it with a contributor during a moderated Live Conversation.
  • Card sorting is included with our Ultimate Edition subscriptions. For customers on our Advanced, Pro, Premium Editions, card sorting can be added for an additional cost. Please get in touch with your account team for more information.

Note: Card sorting is not optimized for mobile.

How to set up a card sort in the UserTesting platform

1. Create a new unmoderated test in UserTesting.

One of the tasks you will add to your test is a card sorting task. To start your test, select New > Create an unmoderated test:

Screen_Shot_2022-05-05_at_10.40.35_AM.png

Next, click Website.

website.png

You'll have two options to reach your audience: Build audience (recruiting contributors from the UserTesting Contributor Network and creating your own network) and Create link (generate a link to share with anyone outside the UserTesting Platform).

Rebrand_Two_Doors.png

2. Select your sample size and target audience in UserTesting.

When running a card sort, it’s best to opt for a larger sample size than for a standard test looking for qualitative feedback. This is because you want to derive meaning from the number of contributors who group content in a particular way. We recommend distributing the test to 30 contributors to have some statistical confidence in your data (see MeasuringU's website for resources about statistics and User Experience). Additionally, you’ll get quite a bit of value from watching the videos of a handful of those contributors.

If your account limits you to 15 contributors per test, launch one test with 15 contributors, then create a copy of that unmoderated test and launch to 15 more contributors. Alternatively, you can keep all the results in one test by inviting 30 of your own Invite Network contributors to take the test.

(Remember: It’s always best practice to pilot the study to a couple of contributors first to validate that you’ve set up the test correctly.)

For more information about finding your ideal contributors, see our other Knowledgebase articles about targeting your audience.

Screen_Shot_2022-04-08_at_11.55.46_AM.png

3. Choose a starting URL and provide some context.

In the Starting Instructions section of UserTesting, choose a URL to send contributors to. Use the A blank page option if you don’t have any specific site you want your contributors to start on. Note that this Starting URL will not be the link to your card sort—that will be added in the Test Plan section of your test because you want to provide more context and instruction before users get to the card sorting activity.

Also, provide some context in the Scenario field, such as:

“Please note: One of the activities in this test will be conducting a card sort. This activity helps companies determine how they should structure and organize items.”

Screen_Shot_2022-02-07_at_9.37.04_AM.png

4. Build out your test plan, adding a card sort at the appropriate point in the test flow.

You may want to ask some background questions before the card sort. For example, you may want contributors to rate their familiarity with the topic that the card sort is focused on. Do not include too many tasks before the card sort because (1) you don’t want to inadvertently bias the contributor’s thinking before they take the card sort, and (2) you want to give the contributor ample time to complete the card sorting task.

Screen_Shot_2022-02-07_at_9.37.40_AM.png

5. Set up the card sort activity.

In the card sort task, follow the link to the card sorting app: https://ia.usertesting.com/. This will open in a new browser tab.

Create a new card sort. You will also select either an open, closed, or hybrid option, depending on what you want to find out:

Card_sorting_2.png

  • Closed card sort: contributors sort items into categories you give them.
  • Open card sort: contributors sort items into categories that make sense to them and then label the categories.
  • Hybrid card sort: contributors sort items into categories you give them and can also create their own.

Create cards that represent the information you want feedback on, such as content topics, page names, or category names on your website.

Note: Creators can access, edit, and view results for their tests. They cannot view or access tests launched by others on the account. 

Label each card you want contributors to sort. You will need at least two cards added to enable Publishing, and you can have as many cards as you need. To add more cards, click Add Card.

Card_sorting_1.pngFill

Note: For Open and Hybrid tests only, there exists in Advance Options a setting that allows contributors to name groups after sorting their cards. Contributors will see at the end of an open or hybrid test a message ("Please give a name to each of the groups you have created to complete the task.") reminding them not to leave the test before adding names to the groups.

You also have the option to add images to your cards. To add images, click Show/Hide Images input. The maximum number of images you can upload at one time is 20 images, 8MB total. If your image file size exceeds these limits, upload images in several smaller groups. Images must also be <2MB in size and be .jpg, .gif, or .png files. For image cards, you must label each image. Click Save Cards to upload.

Note: Your card sort activity can be a mix of images and no images.

Once you have uploaded your card sort images, you can preview the image by hovering over the image thumbnail on the card.

card_sorting_4.png

You will also add the category labels if you are running a closed card sort or hybrid card sort.

Categories_cardsorting.jpg

Click Publish to publish your card sort activity. 

Note: Admins can publish and unpublish tests created by others, just as the creator can. However, admins cannot edit tests created by others. Once a test is deployed, admins can also view and share results as necessary. ia.usertesting_05.png

 

ia.usertesting_06.png

Copy the link to your card sort activity.  Card_sort_activity.jpg

Paste the link into the Card Sort Task. The link can also be shared with a contributor during a moderated Live Conversation.
Screen_Shot_2022-02-07_at_9.37.40_AM.png

Note: All contributors upon completing the card sort test—whether that be a closed, open, or hybrid card sort—will see a "Move on to the next step" message, which is intended to make it super clear to the contributors that just the IA test is complete and not the UT test.

6. Include follow-up questions to get additional insight from users.

Finally, add tasks for any follow-up questions you want to ask to evaluate the contributor’s experience as they completed the card sort activity.

You might ask people:

  • How easy or difficult did you find this card sort?
  • Which cards, if any, were the most difficult to sort? Why do you think that is?
  • Which cards, if any, were difficult to understand?
  • [For open card sorts only] What groups, if any, were difficult to name? What groups, if any, were easy to name?
  • In general, what are your thoughts on the groupings (and labels, if applicable) that you created?

Learn More

Need more information? Read these related articles.

Want to learn more about this topic? Check out our University course.

Please provide any feedback you have on this article. Your feedback will be used to improve the article, and when you submit your survey you'll be entered into a drawing for a $50 Amazon gift card. This survey should take 5 minutes to complete. Article evaluations will remain completely confidential.

Was this article helpful?
3 out of 19 found this helpful