| Understand the key differences between the New and Classic Think-Out-Loud (TOL) experiences in UserTesting, including capabilities, limitations, and when to use each. |
This article applies to: UserTesting
On this page:
- What to expect
- Test creation and capabilities
- Recruitment, devices, and setup
- Results analysis and AI
- Moving from Classic to New TOL
- Choosing the right experience
- Final Takeaway
What to expect
As part of our platform evolution, the New Think-Out-Loud (TOL) experience introduces a modern, AI-powered approach to unmoderated testing. While Classic TOL remains available, the two experiences differ in key areas: test creation, recruitment, device support, and results analysis.
This guide helps you understand those differences so you can choose the right experience for your research needs and confidently create and analyze your tests.
Watch this video for a quick overview of the key differences between Classic and Updated think-out-loud experiences.
Test creation and capabilities
New TOL introduces more advanced question types and a simplified workflow. However, some Classic features are not yet supported.
| Category | New TOL experience | Classic TOL experience |
| Core task types | Multiple choice, written, verbal, rating, image, balanced comparison (up to 4 options) | Multiple choice, multiple select (multi-select), written, verbal, rating, image, balanced comparison (up to 2 options) |
| Advanced question types | Matrix, rank order, NPS, QXscore (advanced survey-style questions) | Not supported |
| SUS+ | Not supported | Supported |
| Task structure | Simplified structure using navigation and instruction tasks | Scenario-based structure with more customization |
| Templates | Not available | Pre-built templates for common use cases |
| Prototype testing | Figma integration and web prototypes | Web, mobile, and prototype testing supported |
Some features available in Classic TOL are not yet supported in the new experience:
- Card sort and tree test
- 5-second test
- Video/audio uploads
- Certain custom task types
When converting a Classic test:
- Tasks may become navigation tasks
- Scenarios may be converted into instruction steps
Review your test carefully before launching to ensure everything behaves as expected.
Recruitment, devices, and setup
New TOL simplifies recruitment and setup, but currently has some limitations in device support and technical requirements compared to Classic.
| Category | New TOL Experience | Classic TOL Experience |
| Recruitment Options | Use both the UserTesting Network and invite your own participants within a single test | Separate audience types (cannot combine in one test) |
| Reusable audiences | Create and reuse audiences across tests | Limited audience reuse |
| Custom/Favorite Contributors | Not available | Save and reuse favorite participant criteria |
| Mobile Testing | Mobile web testing only (iOS and Android browsers) | Mobile web and native app testing |
| Recorder | Requires a Chrome extension for recording | Extensionless recorder available |
| Browser support | Desktop testing is supported in Chrome only | Supports multiple browsers |
⚠️ Important: New TOL currently requires Chrome for desktop testing and does not support native mobile app testing. If your study requires broader device or browser coverage, use Classic TOL.
Results analysis and AI
New TOL uses AI-driven analysis to help you identify insights faster, while Classic TOL relies more on manual tagging and traditional tools.
| Category | New TOL experience | Classic TOL experience |
| AI Summaries | AI-generated summaries at both session and test level | Limited or basic summaries |
| AI Themes | AI-generated themes across sessions | Limited theming (verbal responses and tasks only) |
| Sentiment analysis | Improved AI-driven sentiment analysis | Older sentiment model |
| Analysis approach | AI-driven analysis with automatic theme detection | Manual analysis using tags, keyword maps, and filters |
| Legacy analysis tools | Not available (Smart tags, Friction Detection, etc.) | Includes Smart tags, Friction detection, and other legacy tools |
| Video experience | Updated video player with transcripts and key moments | Legacy video player |
| Clips and Highlight Reels | Supported (within test only) | Supported |
| Cross-test compatibility | Cannot combine results with Classic tests | Can analyze results across multiple Classic tests |
| Results UI | Modern UI with improved charts | Legacy UI |
| Filtering and analysis | Advanced filtering with flexible segmentation | Basic filtering options |
In general, New TOL reduces the need for manual analysis by automatically identifying themes and summarizing results. Classic TOL offers more control through manual tools, but requires more time and effort.
Moving from Classic to New TOL
You can transition existing Classic TOL tests to New TOL, but some elements are converted or simplified. To get started, use Duplicate and convert to create a new version of your Classic test in the New TOL format.
Most task types, questions, and recruitment settings will carry over. Review your test carefully before launching:
- Tasks may be converted into navigation tasks
- Scenarios may become instruction steps
- Unsupported features may be removed or rebuilt
Best practice: Always preview and test your converted test before launch to ensure everything behaves as expected.
If your test relies on features not yet supported in New TOL (such as card sorting, templates, or app testing), consider continuing to use Classic TOL.
Choosing the right experience
Use the following guidance to choose the right Think-Out-Loud (TOL) experience for your research needs.
| Use Case | Recommended Experience |
| You want faster setup and AI-generated insights. | New TOL |
| You want a streamlined workflow with less manual analysis. | New TOL |
| You want to combine the UserTesting Network and invite your own participants in a single test. | New TOL |
| You want to use advanced question types (e.g., matrix, rank order, NPS, QXScore). | New TOL |
| You need card sorting or tree testing. | Classic TOL |
| You need templates to quickly build tests. | Classic TOL |
| You need mobile app testing (not just mobile web). | Classic TOL |
| You rely on legacy analysis tools (e.g., Smart Tags, Friction Detection). | Classic TOL |
| You need broader browser or device support (beyond Chrome or mobile web). | Classic TOL |
Final takeaway
New TOL experience represents the future of unmoderated testing in UserTesting, with built-in AI, a modern interface, and a streamlined workflow.
Classic TOL remains available for advanced use cases that rely on legacy features such as templates, card sorting, and mobile app testing.
For most use cases, start with New TOL and use Classic TOL when specific features are required. You can explore New TOL today while continuing to use Classic where needed.
Related content
|
Want to learn more? Check out these Knowledge Base articles... |
Interested in growing your skills? Check out our University courses... |
|
Need hands-on training?
|
Can't find your answer?
|