AI-powered test creation

This article applies to: UserTesting 

On this page:

• Overview
• Choose how to create your test
• Creating a test with AI
• Importing a pre-written test
• Supported test types and tasks
• What AI-powered test creation does (and doesn't do)
• Access and availability
• Security and AI Information
• Best prompt techniques for AI-powered test creation
• Frequently asked questions

Overview

AI-powered test creation helps you quickly generate structured, research-ready test drafts using generative AI so you can move from idea to draft in minutes.

Instead of starting from scratch, you can describe your research goal, optionally add assets, and let AI generate a test plan aligned with UX research best practices.

With AI-powered test creation, you can:

• Generate complete test drafts in seconds
• Start from a short goal or import an existing test plan
• Create structured tasks and questions aligned with research best practices
• Automatically open your draft in the Test Builder for review and editing

Whether you're a researcher scaling your workflow, a designer validating a prototype, or a product manager gathering feedback, AI-powered test creation helps accelerate test creation without sacrificing quality.

Important: AI generates a starting point. Always review and refine your test before launching.

Note: AI- generated test creation is available on Ultimate, Ultimate+, and Unlimited plans and requires Generative AI to be enabled for your workspace.

Watch this walkthrough to learn how to create an AI-powered test, from defining your goals to generating and refining your test plan.

Choose how to create your test

Before creating your test, decide whether to start from a research goal or use an existing script.

Create a new test (with AI)

Use this option when you're starting from a research goal rather than a written script.

Best for:

• New ideas, features, or exploratory research
• Early-stage concepts or prototypes
• When you want help structuring tasks and questions

AI will generate a complete draft, including methodology, tasks, and questions aligned with research best practices.

Import prewritten test

Use this option when you already have a drafted or approved test plan.

Best for:

• Existing or standardized tests
• Benchmarks or repeat studies
• Surveys or scripts that must remain unchanged

AI will structure your content by:

• Assigning appropriate task types
• Formatting questions correctly
• Placing everything into the Test Builder

Creating a test with AI

You can create an AI-powered test in just a few steps.

1. Start a new AI test

From your Workspace dashboard:

• Click Create test
• Select Create with AI

2. Choose your test settings

Select your test type and settings, then click Next.

3. Define your test goal

Describe what you want to learn from the test.

• Be specific and focused
• Include the behavior, flow, or experience you want to evaluate

Pro Tip: A clear goal has the biggest impact on the quality of your AI-generated draft.

4. Add assets (optional)

Upload supporting materials. For example, a Figma prototype, URL, or image.

After uploading, include a short description that explains:

• What the asset is
• What participants should focus on
• Any key flows or actions to complete

Pro Tip: Providing clear context improves the accuracy of generated tasks.

5. Generate your test

Click Generate test to create your draft.

6. Review the AI-generated draft

Preview your test, including:

• Instructions
• Tasks (e.g., navigation or interaction steps)
• Question types (rating scales, multiple choice, verbal response, etc.)

From the Preview section, you can:

• Accept the draft
• Regenerate a new version
• Refine the draft by providing feedback

7. Edit in Test Builder

Click Create draft to open your test in the Test Builder.

From here, you can:

• Edit instructions, tasks, and questions
• Adjust question types
• Add logic and audience criteria
• Fix validation issues

AI creates the starting point and you remain in full control before launch.

Importing a pre-written test

If you already have a test plan, you can import it and let AI structure it for you.

To import a test:

1. Select Import prewritten test.
2. Paste your full test draft.
3. Click Generate.

AI will automatically:

• Assign appropriate UserTesting task types
• Structure and format your questions
• Place your test into the Test Builder

This helps eliminate manual setup while preserving your original wording and structure.

Supported test types and tasks

AI-powered test creation supports the following test types:

• Unmoderated tests
• Think Out Loud
• Interaction tests
• Surveys

Supported task types

AI-powered tests can include a variety of task and question types:

Instructions and navigation

• Instructions
• Navigation task
• URL task

Prototype and interaction tasks

• Figma task
• Image task

Question types

• Multiple choice
• Written response
• Verbal response
• Rating scale
• NPS (Net Promoter Score)
• Matrix
• Ranking
• Questions page

Metrics and scoring

• QXscore

  
   

What AI-powered test creation does (and doesn't do)

What it does

AI-powered test creation helps you:

• Generate structured, research-ready test drafts
• Create tasks and questions aligned with UX research best practices
• Quickly move from idea to draft in minutes
• Improve test quality, especially for non-researchers

AI-powered test creation was developed in collaboration with UserTesting’s Professional Services team to reflect strong research standards.

Limitations

AI-powered test creation currently:

• Does not analyze content inside uploaded assets (Figma files, URLs, or images)
• Does not generate screener questions (you must add these manually)
• Is optimized for English (other languages may produce inconsistent results)
• May generate imperfect or biased wording

Always review and refine your test before launching to ensure accuracy and quality.

Access and availability

AI-powered test creation is:

• Available on Ultimate, Ultimate+, and Unlimited plans
• Available to users with permission to create tests
• Not available to users with Viewer roles
• Available only when Generative AI is enabled for your workspace

If you don’t see the AI-powered test creation option, contact your UserTesting admin to confirm your permissions and workspace settings.

Security and AI Information

AI-powered test creation is built with security and data privacy in mind.

• Uses Anthropic's Claude models hosted on Amazon Bedrock
• Complies with SOC 2 and ISO 27001 standards
• Encrypts data at rest, in transit, and in use
• Does not use customer data to train generative AI models
• Enforces zero data retention with third-party vendors

This ensures your data remains secure while using AI-powered features.
 

Best prompt techniques for AI-powered test creation

Use these techniques to generate more accurate and relevant test drafts. A well-written prompt helps AI create tasks and questions that align with your research goals.

1. Start with a clear goal

Focus on what you want to learn—not just what you want to test.

❌ Test our checkout flow
✅ Understand where users get confused or drop off during checkout, especially between cart and payment confirmation

2. Provide relevant context

Include background details to guide the test structure, such as:

• Target audience
• Product or feature stage (new, redesigned, in progress)
• Known pain points or hypotheses

3. Include research questions

Add 2–3 focused questions to guide task and question generation.

Example:

• Can users find the filter options without prompting?
• Do users understand what the “Save for later” button does?
• How do users feel about the confirmation screen?

4. Describe your assets clearly

If you upload a Figma prototype, URL, or image, explain:

• What the asset is
• What participants should do
• Any key flows or features to focus on

Example:
This is a redesigned onboarding flow for first-time users. Participants should complete the account setup from start to finish without guidance.
 

5. Keep it concise but specific

Aim for 3–5 sentences:

• Too vague → generic results
• Too long → diluted output

6. Avoid jargon and internal language

Write as if explaining your product to someone outside your company. Internal terminology can reduce the quality of generated tasks and questions.

Frequently asked questions
 

Is AI-powered test creation as good as a researcher-written test?

AI-powered test creation was developed with input from UserTesting’s Professional Services team and follows UX research best practices.

However, AI-generated drafts may include imperfect structure or wording. Always review and refine your test before launch.

Does AI-powered test creation replace a researcher?

No. AI helps generate a structured starting point, but human review is essential to ensure your test aligns with your research goals and standards.

Can I edit the AI-generated draft?

Yes. After generating your test, it opens in the Test Builder, where you can modify any instructions, tasks, or questions before launching.

Does AI-powered test creation create screener questions?

No. Screener questions are not generated in this release. You’ll need to create and add them manually.

Can anyone on my team use the AI-powered test creation option?

Only users with permission to create tests can access AI-powered test creation. Viewer roles do not have access.

Users can only generate AI drafts for test types they have permission to create.
 

Can I generate tests in other languages?

AI-powered test creation is optimized for English. You can request other languages in your prompt, but results may vary. Always review non-English content carefully before launch.

Related content