Controlling the testing frequency of your participants is very important for several reasons. For instance, at times you may have a large pool of potential test participants so you may want to prevent people from taking more than one of your tests—keeping feedback ‘fresh’. And other times you may only have access to a small group of participants so allowing people to take your tests more frequently is vital to receiving feedback.
Easily manage the testing frequency of your participants for each test with test filters.
Here are a few things to note:
- Fresh Eyes is a default account setting for the UserTesting Panel. This setting prevents repeat participants from completing more than one of your tests (on the account level) in a given time frame. Test filters allow you to override this setting at the test level.
- For saved panels and My Panel, we have no default account setting for testing frequency. Test filters allow you to set your own testing frequency parameters for participants at the test level.
Introducing Test Filters
As of July 15, 2020, you also have the option to change these settings for each new study you launch via test filters.
Select test frequency from the list of demographic filters on the audience selection page. Adjust the number of days since last completed a test on this account.
And you also have the option to just exclude participants that took a specific test. Select prior tests to exclude participants.
Test filters must be applied while creating your audience and cannot be edited after your test is launched.
Please note that the test filters can impact how quickly your tests are able to fill. As you increase the study frequency interval, you are reducing the pool of available test participants. If you have stringent demographic filters or screeners, you may want to decrease the interval.
About Fresh Eyes
By default, Fresh Eyes is enabled on all accounts for the UserTesting Panel at a 360-day interval, but it can be adjusted (30, 60, 90, or 270 days) or turned off completely. It's possible to enable Fresh Eyes at the account level or the member level. Test filters override your Fresh Eyes settings.
Account level: participants will only be able to complete one test created by any members of your team within the specified time frame.
Member level - participants won’t be able to complete another test created by same team member, but can still take studies created by other team members.
To adjust the account level Fresh Eyes settings, contact the Support team.