Research and design
Auto Light Dark
Research and design
Auto Light Dark
Breadcrumbs

Planning unmoderated studies

Last Updated: September 18, 2026

Unmoderated research usually involves participants completing simple tasks (such as card sorting or tree testing) or answering questions (such as a survey). This can help gather feedback from more people more quickly, increasing a study's statistical significance. This article walks you through how to plan for unmoderated research and things to keep in mind.

Following the Paperwork Reduction Act (PRA) in your research

PRA requirements have been clarified to say that usability tests like card sort, tree test, and surveys do not need PRA clearance. Usability research is exempt from PRA because it uses direct observation (e.g., usability testing, interviews, co-design) and asks structured, semi-structured, or open-ended questions to improve a paper or digital form.

What does this mean for unmoderated research?

This means that:

  • there are no PRA limits on the number of participants you recruit through Perigean

  • you don’t have to split your study into cohorts of 10 or less

  • you don’t have to include separate links in your research plan

Research tools and participant privacy

Research conducted for VA must use approved tools and services with appropriate paid licenses. Free research tools may collect or retain user data in ways that do not meet VA's privacy requirements. If a research participant shares personally identifiable information (PII) or protected health information (PHI) while using an unapproved service, that information could be put at risk.

As of August 2026, Optimal Workshop is no longer available for widespread use at VA. If you need to conduct an unmoderated survey, card sort, or tree test, reach out to Mikki Northuis in Slack. Mikki can help set up and launch your study, and you'll have access to the results as they come in. Read Conducting unmoderated research for more information about conducting your study and tracking results.

VA is also developing and evaluating new tools to support unmoderated research. As these tools become available for broader use, we'll update this guidance with information about available tools and how to access them.

Recruiting for unmoderated studies

  1. First, submit your research proposal to the Research Review touchpoint

  2. Once your research is approved and ready, Perigean can begin recruitment

    1. Perigean will send out their recruitment email to veterans to gauge interest

    2. Veterans respond to the email

    3. Perigean sends veterans an instructional email, which includes the cohort study link and a unique participant code

  3. Veteran participant completes the study and provides the code in the questionnaire

  4. Researcher logs into Optimal Workshop and sends codes to Perigean at the end of each day to gauge participation

    1. It’s important to only send codes to Perigean for participants who’ve substantially participated

    2. If a participant abandoned the task, entered their code but didn’t answer any questions, ask Perigean to follow up with them

  5. Perigean continues recruitment as needed

  6. Let Perigean know when you’ve closed the study

Tips for conducting unmoderated studies

  • Plan ahead to optimize time

    • Leave the sort open for 14 days if possible (one sprint) and use the time to work on other initiatives while the study is open

  • Recruit for double the number of participants you want

    • Abandonment is much higher for unmoderated research as compared to moderated studies

  • Communicate regularly with Perigean to measure participation and continue recruitment as needed

  • It’s still important to pilot-test unmoderated studies!

    • Use a fake participant code and make sure all parts of the study work correctly

  • Use the Maximum Variation Sampling (MVS) method to make sure your study is inclusive

  • Note that some types of studies in Optimal Workshop are not accessible to users with screen readers (e.g. card sort, tree test, and first click testing)

  • Write thorough instructions for the study

    • For example, many participants have said OptimalSort instructions were difficult to understand

    • Consider a hybrid sort, if applicable, to give participants a better understanding of what to do

  • When conducting an unmoderated card sort, don’t create more than 30 cards

    • Sorting that many cards requires a high cognitive load and a lot of time, meaning increased abandonment of the exercise

  • Do not require participants to go to more than one link to complete the activity

    • This study design decreases participation, increases abandonment

Help and feedback