Check whether the outcome improved
Define neutral behavior
Write guide checks such as an open first question, no solution labels before the participant describes the situation, and a follow-up that asks for an example. Include a rule for handling participant questions without teaching the preferred answer.
Pilot with varied contexts
Run the revised guide with participants who differ in familiarity and circumstances. Record spontaneous topics, clarifying probes, pauses, and moments where the moderator supplied language. Compare the pilot transcript with the original guide and its intended learning goals.
Review evidence quality
Ask an observer to label which findings arose before prompting and which depended on a follow-up. Note missing experiences and unanswered questions. Update wording only when the change preserves the research objective and makes the participant response less constrained.
What to carry forward
The verification record should show the revised prompts, pilot interactions, spontaneous evidence, and remaining leading risks. Approve the guide for a bounded round when the core questions can be answered without coaching. Keep a follow-up review if the pilot used unusually familiar participants.
Technical background: Nielsen Norman Group research guidance.
Keep the decision with the work.
Use a Work Item in Aglet to record the problem, the evidence you have, and the next decision. Add an owner and priority, then keep updates in the discussion so the next person can follow the reasoning.
Create an account See the product workflow