Aglet

Prioritize Interview Bias Fixes Before More Sessions

Not every imperfect prompt invalidates a study, but some biases can steer every participant toward the same conclusion. Prioritize fixes that threaten the central research question or affect the interpretation of multiple sessions. Preserve useful evidence while deciding what must change before recruiting again.

Decide where the work belongs

  1. Assess distortion risk

    For each flagged prompt, identify the findings it influenced and whether the answer would likely differ under neutral wording. Give priority to questions about demand, satisfaction, or feature preference when the wording contains the desired outcome.

  2. Compare recovery options

    Decide whether to rephrase a prompt, reorder topics, add an observation task, recruit a contrasting group, or reanalyze existing notes. Compare effort with the chance of separating a prompted response from an underlying experience.

  3. Set a go or pause rule

    Choose which fixes are required before the next session and which can be handled during analysis. Assign a guide owner, pilot the revised wording, and set a review point. Pause collection when the central question cannot be answered without the biased prompt.

What to carry forward

The priority result is a short correction queue showing distortion risk, recovery method, owner, and pilot condition. Fix the bias that could change the main decision first. Keep lower-risk wording issues visible so they do not recur across later rounds.

Technical background: Nielsen Norman Group research guidance.

Keep the decision with the work.

Use a Work Item in Aglet to record the problem, the evidence you have, and the next decision. Add an owner and priority, then keep updates in the discussion so the next person can follow the reasoning.

Create an account See the product workflow