Keep the lesson for the next incident
Save the wording case
Store the item versions, construct, pilot notes, response patterns, and decision that was affected. Include a respondent who selected an answer for a different interpretation. That counterexample makes the measurement risk understandable to later researchers.
Improve item review
Add construct, recall, scale, accessibility, and cognitive-probe checks to the survey brief. Require a pilot for items driving a major decision. Explain how the practice addresses the ambiguity found in this study.
Watch for precision drift
Set a signal such as high completion with many clarification requests, subgroup scales moving for different reasons, or percentages used without item context. Assign an owner to review future results and revisit the practice when the signal appears.
What to carry forward
The learning record should connect the wording problem to the revised review practice and recurrence signal. State what the team will ask differently next time. Keep the lesson tied to the construct and audience rather than treating every survey response as comparable.
Technical background: GOV.UK user research guidance.
Keep the decision with the work.
Use a Work Item in Aglet to record the problem, the evidence you have, and the next decision. Add an owner and priority, then keep updates in the discussion so the next person can follow the reasoning.
Create an account See the product workflow