Verification of User’s Attention With the Use of a “Trap” Question

Trap questions (also bogus questions) are meant to check if respondents are speeding when filling out the survey and therefore cheat. We occasionally pose a trivial question (eg. To choose a certain answer for this purpose created question) to respondents. If a certain respondent chooses the wrong answer we can assume that the respondent was not paying attention to the content of the question.

Use of trap questions is recommended in panels and when we award respondents for responding to the survey. We want to eliminate cases where the respondent only wants to satisfy the surveyor by answering quickly or choosing random answers. It is recommended that such questions are not too difficult, boring, unusual or offensive.

A study by Baker – Prewitt and Miller (2009) shows that more than 10% of the respondents are not successful at such questions. This research also shows that we can increase the quality of the research by using trap questions:

  • respondents use more time to finish the survey;
  • fewer respondents speed through the survey;
  • fewer respondents choose the same answer at different questions (straight-lining);
  • the smaller likelihood for respondents to miss the next trap question;
  • less mind cheating;
  • respondent’s answers show a higher correlation with the measurement scale.

We can also increase respondent’s attention by using a combination of positive and negative statements. This encourages respondents to be more careful when reading statements and be more thoughtful before answering an individual statement.

Examples of trap questions >>

 

Related content

1KA is free to use for basic users