Is undesirable answer behaviour consistent across surveys? An investigation into respondent characteristics

Frank Bais, Barry Schouten, Vera Toepoel

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

In this study, we investigate to what extent the respondent characteristics age and educational level may be associated with undesirable answer behaviour (UAB) consistently across surveys. We use data from panel respondents who participated in ten general population surveys of CentERdata and Statistics Netherlands. A new method to visually present UAB and an inventive adaptation of a non-parametric effect size measure are used. The occurrence of UAB of respondents with specific characteristics is summarized in density distributions that we refer to as respondent profiles. An adaptation of the robust effect size Cliff’s Delta is used to compare respondent profiles on the potentially consistent occurrence of UAB across surveys. Taking all surveys together, the degree of UAB varies by age and education. The results do not show consistent UAB across individual surveys: Age and educational level are associated with a relatively higher occurrence of UAB for some surveys, but a relatively lower occurrence for other surveys. We conclude that the occurrence of UAB across surveys may be more dependent on the survey and its items than on respondent’s cognitive ability.
Original languageEnglish
Pages (from-to)191-224
JournalSurvey Methodology
Volume48
Issue number1
Publication statusPublished - Jun 2022

Keywords

  • Respondent profiles
  • Answer behaviour consistency
  • Adapted Cliff’s Delta
  • Measurement error
  • Cognitiveability
  • Satisficing

Fingerprint

Dive into the research topics of 'Is undesirable answer behaviour consistent across surveys? An investigation into respondent characteristics'. Together they form a unique fingerprint.

Cite this