So many questions, so little time: Integrating adaptive inventories into public opinion research

  • Jacob M. Montgomery
  • , Erin L. Rossiter

    Research output: Contribution to journalArticlepeer-review

    13 Scopus citations

    Abstract

    One of the most difficult tasks facing survey researchers is balancing the imperative to keep surveys short with the need to measure important concepts accurately. Not only are long batteries prohibitively expensive but lengthy surveys can also lead to less informative answers from respondents. Yet, scholars often wish to measure traits that require a multi-item battery. To resolve these contradicting constraints, we propose the use of adaptive inventories. This approach uses computerized adaptive testing methods to minimize the number of questions each respondent must answer while maximizing the accuracy of the resulting measurement. We provide evidence supporting the utility of adaptive inventories through an empirically informed simulation study, an experimental study, and a detailed case study using data from the 2016 American National Election Study (ANES) Pilot. The simulation and experiment illustrate the superior performance of adaptive inventories relative to fixed-reduced batteries in terms of precision and accuracy. The ANES analysis serves as an illustration of how adaptive inventories can be developed and fielded and also validates an adaptive inventory with a nationally representative sample. Critically, we provide extensive software tools that allow researchers to incorporate adaptive inventories into their own surveys.

    Original languageEnglish
    Pages (from-to)667-690
    Number of pages24
    JournalJournal of Survey Statistics and Methodology
    Volume8
    Issue number4
    DOIs
    StatePublished - Sep 1 2020

    Keywords

    • Computerized adaptive testing
    • Personality
    • Survey methodology

    Fingerprint

    Dive into the research topics of 'So many questions, so little time: Integrating adaptive inventories into public opinion research'. Together they form a unique fingerprint.

    Cite this