The QDRL perform Question Evaluation on a wide range of projects that utilize both quantitative and qualitative methodologies. Question evaluation is vital part of survey development and is essential to produce quality and dependable survey data. The Office of Management and Budget stipulates in Section 1.4 of The Standards and Guidelines for Statistical Surveys:
"Agencies must ensure that all components of a survey function as intended when implemented in the full-scale survey and that measurement error is controlled by conducting a pretest of the survey components or by having successfully fielded the survey components on a previous occasion."
Question evaluation studies are conducted to determine if a question
- Captures the intended concept
- Is interpreted consistently across respondent groups
- Poses problems for respondents when attempting to answer the question
- The best question design is based on question evaluation, not expert opinion.
- Question evaluation is science-based
- Empirical Evidence
- Transparent and Systematic analysis
- Evaluation studies must be well documented, replicable, and made accessible
- Following these principles, survey question performance is improved, ensuring comparable data and supporting data users in their analyses of survey data.
The QDRL engages in research to develop and refine pretest methods and to increase overall understanding of the question response process and survey response error. Learn more on Methodological Research