The reduction of heaping in numeric open-ended questions through immediate interactive feedback: experiments in a web survey

Read full text Summarise with VIRAT
Authors: Hannah Schwärzel, Marek Fuchs
Cited by: 0
References: 50

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

In open-ended numeric survey questions, certain numbers, typically round numbers, are disproportionately mentioned, creating unsubstantial “heaps” in the response distribution. These distortions often arise from satisficing behavior or imprecise memory, making it difficult to correct the resulting measurement error through post-hoc weighting. With the intention to reduce the incidence of heaping during data collection, we conducted an experimental study embedded in a web survey of the general internet population in Germany. Respondents answered two list-style numeric open-ended questions and were randomly assigned to either an experimental group, where round-number responses triggered immediate interactive feedback, or a control group getting no feedback. Results show that the feedback in the form of instructing and appreciating text-bubbles significantly reduced both the prevalence of round answers and the degree of roundness of the responses. This indicates that interactive feedback can effectively mitigate heaping in numeric open-ended questions.

Fields of Study & Subjects

Survey Methodology and Nonresponse Survey Sampling and Estimation Techniques Mobile Crowdsensing and Crowdsourcing

Publication details

Journal / source
Quality & Quantity
Volume
60
Issue
3
Pages
11213–11229
Publication date
31 March 2026
Language
EN