Simulation of Human Survey Responses for Market Research: The Role of Contextualization in LLM-Based Agents

Read full text
Authors: Bhupender Kumar Saini, Chandan Kumar, Kathrin Pollmann, Janina Bierkandt, Doris Janssen, Christian Knecht, Nora Fronemann
Cited by: 1
References: 12

Abstract

Market and user research rely on surveys to understand customer preferences. Collecting rich human responses is a costly and time-intensive process. This has prompted growing interest in using large language model (LLM)-based agents to simulate human survey responses. A key open question, however, is how different forms of contextual data shape what such agents represent and how well they reflect individual preferences. Based on data collected in a six-week longitudinal study with 13 participants, combining interviews, diary entries, and surveys, we generated eight variants of multiple LLM-based agents that progressively integrate personal contextual information and evaluated their ability to reflect participants’ responses to realistic market research questions. Our results show that incorporating personal data can improve alignment with human responses, with contextualized agents achieving similarity scores up to approximately 0.78 compared to around 0.60–0.68 without participant-specific context. The findings indicate that richer contextualization strategies produce measurable but incremental improvements in how well agents approximate individual preferences.

Fields of Study & Subjects

Mobile Crowdsensing and Crowdsourcing Social Power and Status Dynamics Opinion Dynamics and Social Influence

Publication details

Journal / source
Proceedings of the Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Pages
1–5
Publication date
13 April 2026
Language
EN