Generative Confidants: How do People Experience Trust in Emotional Support from Generative AI?

Read full text
Authors: Riccardo Volpato, Simone Stumpf, Lisa DeBruine
Cited by: 3

Abstract

People are increasingly turning to generative AI (e.g., ChatGPT, Gemini, Copilot) for emotional support and companionship. While trust is central to these unsupervised interactions, we lack an understanding of how people develop and experience trust in this high-stakes context, where inappropriate reliance could delay professional help-seeking or lead to the acceptance of harmful advice. We recruited 24 frequent users of generative AI for emotional support and conducted a qualitative study combining diary entries, chat transcripts, and in-depth interviews. Our results reveal that trust develops through iterative processes: confirming content credibility, learning to shape AI responses, and forming nuanced "artificial human" mental models that balance conversational fluency with awareness of machine limitations. Critically, the consistently personalised, positive, and persuasive language of generative AIs simultaneously builds trust while undermining the critical engagement necessary for appropriate trust. Our findings have immediate implications for AI developers seeking to facilitate rather than discourage critical thinking, mental health professionals navigating clients’ concurrent AI use, and policymakers establishing safeguards for vulnerable populations.

Fields of Study & Subjects

Artificial Intelligence in Healthcare and Education Digital Mental Health Interventions Ethics and Social Impacts of AI

Publication details

Journal / source
SSRN Electronic Journal
Publisher
Elsevier BV
Publication date
1 January 2026
Document type
Preprint