The threat of synthetic respondents extends to clinical mental health screening

Read full text
Authors: Kianté A. Fernandez, Laura A. Berner, Blair R. K. Shevlin
Cited by: 0

Abstract

Online platforms have enabled clinical mental health research at unprecedented scale, yet large language models (LLMs) now threaten the integrity of remotely collected data. Recent work has demonstrated that LLM-based synthetic respondents can complete general surveys with human-like plausibility, but the vulnerability of validated clinical psychiatric instruments remains unexamined. Here, we show that a commercially available LLM, given only brief diagnostic persona descriptions, produces clinically differentiated responses across seven standardized psychiatric screening instruments spanning mood, anxiety, obsessive-compulsive, trauma, psychotic, neurodegenerative, and eating disorders. In a simulation of 2106 synthetic personas, diagnosis-congruent personas generated scores exceeding clinical cutoffs on five of seven instruments, with scores scaling monotonically with assigned severity. This mimicry required no specialized configuration. Coherent symptom endorsement can no longer serve as a proxy for authentic participation, urgently necessitating standardized verification methods for clinical online data.

Fields of Study & Subjects

Survey Methodology and Nonresponse Ethics and Social Impacts of AI Digital Mental Health Interventions

Publication details

Journal / source
PsyArXiv (OSF Preprints)
Publication date
6 March 2026
Language
EN
Document type
Preprint