Dissociative Identity: Language Model Agents Lack Grounding for Reputation Mechanisms

Read full text
Authors: Botao Amber Hu, Helena Rong, Max Van Kleek
Cited by: 1
References: 141

Abstract

As autonomous language model agents proliferate, forming an emerging agentic web with real-world consequences, what credibility signals can you use to decide whether to trust an unfamiliar agent in the wild and delegate to it? A natural governance intuition is to extend human identity verification and reputation mechanisms, from “Know Your Customer” and credit scores to “Know Your Agent” regimes. However, we argue that this analogy is fundamentally incomplete. Reputation mechanisms function both as social signals and as corrective feedback that sustain an equilibrium of trustworthy behavior, presuming a persistent identity associated with behavioral continuity, sanction sensitivity, and costly non-fungibility. Yet language model agents are ontologically dissociative: they are essentially an assemblage of mutable modules—foundational models, system prompts, tool-access policies, external memory, and, in some cases, a multi-agent system as a whole— any of which may change agent behavior—with a fluid persona that is also vulnerable to adversarial attack and may not internalize sanctions. Drawing on dissociative identity disorder jurisprudence, this dissociativity leaves agents without grounding for identifiability, predictability, credibility, and rehabilitability—the very properties that reputation mechanisms aim to sustain—thereby collapsing trust. We argue that identity-based, ex post, regulative, sanction-based governance, such as reputation, is structurally inapplicable to dissociative agents, and we suggest a shift to observability-based, ex ante, constitutive, protocol-based behavioral harnesses.

Fields of Study & Subjects

Language and cultural evolution Ethics and Social Impacts of AI Access Control and Trust

Publication details

Journal / source
Proceedings of the 2026 ACM Conference on Fairness, Accountability, and Transparency
Publisher
ACM
Pages
4199–4219
Publication date
23 June 2026