Adjust for Trust: Mitigating Trust-Induced Inappropriate Reliance on AI Assistance

Read full text
Authors: Tejas Srinivasan, Jesse Thomason
Cited by: 2
References: 45

Abstract

User trust biases reliance on AI assistance during decision-making tasks, with overly low and high levels of trust resulting in increased under- and over-reliance, respectively. We propose that AI assistants should adapt their behavior through trust-adaptive interventions to mitigate such inappropriate reliance. For instance, when user trust is low, that providing an AI explanation can elicit more careful consideration of the assistant’s advice by the user. In two decision-making scenarios—laypeople answering science questions and medical doctors making diagnoses—we find that providing supporting and counter-explanations during moments of low and high trust, respectively, yields up to 38% reduction in inappropriate reliance and 20% improvement in decision accuracy. We are similarly able to reduce over-reliance by adaptively inserting forced pauses to promote deliberation. Our results highlight how AI adaptation to user trust facilitates appropriate reliance, presenting exciting avenues for improving human-AI collaboration.

Fields of Study & Subjects

Ethics and Social Impacts of AI Human-Automation Interaction and Safety Access Control and Trust

Publication details

Journal / source
Proceedings of the 31st International Conference on Intelligent User Interfaces
Publisher
ACM
Pages
1883–1900
Publication date
3 March 2026