Poisoned Substrates: Adversarial Tool Trust as a Structural Governance Problem in Agentic Clinical AI

Read full text Summarise with VIRAT
Authors: Narnaiezzsshaa Truong
Cited by: 0

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

Agentic large language models operating in clinical and regulated environments rely on retrieved tools and external guidelines as grounding inputs. This governance analysis note examines empirical evidence from Omar et al. (2026) — a large-scale adversarial evaluation of clinical LLM tool selection across 10,500 decisions by 21 models — and translates its findings into structural governance requirements for agentic AI deployment. The study demonstrates that current agentic systems correctly identify adversarially modified guidelines in only 59.4% of evaluations, with safety-critical failure rates exceeding 50% for the modification types most likely to harm patients. Tool selection is dominated by presentation-order bias rather than content analysis, with sham position explaining more detection variance than any model-level factor. This note argues that these findings constitute empirical validation that model-level detection is an insufficient governance control, and that substrate-layer constraints — privilege envelopes, boundary hygiene, interpretive authority anchoring — are structurally necessary. A secondary contribution is a formalization of multi-layer validation pipeline collapse: the conditions under which a validator ceases to be a constraint and becomes a correlated generator, producing a closed stochastic loop that no arbiter can meaningfully govern.

Fields of Study & Subjects

Ethics and Social Impacts of AI Artificial Intelligence in Healthcare and Education Adversarial Robustness in Machine Learning

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
26 March 2026
Language
EN
Document type
Preprint