Faithful-First Reasoning, Planning, and Acting for Multimodal LLMs

Read full text
Authors: Junxian Li, Xinyue Xu, Sai Ma, Di Zhang, Sichao Li
Cited by: 0

Abstract

Multimodal Large Language Models (MLLMs) frequently suffer from unfaithfulness, generating reasoning chains that drift from visual evidence or contradict final predictions.We propose Faithful-First Reasoning, Planning, and Acting (RPA) framework in which FAITHEVI provides step-wise and chain-level supervision by evaluating the faithfulness of intermediate reasoning, and FAITHACT uses these signals to plan and execute faithfulnessaware actions during inference.Experiments across multiple multimodal reasoning benchmarks show that faithful-first RPA improves perceptual faithfulness by up to 24% over prompt-based and tool-augmented reasoning frameworks, without degrading task accuracy.Our analysis shows that treating faithfulness as a guiding principle perceptually faithful reasoning trajectories and mitigates hallucination behavior.This work thereby establishes a unified framework for both evaluating and enforcing faithfulness in multimodal reasoning.Code is at https://github.com/ lijunxian111/Faithful-First-RPA.

Fields of Study & Subjects

Multimodal Machine Learning Applications Topic Modeling Explainable Artificial Intelligence (XAI)

Publication details

Journal / source
Findings of the Association for Computational Linguistics: ACL 2026
Publisher
Association for Computational Linguistics
Pages
6777–6793
Publication date
1 January 2026