162 - CLER: Improving Multimodal Financial Reasoning by Cross-MLLM Error Reflection

Read full text
Authors: Association for Artificial Intelligence 2026, Shuangyan Deng, Ciprian Doru Giurcăneanu, Jiamou Liu, Rui Mao, Zhongsheng Wang
Cited by: 0

Abstract

Recent advances in Multimodal Large Language Models (MLLMs) have enabled joint reasoning over financial textual and visual inputs. However, they still struggle with financial terminology, logical consistency, and numerical computations. Moreover, while commercial large models perform well on reasoning tasks, their high inference costs limit their scalable usage in real world financial applications. We thus propose a cost-effective framework, CLER, that combines contrastive retrieval with step-wise reflection to improve reasoning performance. Also, the reasoning cost is only generated in the test stage when using commercial large models. CLER leverages FinErrorSet, a dataset of 8,000+ mistake correction pairs from diverse open-source MLLMs. A fine grained retriever is trained to identify structurally relevant errors for self-correction through individual reflection. Experiments on three benchmarks show that CLER consistently outperforms other baselines. To our knowledge, CLER is the first framework to use cross-model errors for financial reasoning.

Fields of Study & Subjects

Multimodal Machine Learning Applications Topic Modeling Handwritten Text Recognition Techniques

Publication details

Journal / source
Underline Science Inc.
Publication date
7 January 2026
Language
EN