Endogenous Reprompting: Self-Evolving Cognitive Alignment for Unified Multimodal Models

Read full text
Authors: Zhenchen Tang, Songlin Yang, Zichuan Wang, Bo Peng, Yang E. Li, Beibei Dong, Jing Dong
Cited by: 0

Abstract

Unified Multimodal Models (UMMs) exhibit strong understanding, yet this capability often fails to effectively guide generation. We identify this as a Cognitive Gap: the model lacks the understanding of how to enhance its own generation process. To bridge this gap, we propose Endogenous Reprompting, a mechanism that transforms the model's understanding from a passive encoding process into an explicit generative reasoning step by generating self-aligned descriptors during generation. To achieve this, we introduce SEER (Self-Evolving Evaluator and Reprompter), a training framework that establishes a two-stage endogenous loop using only 300 samples from a compact proxy task, Visual Instruction Elaboration. First, Reinforcement Learning with Verifiable Rewards (RLVR) activates the model's latent evaluation ability via curriculum learning, producing a high-fidelity endogenous reward signal. Second, Reinforcement Learning with Model-rewarded Thinking (RLMT) leverages this signal to optimize the generative reasoning policy. Experiments show that SEER consistently outperforms state-of-the-art baselines in evaluation accuracy, reprompting efficiency, and generation quality, without sacrificing general multimodal capabilities.

Fields of Study & Subjects

Multimodal Machine Learning Applications Domain Adaptation and Few-Shot Learning Generative Adversarial Networks and Image Synthesis

Publication details

Journal / source
arXiv (Cornell University)
Publication date
28 January 2026
Document type
Preprint