Best of Both Worlds: Multimodal Reasoning and Generation via Unified Discrete Flow Matching

Read full text
Authors: Onkar Susladkar, Tushar Prakash, Gayatri Deshmukh, Kiet A. Nguyen, Jiaxun Zhang, Adheesh Sunil Juvekar, Tianshu Bao, Lin Chai, Sparsh Mittal, Inderjit S. Dhillon, Ismini Lourentzou
Cited by: 0

Abstract

We propose UniDFlow, a unified discrete flow-matching framework for multimodal understanding, generation, and editing. It decouples understanding and generation via task-specific low-rank adapters, avoiding objective interference and representation entanglement, while a novel reference-based multimodal preference alignment optimizes relative outcomes under identical conditioning, improving faithfulness and controllability without large-scale retraining. UniDFlpw achieves SOTA performance across eight benchmarks and exhibits strong zero-shot generalization to tasks including inpainting, in-context image generation, reference-based editing, and compositional generation, despite no explicit task-specific training.

Fields of Study & Subjects

Generative Adversarial Networks and Image Synthesis Multimodal Machine Learning Applications Advanced Neural Network Applications

Publication details

Journal / source
arXiv (Cornell University)
Publication date
12 February 2026
Language
EN
Document type
Preprint