ERank: Fusing Supervised Fine-Tuning and Reinforcement Learning for Effective and Efficient Text Reranking

Read full text
Authors: Association for Artificial Intelligence 2026, Yuzheng Cai, Mingxin Li, Dingkun Long, Pengjun Xie, Yanzhao Zhang, Weiguo Zheng
Cited by: 0

Abstract

Reranking models are a crucial component in modern systems like Retrieval-Augmented Generation, tasked with selecting the most relevant documents prior to generation. However, current reranking approaches often face a fundamental trade-off. On one hand, Supervised Fine-Tuning methods that frame relevance as a binary classification task lack the necessary scoring discrimination, particularly for rerankers based on reasoning Large Language Models (LLMs). On the other hand, approaches designed for complex reasoning often employ powerful yet inefficient listwise formulations, rendering them impractical for low latency applications. To resolve this dilemma, we introduce ERank, a highly effective and efficient reranker built from a reasoning LLM that excels across diverse relevance scenarios. We propose a novel two-stage training pipeline that begins with Supervised Fine-Tuning (SFT). In this stage, we move beyond binary labels and train the model generatively to output fine grained integer scores, which significantly enhances relevance discrimination. The model is then further refined using Reinforcement Learning (RL) with a novel, listwise derived reward. This technique instills global ranking awareness into the efficient pointwise architecture. We evaluate the ERank-4B reranker on the BRIGHT, FollowIR, TREC DL, and BEIR benchmarks, demonstrating superior effectiveness and robustness compared to existing approaches. On the reasoning-intensive BRIGHT benchmark, our 4B-parameter reranker achieves an nDCG@10 of $38.7$, while a larger 32B variant reaches a state of the art nDCG@10 of $40.2$.

Fields of Study & Subjects

Information Retrieval and Search Behavior Topic Modeling Recommender Systems and Techniques

Publication details

Journal / source
Underline Science Inc.
Publication date
7 January 2026
Language
EN