FinLCR: Scaling Financial Long-Context Reasoning via Curriculum Reinforcement Learning

Read full text
Authors: Wenjie Qiu, Yong Xie, Karan Aggarwal, Aitzaz Ahmad, Stephen Lau
Cited by: 0

Abstract

Long-context financial document understanding and reasoning pose significant challenges for small language models (SLMs).In this paper, we scale the financial long-context reasoning capability of SLMs through reinforcement learning.Specifically, we propose an efficient curriculum reinforcement learning recipe that features staged training across context lengths and difficulty-aware data sampling.To support our curriculum recipe, we curate Fin-Ladder, a difficulty-graded financial corpus spanning diverse datasets and context lengths.We apply the proposed corpus and recipe to train Financial Long-Context Reasoner (FinLCR), a 4-billion parameter model with enhanced financial reasoning capabilities.Experiments demonstrate that our curriculum learning recipe yields superior performance on financial numerical reasoning benchmarks.

Fields of Study & Subjects

Topic Modeling Multimodal Machine Learning Applications Stock Market Forecasting Methods

Publication details

Journal / source
Workshop on Financial Technology and Natural Language Processing (FinNLP)
Pages
15–25
Publication date
1 January 2026
Language
EN