Beyond Templates: Dynamic Adaptation of Reasoning Demonstrations via Feasibility-Aware Exploration

Read full text
Authors: Yong Wu, weihang Pan, Ke Li, Chen Binhui, Ping Li, Binbin Lin
Cited by: 0

Abstract

Large language models (LLMs) have shown remarkable reasoning capabilities, yet aligning such abilities to small language models (SLMs) remains a challenge due to distributional mismatches and limited model capacity.Existing reasoning datasets, typically designed for powerful LLMs, often lead to degraded performance when directly applied to weaker models.In this work, we introduce Dynamic Adaptation of Reasoning Trajectories (DART), a novel data adaptation framework that bridges the capability gap between expert reasoning trajectories and diverse SLMs.Instead of uniformly imitating expert steps, DART employs a selective imitation strategy guided by step-wise adaptability estimation via solution simulation.When expert steps surpass the student's capacity-signaled by an imitation gap-the student autonomously explores alternative reasoning paths, constrained by outcome consistency.We validate DART across multiple reasoning benchmarks and model scales, demonstrating that it significantly improves generalization and data efficiency over static fine-tuning.Our method enhances supervision quality by aligning training signals with the student's reasoning capabilities, offering a scalable solution for reasoning alignment in resource-constrained models.

Fields of Study & Subjects

Semantic Web and Ontologies Data Stream Mining Techniques Logic Reasoning and Knowledge

Publication details

Journal / source
Findings of the Association for Computational Linguistics: ACL 2026
Publisher
Association for Computational Linguistics
Pages
6562–6577
Publication date
1 January 2026
Language
EN