A Thermodynamic Theory of Learning Part II: History-Dependent Reachability and Continual Learning

Read full text
Authors: Daisuke Okanohara
Cited by: 0

Abstract

We formulate plasticity as target-dependent, finite-horizon reachability under history-dependent dynamics, using standard minimum-energy control theory. An extended state includes parameters and internal variables that affect future updates. Around a reference trajectory, the input-to-endpoint response and its controllability Gramian determine the minimum input energy for each reachable displacement. Minimizing this energy over the joint task target defines a task-conditioned adaptation cost, exact for the arbitrary-input linear model. A solvable learning-retention example shows that this cost can increase without any rank loss, and distinguishes small directional gain from an inaccessible direction. Wasserstein transport supplies a complementary global lower bound, while learning-map Jacobians describe deformation of initial perturbations rather than response to future inputs. The resulting learning-retention frontier depends on the current extended state, admissible updates, target, horizon, and cost metric; nonlinear and constrained-update applications require additional control of these modeling choices.

Fields of Study & Subjects

Motor Control and Adaptation Neural Networks and Applications Reinforcement Learning in Robotics

Publication details

Journal / source
arXiv (Cornell University)
Publication date
8 February 2026
Language
EN
Document type
Preprint