K-Field Routing: Cross-Layer Causal Signals for Multi-Hop Reasoning in Transformers

Read full text
Authors: Y.Y.N. Li
Cited by: 0

Abstract

We propose a theoretical framework in which neural network optimization dynamics can be characterized by an effective Lorentzian spacetime structure in the reduced $(K,\sigma)$ state space—analogous to the (1+1)-dimensional geometry of special relativity. The Hessian of a reference Lyapunov potential exhibits signature $\Sig(\Hessian)=(1,1)$, where the information flow ratio $K$ plays the role of 'time' and entropy $\sigma$ of 'space'. This geometric structure, combined with stability requirements, theoretically constrains the space of optimal neural architectures. We present \textbf{K=1 Chronogeometrodynamics}, a theoretical framework deriving optimal neural structures from information-geometric first principles. Our contributions are threefold: (1) a \textbf{uniqueness theorem} proving that Lorentzian signature $\Sig(\Hessian)=(1,1)$ with stability constraints forces a unique optimal structure $\Jmat_{\Hessian} = \alpheff \Hessian^{-1} \Jmat$, (2) definition of the K-metric ($K = \dd{\Phi}/H$) as a training diagnostic, and (3) experimental validation providing empirical support for dissipative dynamics with negative average Lyapunov drift. Experiments show K-metric convergence from high initial values toward task-dependent equilibria, with negative average drift supporting the predicted dissipative behavior. This work represents a step from \emph{trial-and-error architecture design} toward \emph{geometry-guided principles}. \textbf{Keywords}: Neural architecture, information geometry, port-Hamiltonian systems, Lorentzian geometry, optimal control, deep learning theory

Fields of Study & Subjects

Neural Networks and Applications Stochastic Gradient Optimization Techniques Complex Systems and Dynamics

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
11 March 2026
Language
EN