DREAM: Dynamic Recall and Elastic Adaptive Memory on Machine Learning

Read full text
Authors: Bagzhan Karl, Alizhan Karl
Cited by: 0

Abstract

DREAM is a novel neural architecture that enables real-time, in-situ parameter adaptation during inference. By integrating Active Inference and Spike-Timing-Dependent Plasticity (STDP), it overcomes the static constraints of Transformers and LSTMs. Core Mechanisms: Slow-Fast Weights: Resolves the stability-plasticity dilemma by separating long-term invariants from elastic contextual updates. Surprise Gate: A homeostatic regulator that triggers plasticity only upon detecting structural novelty, preventing overfitting to noise. Low-Rank Updates: Ensures computational efficiency for Edge AI by restricting adaptations to a compact feature subspace (r=16). Liquid Time-Constants (LTC): Dynamically adjusts information integration rates to instantly discard outdated context during anomalies. Key Results: On non-stationary audio tasks (LJ Speech), a 82K parameter DREAM model achieved a 99.9% error reduction, outperforming stasis-bound models (LSTM 893K, Transformer 551K) through millisecond-scale self-calibration

Fields of Study & Subjects

Neural Networks and Applications Advanced Memory and Neural Computing Data Stream Mining Techniques

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
8 March 2026
Language
EN