WITHDRAWN: Masking Drives Shared Representations in Predictive Networks

Read full text
Authors: Shamim Khaliq
Cited by: 0
References: 3

Abstract

Abstract When must a neural network develop shared representations for self-generated and externally-observed information? We investigate this question using small recurrent networks trained on masked sensorimotor prediction. We find that cross-modal masking during training is the primary driver of cross-modal shared representation alignment (mean effect + 0.10 on Pearson correlation), while further constraint tightening (lower temporal persistence, higher masking probability) adds negligible mean improvement (effect = − 0.001). The real contribution of tight constraints appears at large capacity: modest floor elevation and variance compression across seeds. We report a methodological correction: earlier descriptions of a dramatic “optional-to-compulsory” regime transition were confounded by a metric change (Linear CKA to Pearson correlation) between experimental conditions. With consistent metrics, the transition is gradual, not phase-like. These findings suggest that cross-modal shared representations emerge from cross-modal predictive pressure, with capacity constraints modulating the strength and consistency of shared representation expression.

Fields of Study & Subjects

Embodied and Extended Cognition Multisensory perception and integration Neural Networks and Applications

Publication details

Journal / source
Research Square
Publication date
18 February 2026
Language
EN
Document type
Preprint