PRISM: Structured Optimization via Anisotropic Spectral Shaping

Read full text
Authors: Yujie Yang
Cited by: 0

Abstract

We propose PRISM, an optimizer that enhances first-order spectral descent methods like Muon with partial second-order information. It constructs an efficient, low-rank quasi-second-order preconditioner via innovation-augmented polar decomposition. This mechanism enables PRISM to perform anisotropic spectral shaping, which adaptively suppresses updates in high-variance subspaces while preserving update strength in signal-dominated directions. Crucially, this is achieved with minimal computational overhead and zero additional memory compared to first-order baselines. PRISM demonstrates a practical strategy for integrating curvature-adaptive properties into the spectral optimization paradigm.

Fields of Study & Subjects

Stochastic Gradient Optimization Techniques Matrix Theory and Algorithms Sparse and Compressive Sensing Techniques

Publication details

Journal / source
arXiv (Cornell University)
Publication date
3 February 2026
Document type
Preprint