Spectral Optimization for Neural Networks: Muon and the Newton-Schulz Iteration
From Adam's per-coordinate rescaling to Muon's spectral balancing: how the Newton-Schulz iteration orthogonalizes momentum, the Gram-Newton-Schulz refinement, and experiments comparing optimizers.