Outlier-robust nonsmooth stochastic optimization

Read full text
Authors: Shuyao Li, Stephen J. Wright, Jelena Diakonikolas
Cited by: 0

Abstract

We study nonsmooth stochastic optimization under adversarial data contamination, which models outliers that are often unavoidable in modern machine learning tasks.While robust methods for such settings with smooth objectives have been developed, nonsmooth models remain largely unexplored despite their central role in machine learning, including regression with ℓ 1 losses, support vector machines, and distributionally robust optimization.We introduce a general framework for outlier-robust nonsmooth optimization, combining robust mean estimation with projected subgradient methods.Our analysis establishes the first polynomial-time algorithms with provable guarantees for nonsmooth (weakly) convex objectives under adversarial corruptions.As a key application, we resolve an open problem in outlierrobust distributionally robust optimization, obtaining polynomial-time algorithms with bounded errors for Conditional Value-at-Risk and f -divergence-based formulations.These results advance the theory of robust nonsmooth optimization and highlight new directions for robust learning with corrupted data.

Fields of Study & Subjects

Risk and Portfolio Optimization Simulation Techniques and Applications Metaheuristic Optimization Algorithms Research

Publication details

Journal / source
Journal of Nonlinear and Variational Analysis
Volume
10
Issue
2
Publication date
1 January 2026