Prépublication · 2026
MOMENT-DP: Momentum Aware Evaluation of Correlated Noise for Differentially Private Training
Sunny Gupta, Raja Viswanadha — Monde
Source : arXiv
Résumé
Temporally correlated noise can substantially improve the utility of differentially private optimization, yet candidate mechanisms are commonly designed or evaluated using only partial information about the optimization process, such as workload structure, learning-rate schedules, or local curvature. We study whether persistent optimizer state provides additional information that can change the relative utility of privacy-valid correlated-noise mechanisms. We introduce MOMENT-DP, an optimizer-state-aware framework that models how temporally correlated privacy noise propagates through momentum-…