Nouveau Recherche PDF, HTML, DOCX et bien d'autres formats.

Prépublication · 2026

MOMENT-DP: Momentum Aware Evaluation of Correlated Noise for Differentially Private Training

Sunny Gupta, Raja Viswanadha — Monde

Source : arXiv

Résumé

Temporally correlated noise can substantially improve the utility of differentially private optimization, yet candidate mechanisms are commonly designed or evaluated using only partial information about the optimization process, such as workload structure, learning-rate schedules, or local curvature. We study whether persistent optimizer state provides additional information that can change the relative utility of privacy-valid correlated-noise mechanisms. We introduce MOMENT-DP, an optimizer-state-aware framework that models how temporally correlated privacy noise propagates through momentum-…

Actions

Citation