Why Stochastic Gradient Descent Beats Full-Batch
Gradient noise in SGD is not a bug to fix but a feature to exploit: it provides implicit regularization that helps the optimizer escape saddle points, traverse flat regions, and prefer wide minima that generalize.