Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, Szegedy
2015 ICML 2015
TL;DR
Normalize each layer's activations over the mini-batch, then rescale with learned parameters. Dramatically speeds up training and reduces sensitivity to initialization.