Skip to content
Ephizen logo ephizen / wiki
2014 · ICLR 2015

Adam: A Method for Stochastic Optimization

Kingma, Ba

2014 ICLR 2015
TL;DR
An adaptive optimizer that tracks first and second moments of the gradient per parameter. Became the default optimizer for deep learning almost overnight.
Read paper (opens in new tab)
BACKLOG · WORK IN PROGRESS

This paper is being written.

The metadata and shape of this page are stable, but the body content isn't ready yet. We'll publish it once it meets the bar of teaching something new with worked examples and real tools.

Back to papers Track progress on GitHub