Learning to learn by gradient descent by gradient descent

The move from hand-designed features to learned features in machine learning has been wildly successful. In spite of this, optimization algorithms are still designed by hand. In this paper we show how the design of an optimization algorithm can be cast as a learning problem, allowing the algorithm to learn to exploit structure in the problems of interest in an automatic way. Our learned algorithms

[elu_18]

Learning to learn by gradient descent by gradient descent 最適化手法もADAMとかRMSPropとか手で選んでないで学習しちゃえばいいじゃんという意欲作 https://t.co/HlblmR2D5i

[yoavlt]

LSTMで構築されたOptimizer。タイトルがすごい。