Massive Exploration of Neural Machine Translation Architectures

Neural Machine Translation (NMT) has shown remarkable progress over the past few years with production systems now being deployed to end-users. One major drawback of current architectures is that they are expensive to train, typically requiring days to weeks of GPU time to converge. This makes exhaustive hyperparameter search, as is commonly done with other neural network architectures, prohibitiv

[elu_18]

ニューラル機械翻訳の大規模なハイパパラメータ探索によると以下の設定が最適値らしい． ちなみに著者@dennybritz氏のNMT実装(TensorFlow)は現時点で最高の完成度だと思… https://t.co/8U7Cdc1mak https://t.co/lngqPW2DYv