This is minimum Seq2Seq implementation using Tensorflow 1.4/1.5 API with some comments, which supports Attention and Beam Search and is based on tensorflow/nmt/README.md. I'd recommend you run this in https://colab.research.google.com/. This code is also available on gist. import numpy as np import tensorflow as tf from tensorflow.python.layers import core as layers_core hparams = tf.contrib.train