Awesome

Online and Linear-Time Attention by Enforcing Monotonic Alignments

NOTE - A reference implementation of the monotonic attention mechanism is now built into TensorFlow in the `tf.contrib.seq2seq` module. See here for documentation.

This repository contains an example implementation of the monotonic alignment decoder proposed in "Online and Linear-Time Attention by Enforcing Monotonic Alignments", by Colin Raffel, Minh-Thang Luong, Peter J. Liu, Ron J. Weiss, and Douglas Eck (arXiv:1704.00784).

It also contains (in the benchmark folder) the synthetic benchmark used to compare the speed of the monotonic attention mechanism and standard softmax-based attention.

Awesome

Online and Linear-Time Attention by Enforcing Monotonic Alignments

NOTE - A reference implementation of the monotonic attention mechanism is now built into TensorFlow in the tf.contrib.seq2seq module. See here for documentation.

NOTE - A reference implementation of the monotonic attention mechanism is now built into TensorFlow in the `tf.contrib.seq2seq` module. See here for documentation.