Word Sequence Decoding in Seq2Seq Architectures

https://towardsdatascience.com/word-sequence-decoding-in-seq2seq-architectures-d102000344ad

1*ZiaGQhQhmN8yAK5WLeqpnA.jpeg

Word Sequence Decoding in Seq2Seq Architectures – Towards Data Science
A concise introduction to decoding algorithms in Natural Language Generation. Beam Decoding with k=3 at each time-step. Here, we search for a high scoring output sequence by keeping track of top k vocabulary outputs at each time-step while decoding.We usually stop our search when end-of-sentence token (<eos>) is reached or till time-step t for all or at-least some n output sequences.
towardsdatascience.com