https://towardsdatascience.com/word-sequence-decoding-in-seq2seq-architectures-d102000344ad
 |
Word Sequence Decoding in Seq2Seq Architectures – Towards Data Science A concise introduction to decoding algorithms in Natural Language Generation. Beam Decoding with k=3 at each time-step. Here, we search for a high scoring output sequence by keeping track of top k vocabulary outputs at each time-step while decoding.We usually stop our search when end-of-sentence token (<eos>) is reached or till time-step t for all or at-least some n output sequences. towardsdatascience.com |