Use of <blank> in the dictionary

(Shruti P) #1

Hi, could you please explain why there is a ‘’ in the dictionary after preprocessing? Why do we need this apart from and ?

(Guillaume Klein) #2


It is reserved for the padding which has its own entry in the embedding lookup table.

(Shruti P) #3

Hi @guillaumekln,

Could you please explain in more detail?

  • When is the embedding lookup table used?
  • Is this the encoder embedding?
  • How often is there a need for padding to the input data?


(Guillaume Klein) #4

The lookup table is used as input for the encoder and decoder.

By default, there is no padding on the source side (unless the -uneven_batches flag is enabled). The target side usually contains padding.