Use of <blank> in the dictionary

1

Hi, could you please explain why there is a ‘’ in the dictionary after preprocessing? Why do we need this apart from and ?

2

Hi,

It is reserved for the padding which has its own entry in the embedding lookup table.

3

Hi @guillaumekln,

Could you please explain in more detail?

  • When is the embedding lookup table used?
  • Is this the encoder embedding?
  • How often is there a need for padding to the input data?

Thanks!

4

The lookup table is used as input for the encoder and decoder.

By default, there is no padding on the source side (unless the -uneven_batches flag is enabled). The target side usually contains padding.