Transformers memory_bank vs enc_state

[anderleich]

Hi,
I’m wondering which are the encoder’s final embeddings for the words, enc_state or memory bank. What do each of them represent?
Thanks