What are the best techniques to add noise to set clear and unambiguous translation of single word

Research
1

Hello!

I have a problem with translation of dictionaries(single-words in general). In the middle of the training(20-30k steps) model translate them corretly, but at the end I’ve got bad results(100k steps).

I’ve heard that it can be helpful to wrap dictionaries or just single-words by tags, or another type of noise. To show our model, that in any noisy context this words should be translated in certain way(I think, that can be helpful for idioms, proverbs). But now I can’t find any researches about that.

Maybe you have some ideas? Or maybe you know how to solve this?

2

Hi,

There is no need to post the same question multiple times.

If you did not get a reply in the previous post it means people don’t really know the answer, or they simply did not have the time to answer yet.

3