Multi way training


(stano) #1

I am working using two language lets name them language A and B. I wanted to create a single model that can accept any of the languages either A and B and give out a corresponding transalted output. ie if my input is language A then the output should language B and vice versa should also be true using pytorch.

I have read about the ROMANCE but couldnt understand since a kinda new in machine translation. Can someone please help me.

(jean.senellart) #2

Hello, you can just mix A-B and B-A sentences and it should work reasonably well - your model will both learn to detect source language and to translate to the other language. However, if your languages A and B are similar, then you can expect confusion between the languages - so the better is to add a marker in the source (so in A-B sentence, just add target_B token somewhere for instance as the first token, and the other way around for the other direction),