English to hindi translation

can we use a english to france pretrained model to train on our new dataset and translate english to other language…bacically can we use transfer learning?

Do you mean reusing the English encoder for another training?