Using trained OpenNMT models for scoring translations


(Raymond) #1

Hi, may I ask if it is possible to use trained OpenNMT just for scoring translation output (i.e., no beam search since decoded output is provided)? I’d like to use the model for re-ranking other translation output.

Thanks!


(Guillaume Klein) #2

Hello,

I think you are referring to this:


(Raymond) #3

Thanks! Understand that we can pass the -tgt argument. In this case, is it possible to supply multiple target sentences for each source sentence, any specific format for this? For each source input, I have more than one hypotheses that I want to score.


(Guillaume Klein) #4

You could just duplicate the source sentences in the test file.


(Raymond) #5

Ok, got it. Thanks for the quick reply!


(Loreto Parisi) #6

Hey @raymondhs where you able to assign that quality score to each translation?


(Raymond) #7

I’m using the log-probability of the translation, which is indicated by GOLD SCORE in the translation log.