What exactly is the 'Gold Score'?

I understand that the target sentence is passed through the decoder part of the model and then the output from that step is pass through the generator (liner + softmax function) to obtain log probability- and the gold score is related to this probability. But what exactly does it signify? Should the gold score be better (lower) than the pred score?


I think there is no official description about gold score. Normally, the lower gold score we obtain, the better the model fits (or the more closer target side language distribution the model learns)~ and if your model has converged, gold score technically must lower than the pred score

Gold score is the log likelihood of the reference that you provided during translation.

@alphadl @guillaumekln, thanks!