Possible bug in translate.lua with gold features

Hi, when supplying translate.lua with the gold targets, it reads the target file line by line and not by feature ID. So gold and pred don’t match, and gold has a very high perplexity value compared with predicted.


Could you open a GitHub issue for that?


Linking to the created issue for reference: