Hi, when supplying translate.lua with the gold targets, it reads the target file line by line and not by feature ID. So gold and pred don’t match, and gold has a very high perplexity value compared with predicted.
Shruti (Shruti P) #1
guillaumekln (Guillaume Klein) #2
Could you open a GitHub issue for that?
Linking to the created issue for reference: