Hi, when supplying translate.lua with the gold targets, it reads the target file line by line and not by feature ID. So gold and pred don’t match, and gold has a very high perplexity value compared with predicted.
Hi,
Could you open a GitHub issue for that?
Thanks.
Linking to the created issue for reference: