Validation metrics logging different float precisions?

arendu · January 26, 2018, 5:42pm

I am working on models that have very similar validation perplexities. In such cases, it would be nice to log validation metrics (in my case perplexity) at higher floating point precision (3 or 4 decimal places).

I don’t think this should be a feature request, so I’d appreciate if I just get a pointer to the relevant logging/ model saving parts of the Lua source code.

guillaumekln · January 26, 2018, 5:46pm

Validation score in logging: https://github.com/OpenNMT/OpenNMT/blob/r0.9/onmt/train/Trainer.lua#L181
Validation score in model file: https://github.com/OpenNMT/OpenNMT/blob/r0.9/onmt/train/Saver.lua#L187

arendu · January 26, 2018, 5:49pm

Thanks! for the quick reply! I just found it and was about to remove the question.