How to know validation perplexity?

[DA1234k (Aditya)]

Sir how to know that validation perplexity in OpenNMT ,when my training period is stop any situation.

[guillaumekln (Guillaume Klein)]

Validation perplexity is printed in the logs and are part of the model filename that is saved after each epoch.

Otherwise see here:

Evaluate translation hypotheses

Hello everyone, Please, I want to know if there is any tool or module to scor translation hypotheses withe the trained neural network. The idea is to give a source sentence (e) and a translation (f), the system must evaluate the quality of this translation a give me a score representing the quality of the f according to e (P(f|e)). Thanks a lot. best regards, Ameur

[DA1234k (Aditya)]

sir i have a doubt i am taking 80% of training corpus , 20% of validation src/tgt i.e differece for the training corpus and also testing corpus is difference it is correct.

[guillaumekln (Guillaume Klein)]

This was already covered in the forum. You could just use:

• 2000 for validating
• 2000 for testing
• the rest for training

[DA1234k (Aditya)]

i am studying after Applying but i want to ask my training src/tgt corpus is 1 million and validation src/tgt corpus 0.2 million and also testing 0.2 million, validation is different as compression to training also testing is it correct?

[guillaumekln (Guillaume Klein)]

Sorry, I have some trouble to understand what your question or issue is. Could you be clearer?

[sunshine6789]

Thanks very much!