OpenNMT Forum

Nbest feature during translation with pytorch

Why isnt nbest feature work with pytorch beam search decoding ???

Not sure what you mean. N-best just outputs the best N beams.

yes, but it is not working for me. When I put it here in conf.json

{
“models_root”: “./available_models/models”,
“models”: [
{
“id”: 1,
“model”: “model_270519-model_step_100000.pt”,
“timeout”: 600,
“on_timeout”: “to_cpu”,
“load”: true,
“opt”: {
“beam_size”: 5,
“log_file”:“log_file.txt”,
“log_file_level”:“INFO”,
“n_best”:5
}
}

this should output me 5 outputs, but it still gives only 1

The support of n_best in the REST server was added here: https://github.com/OpenNMT/OpenNMT-py/pull/1631
Are you on a recent enough version of the code?

thanks @francoishernandez I am on an older version.