Why isnt nbest feature work with pytorch beam search decoding ???
Not sure what you mean. N-best just outputs the best N beams.
yes, but it is not working for me. When I put it here in conf.json
{
“models_root”: “./available_models/models”,
“models”: [
{
“id”: 1,
“model”: “model_270519-model_step_100000.pt”,
“timeout”: 600,
“on_timeout”: “to_cpu”,
“load”: true,
“opt”: {
“beam_size”: 5,
“log_file”:“log_file.txt”,
“log_file_level”:“INFO”,
“n_best”:5
}
}
this should output me 5 outputs, but it still gives only 1
The support of n_best in the REST server was added here: https://github.com/OpenNMT/OpenNMT-py/pull/1631
Are you on a recent enough version of the code?