I would like to export several models from a given checkpoint in order to run experiments.
For example, a default one using traditional beam search, a noisy beam one, a sampling one etc.
Since I am only interested in the export operation, training configurations are irrelevant. I only provide those parameters, the vocabulary files and model directory like so:
model_dir: /work/model data: source_words_vocabulary: /work/shared.bpe target_words_vocabulary: /work/shared.bpe params: decoding_subword_token: ▁ decoding_noise: - dropout: 0.1 - replacement: [0.1, <unk> ] - permutation: 3
I use this conf file and my checkpoint to export a model, then call that model to infer. I am using ONMT as a library if it makes any difference. However, when inspecting the translations I don’t see any permutations or noising, in fact it appears that vanilla beam search ran instead. Is this a known issue, or am I making a mistake somewhere?