Hi, having difficulties on modifying the beam search so it will only output unique terms, meaning that if the first word generated is “hi”, it will never output “hi” again, such that it will consider the 2nd highest candidate instead for the beam if “hi” is first.
Tried looking at advancer.lua and others but doesn’t seem straightforward to achieve this.
Also, if my prediction outcome has a max length of 21.
Does this mean my beam search should be 21? But it won’t run and show out of memory.
If the hypotheses filtering is aggressive you may want to consider more hypotheses before applying it by using the -pre_filter_factor option. This way, after the filter you can still work with -beam_size hypotheses.