Hi, having difficulties on modifying the beam search so it will only output unique terms, meaning that if the first word generated is “hi”, it will never output “hi” again, such that it will consider the 2nd highest candidate instead for the beam if “hi” is first.
Tried looking at advancer.lua and others but doesn’t seem straightforward to achieve this.
Also, if my prediction outcome has a max length of 21.
Does this mean my beam search should be 21? But it won’t run and show out of memory.