Bpe option in learn_bpe.lua


(Xiang Zhu0718) #1

In tools/learn_bpe.lua, what’s the meanings of the -option ‘-tok_case_feature’, what’s the meaning of case feature ? An example is best , thank you.


(Guillaume Klein) #2

This is covered in the BPE documentation:

http://opennmt.net/OpenNMT/tools/tokenization/#bpe