Preprocess.lua on OpenNMT-TF

Support
1

Hello, I am using OpenNMT Tensorflow on windows 7.
I am following this multi-way training tutorial for quite some time now.
I already have 2000 random validation files for training. But I don’t know what is the equivalent command/package of preprocess.lua/py in OpenNMT Tensorflow with -valid_src, valid_tgt, train_src, train_tgt and save_data parameters.

2

Hello,

There is no equivalent in OpenNMT-tf. The preprocessing happens on-the-fly during the training.

1 Like