HDFS support in OpenNMT-tf


(Aditya Chukka) #1

Are there any plans to extend support for ```hdfs`` file system?

(Guillaume Klein) #2

Although I haven’t tested it, TensorFlow should have a builtin support for that.

See this guide to setup your environment: https://www.tensorflow.org/deploy/hadoop

Then, prefix your data files with, for instance, hdfs://namenode:8020/.

Let me know if that works for you!