Is there any method to force loading the full dataset into memroy instead of lazily load in OpenNMT-py?

Support
1

Hi, since my dataset is small. I want to load it into memory once, instead of loading from the disk again and again. It takes most of its time showing the message:

Loading train dataset from nmt_input/input.train.1.pt number of examples: 226
2

hi, I also encountered this problem，The message of loading data is always displayed, have you solved it?
But when I used CPU to train the model, It’s normal.

image
image1232×751 345 KB

Thank you