I just tried to restart my current training from the last checkpoint (epoch 5), with the new code.
With 2 threads, I still got the OutOfMemory error.
The preparation time, with only one thread, took a bit less than 5 mn for all files (16.7M).
I don’t see something else noticeable. All seems ok.