Model wont resume training - missing files

SamuelLacombe · January 10, 2022, 12:42am

Hello,

I had an infortunate issue,

My google drive was full and my last check point was just halfway saved. Can I simply remove the partial file: “ckpt-12000.index” and start my training again?

The error says that ckpt-12000.data-0000-of-0001 is missing.

I prefer to ask before trying anything. I dont want things to get worse.

guillaumekln · January 10, 2022, 8:25am

Hi,

Yes, you can remove this file.

You may also need to edit the file checkpoint to change the name of the latest checkpoint.