Translation without GPU

I have completed the training the model with my dataset and with GPU it is working fine. I want to know if I can use CPU for translation part only, whether it is possible or not and if yes then how?

Yes you can. Just dont use the -gpu parameter. Obviouslly it will take longer.

Have a nice day!

1 Like

Also, you might want to use CTranslate2 for faster inference, especially on CPU.

1 Like