Translation without GPU

Support
1

Hi,
I have completed the training the model with my dataset and with GPU it is working fine. I want to know if I can use CPU for translation part only, whether it is possible or not and if yes then how?

2

Yes you can. Just dont use the -gpu parameter. Obviouslly it will take longer.

Have a nice day!

1 Like
3

Also, you might want to use CTranslate2 for faster inference, especially on CPU.

1 Like