I have completed the training the model with my dataset and with GPU it is working fine. I want to know if I can use CPU for translation part only, whether it is possible or not and if yes then how?
Yes you can. Just dont use the -gpu parameter. Obviouslly it will take longer.
Have a nice day!
Also, you might want to use CTranslate2 for faster inference, especially on CPU.