Mulithreading in CTranslate

ctranslate

(Negacy Hailu) #1

Could someone share if they have examples that demonstrate how to use the multithreading feature of CTranslate? I am interested in optimizing the speed of OpenNMT, and CTranslate looks like the way to go at least from the documentation.

Thanks.


(Guillaume Klein) #2

Did you go through the “Performance tips” section in the README?

It explains the usage and trade-off of the threading options.


(Negacy Hailu) #3

Yes, I saw that but is there sample code that shows how to use those performance tips?


(Guillaume Klein) #4

You don’t need to code anything. Try using the client after compiling it:

cli/translate -h