Could someone share if they have examples that demonstrate how to use the multithreading feature of CTranslate? I am interested in optimizing the speed of OpenNMT, and CTranslate looks like the way to go at least from the documentation.
Thanks.
Did you go through the “Performance tips” section in the README?
It explains the usage and trade-off of the threading options.
Yes, I saw that but is there sample code that shows how to use those performance tips?
You don’t need to code anything. Try using the client after compiling it:
cli/translate -h