Can anyone explain this? Everything is the same except the OS of my server.
YMoslem also confirmed this.
What are the operating systems?
On each system, can you update to the latest version of CTranslate2, enable the verbose mode by setting the environment variable CT2_VERBOSE=1, and then report the output here?
My home machine is Windows 8.1, server is Ubuntu 21.10.
Server is using AVX2, localhost is using AVX.
It can explain the differences. You can verify this by forcing AVX on the server by setting the following environment variables:
MKL_CBWR=AVX CT2_FORCE_CPU_ISA=AVX
Great it’s closer now just a few differences. In the future I will try Dockerizing it should eliminate any more confounding factors.
1 Like