I tried replying in the other topic but it is blocked.
I managed to compile Ctranslate2 with CUDA=10.1 and installing it in the Python virtual environment. When running
onmt_server I get the following error:
File "/home/venv/lib/python3.6/site-packages/onmt/translate/translation_server.py", line 116, in <listcomp> scores = [[item["score"] for item in ex] for ex in preds] KeyError: 'score'
It seems there is still a mismatch in the installation