Building CTranslate2 From Source

anterart · April 1, 2024, 8:43am

Hello!

I’m trying to build CTranslate2 from source after customising the code in python/translator.cc file.
I’m using the guide here: https://opennmt.net/CTranslate2/installation.html
When I install the python package on the same computer where I built it, it works. But when I install the python package on a different computer from my private artifactory, it doesn’t work - when I’m running the following code:

from ctranslate2 import Translator

I get the following error:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/opt/conda/envs/arty_env/lib/python3.9/site-packages/ctranslate2/__init__.py", line 21, in <module>
    from ctranslate2._ext import (
ImportError: libctranslate2.so.4: cannot open shared object file: No such file or directory

I suspect that the C++ stuff is not included in the python package build (the resulting .whl file is just ~500kb).
I did pay attention to the “Attention” section in the install guide. It looks like the install directory of CTranslate2 in the computer that builds it is in “/home/ubuntu/my_ctranslate2”, so I did: export CTRANSLATE2_ROOT=/home/ubuntu/my_ctranslate2, but it didn’t help.

More Info:
This is my cmake command:

make -DWITH_CUDA=ON -DWITH_CUDNN=ON -DWITH_DNNL=ON -DCUDA_DYNAMIC_LOADING=ON -DCMAKE_INSTALL_PREFIX=/home/ubuntu/my_ctranslate2 ..

and I also ran sudo ldconfig

I would be happy if you can help me with this problem

ymoslem · April 1, 2024, 10:44am

Hello!

Maybe try to add the path as in here:

github.com/OpenNMT/CTranslate2

Build from source code and get cannot open shared object file error

opened 09:29AM - 23 Aug 21 UTC

closed 01:08PM - 23 Aug 21 UTC

SefaZeng

I try to build the python and cpp module from source code. I run the following c…ommands first: ``` git submodule update --init --recursive mkdir build && cd build cmake -DWITH_MKL=ON -DWITH_CUDA=ON .. make -j4 ``` Then I get the libctranslate2.so and cli/translate . I try to build the python library from these commands: ``` # Install the CTranslate2 library. cd build && make install && cd .. # Build and install the Python wheel. cd python pip install -r install_requirements.txt python setup.py bdist_wheel pip install dist/*.whl ``` I found a missing ctranslate2.lib directory under the installation path compared to the pip installation. And when I try to transform the model to ctranslate file using this command: `ct2-opennmt-py-converter --model_path $1 --quantization int8 --output_dir int8_model_ctranslate2 --force` It returns this error: ``` Traceback (most recent call last): File "/root/miniconda2/envs/torch1.8/bin/ct2-opennmt-py-converter", line 5, in <module> from ctranslate2.converters.opennmt_py import main File "/root/miniconda2/envs/torch1.8/lib/python3.6/site-packages/ctranslate2/__init__.py", line 2, in <module> from ctranslate2.translator import Translator ImportError: libctranslate2.so: cannot open shared object file: No such file or directory ``` Did I miss something? Is there any methods to solve this?

If this does not work, feel free to open an issue at GitHub.

anterart · April 1, 2024, 11:15am

Hi @ymoslem, thank you for your reply.

I also followed this suggestion.
I edited the LD_LIBRARY_PATH environment variable like this:

export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$CTRANSLATE2_ROOT/lib

then I ran:

python setup.py bdist_wheel --dist-dir $CTRANSLATE2_ROOT

but the resulting .whl file is still small and doesn’t contain the libctranslate2.so file.
I will keep trying to make it work, I will open an issue in Github if I won’t make any progress.

anterart · April 1, 2024, 12:52pm

I opened an issue in GitHub:
https://github.com/OpenNMT/CTranslate2/issues/1654