Question about Intel MKL

Guoli · April 11, 2021, 10:35am

A beginner question about Intel MKL. During the compiling step, Intel MKL (oneapi) would be installed to build the ctranslate2. However it wasn’t installed for the runtime docker container. CTranslate2/Dockerfile.ubuntu-gpu at 3190be529d55d1e4d4ca246bd2a9cf405107bb6d · OpenNMT/CTranslate2 · GitHub

Then what does the runtime mean below to use Intel MKL? Thanks

By default, the runtime automatically decides whether to use Intel MKL or not based on the CPU vendor.

guillaumekln · April 11, 2021, 10:57am

Intel MKL is integrated in all prebuilt binaries of CTranslate2. It is installed in the first stage of the Dockerfile and linked statically to CTranslate2:

github.com

OpenNMT/CTranslate2/blob/3190be529d55d1e4d4ca246bd2a9cf405107bb6d/docker/Dockerfile.ubuntu-gpu#L33



ENV ONEAPI_VERSION=2021.2.0
ENV MKL_BUILD=296
ENV DNNL_BUILD=228
RUN wget https://apt.repos.intel.com/intel-gpg-keys/GPG-PUB-KEY-INTEL-SW-PRODUCTS.PUB && \
    apt-key add *.PUB && \
    rm *.PUB && \
    echo "deb https://apt.repos.intel.com/oneapi all main" > /etc/apt/sources.list.d/oneAPI.list && \
    apt-get update && \
    apt-get install -y --no-install-recommends \
        intel-oneapi-mkl-devel=$ONEAPI_VERSION-$MKL_BUILD \
        intel-oneapi-dnnl-devel=$ONEAPI_VERSION-$DNNL_BUILD \
        && \
    apt-get clean && \
    rm -rf /var/lib/apt/lists/*

WORKDIR /root/ctranslate2-dev

COPY third_party third_party
COPY cli cli
COPY include include

Then at runtime we only call Intel MKL when running on an Intel CPU.