OpenNMT

Training Server Docker

Hello,

I’m building a server to do my trainings and I will be using SSH to access the server.

I was thinking of using a Docker with Jupyter on the server. Anyone have better suggestion or a link to a good Docker to do that?

I was planning on installing : jupyter/tensorflow-notebook from this website:
https://jupyter-docker-stacks.readthedocs.io/en/latest/using/selecting.html

I’m not 100% sure if it’s the correct Docker to put on a server and access via SSH.

Best regards,
Samuel

Just incase anyone come across the same problem, I ended up using this:

which is working like a charm!

Best regards,
Samuel

Hi Samuel

I buid a docker image. Some time ago, but I guess you can get an idea. The only requirement is to install nvidia-docker if you want to use the GPU. Invoking docker, you can specify one or all.

Not sure if someone has posted, but from the stability or performance works flawlessly.

Hope this helps.
Miguel

FROM pytorch/pytorch:1.9.0-cuda10.2-cudnn7-runtime
# 
# Update the image to the latest packages
RUN apt-get update && apt-get upgrade -y
#
RUN apt install git -y
RUN apt install nano
# Locale UTF8 https://stackoverflow.com/questions/27931668/encoding-problems-when-running-an-app-in-docker-python-java-ruby-with-u
RUN apt-get update && apt-get install -y locales && locale-gen en_US.UTF-8
RUN locale-gen en_US.UTF-8
ENV LANG en_US.UTF-8
ENV LANGUAGE en_US:en
ENV LC_ALL en_US.UTF-8
# sentence piece
# from https://github.com/google/sentencepiece
RUN apt-get install cmake build-essential pkg-config libgoogle-perftools-dev -y 
RUN git clone https://github.com/google/sentencepiece.git && \
     cd sentencepiece       && \
     mkdir build            && \
     cd build               && \
     cmake ..               && \
     make -j $(nproc)       && \
     make install           && \
     ldconfig -v          
RUN cd ../..              
RUN  git clone https://github.com/OpenNMT/OpenNMT-py.git && \
     cd OpenNMT-py  && \
     pip install -e .
1 Like