We have made use of CTranslate (https://github.com/OpenNMT/CTranslate) extensively for translating with OpenNMT torch models on android. I was wondering if there is a similarly available library for making use of OpenNMT-py Pytorch models? Now that that the torch distribution is not maintained, it would be great to update our environment, if we can comntinue to support translation on a mobile device.
Unfortunately there is currently no direct paths to run a OpenNMT-py model on mobile. One promising approach would be to export the model to ONNX but this has been proved to be difficult.