I trained a model on OpenNMT and it does really well on the task. For connectivity reason I need to have an embedded version on iOS, any pointers on how to achieve this and what is the current recommended route? I’ve already read about several approaches:
- tensorflow >= 1.5 to core ML model conversion
- embedding python code into native iOS using https://github.com/pybee/Python-Apple-support
I wonder how much would need to be re-written, whether any solution can already handle like the attention layers and other specificities of the OpenNMT model. I guess beam search would need to be re-written, anything else?
Thanks a lot!