How to input sentences on the fly from terminal, instead from file?

Development
1

Hello,

I’m new to using OpenNMT, but have used PyTorch and TF. I trained a text-to-text Transformer model using OpenNMT-py, but always had to provide a file for input and a destination file to get the outputs. I checked https://github.com/OpenNMT/OpenNMT-py/blob/f7fc40e319c03b90addc7e3364635e0fc7625b95/docs/source/Library.ipynb, where still the input is fed through *.pt. Is there a way I can write something like the following in OpenNMT ? Thanks in advance!

model = my_model
while True:
sent = input("Enter your input: ") #input sentence in English
translated_sent = my_model.translate(sent) #translated sentence
print(translated_sent)

2

Hi @raviteja_anantha,

Take a look at Ctranslate2

import ctranslate2
translator = ctranslate2.Translator("ende_ctranslate2/")
translator.translate_batch([["▁H", "ello", "▁world", "!"]])

It is even faster

3

Thanks @anderleich. I looked into ctranslate2, but still wanted to know if we can do this in python with openNMT-py.

4

You can have a look at the REST server: Simple OpenNMT-py REST server
Not exactly what you want but it might help.
Else, if you really want to use the onmt code as library inside your python code it’s doable, but it’ll require a bit more work. (This might help, or the REST server code for instance.)

5

Thanks @francoishernandez, I’ll do some exploration using the pointers you shared.