Japanese training

[liluhao1982]

Thanks.
If so, it is better to add an option disable tokenization when using the rest server instead of removing automatic tokenization/detokenization as this is great feature and in most time automatic tokenization/detokenization can work well except some language which need special morphological analyzer, e.g: Japanese, Chinese…, I required automatic tokenization/detokenization for rest server previously.

Supporting Tokenize/Detokenize automatically by Translation Server

Hello, I deployed a Translation Server and made some codes to enable this server can be accessed remotely as following (C++ translator section): http://opennmt.net/Advanced/#translation As I know the input source string should be tokenized first and translation should be detokenized, My question is: If the tokenization for Source and detokenization for translation can be executed automatically by the Translation Server? Or we need extra codes to tokenize the source before sending to Tra…

[tnkmsh]

Thanks for the good information. I’m also trying translation including Asian languages and I’d like to apply this tokenizer to ONMT, but I have no idea how to change options. Do I need to change the source code?

[Mahi (Mahendra)]

Hi Jean,

We need to build Japanese to English models & vice versa language pair , would you be able to guide on approach or do we have any available ready to use paid models to do this .
Please let me know.

Thanks
Mahi