Language model inference


(Vincent Nguyen) #1

Just a reminder :slight_smile:

It would be great to support LM inference.

Output may be:

  1. next word prediction
  2. text generation
  3. log likelihood for rescoring

Cheers.


(jean.senellart) #2

for reference - tool documented there: http://opennmt.net/OpenNMT/options/lm/ - and see also this thread:


(Vincent Nguyen) #3

Jean,
Did you run some benchmark for this on your end ?
PTB ?