Sorry for jump in. I want to raise a new ticket but this topic is related to mine.
I started to use the Rest server from the pilot release, see article here:
I have the same feeling that the speed is slow for previous version of Rest Server version, I mean if I send one sentence for translation, it will usually take long time for responding.
I test the latest version, it seems the speed is much improved. Thanks for your great work.
But it seems the detokenization for translation is missing now, please see my screenshots below for detail. This is important feature i think which should be kept. Would you please check?