Typo in FAQ OpenNMTTokenizer

Site Feedback
1

I found error on the page: https://opennmt.net/OpenNMT-py/FAQ.html#opennmt-tokenizer

OpenNMT Tokenizer Additional options are available:
…
src_onmttok_kwargs: additional kwargs for pyonmttok Tokenizer class, source side;
src_onmttok_kwargs: additional kwargs for pyonmttok Tokenizer class, target side.
maybe there should be tgt_onmttok_kwargs

2

Yes, you’re right, thanks for pointing it out.
There are a few issues with the onmttok_kwargs args and docs that should be fixed soon.

3

Addressed in https://github.com/OpenNMT/OpenNMT-py/pull/1902

@MonsterDimka do not hesitate to directly open a PR on the repo to fix such issues in the future.

1 Like