UnicodeEncodeError: 'charmap' codec can't encode character '\ufffd' in position 0: character maps to <undefined>

Support
1

Here is my .yml file :

toy_en_de.yaml

Where the samples will be written

save_data: run/example

Where the vocab(s) will be written

src_vocab: run/example.vocab.src
tgt_vocab: run/example.vocab.tgt

Prevent overwriting existing files in the folder

overwrite: False

Corpus opts:

data:
corpus_1:
path_src: src-train.txt
path_tgt: tgt-train.txt
valid:
path_src: src-val.txt
path_tgt: tgt-val.txt
…

my directory is : C:\Users\Dhar_7\OpenNMT-py\toy-ende>

i ran the following code : onmt_build_vocab -config toy_en_de.yml -n_sample 10000

got the following error : UnicodeEncodeError: ‘charmap’ codec can’t encode character ‘\ufffd’ in position 0: character maps to

2

There probably is an issue with the way you created your .yaml configuration. (encoding issue)
Can you try converting / saving it directly in ‘utf-8’ encoding?

3

i cant understand what you mean . will you please kindly explan me the process of creating .yaml / utf-8 encoding??

4

Some useful links:

5

I have created the yaml file in notepad++ and set the encoding in UTF-8 but the same error occurs again.How can i solve it??

Thanks in advance