Log_file encoding

SamuelLacombe · June 2, 2021, 12:21pm

Hello,

I have notice that when i use opennmt to translate in google colab, my log file come out with “UFT-8” encoding, but if I do it in command line on my own computer it’s come out has “ANSI”.

Is there a way to control the file encoding before it’s saved?

francoishernandez · June 2, 2021, 2:29pm

This case is not handled by default but it could probably be fairly easy to add with the encoding kwarg here:

github.com

OpenNMT/OpenNMT-py/blob/d5d3c74e90a8bbde07bf555f0c6bf6b0a3e7850b/onmt/utils/logging.py#L26

    
      
          
          
console_handler = logging.StreamHandler()
          console_handler.setFormatter(log_format)
          logger.handlers = [console_handler]
          
          
if log_file and log_file != '':
              if rotate:
                  file_handler = RotatingFileHandler(
                      log_file, maxBytes=1000000, backupCount=10)
              else:
                  file_handler = logging.FileHandler(log_file)
              file_handler.setLevel(log_file_level)
              file_handler.setFormatter(log_format)
              logger.addHandler(file_handler)
          
          
return logger

as documented here:
https://docs.python.org/3/library/logging.handlers.html#filehandler