I’ve been following the tutorials to train a Transformer topology on the toy German/English corpus. It logs the loss after every 50 steps, but I was wondering if there was a way to also print out the BLEU score for the validation dataset as well? Is there a flag for that? Could someone show me an example?
Also, during training I get the following metrics:
I know that global_step/sec is the speed of one forward/backward pass through the network. What do the “words_per_sec/features” and “words_per_sec/labels” mean?
Thanks so much.