I get result
Train perplexity: 13.3963
Train accuracy: 51.4974
Validation perplexity: 23.7748
Validation accuracy: 44.4444
Decaying learning rate to 0.00195312
Just want to undurstand how this parameters being calculated and so that I can improve it.
Hi, with regard to perplexity you should check out the forum at here: Metrics (Bleu, ppl, gold ppl, pred ....)
I recently asked a question on it and many good answers were given. I also have a bunch of links in my post which may help you.
Thanks @seisqui , Your answer has much useful information.