as shown below training speed is very low any support
- corpus_1: 23
[2021-05-14 13:34:17,526 INFO] Step 4400/50000; acc: 62.16; ppl: 6.02; xent: 1.79; lr: 0.00054; 1751/1582 tok/s; 6379 sec
[2021-05-14 13:35:28,233 INFO] Step 4450/50000; acc: 56.43; ppl: 7.87; xent: 2.06; lr: 0.00055; 1822/1706 tok/s; 6450 sec
[2021-05-14 13:36:37,717 INFO] Step 4500/50000; acc: 50.65; ppl: 9.87; xent: 2.29; lr: 0.00056; 1939/1796 tok/s; 6519 sec
[2021-05-14 13:37:48,897 INFO] Step 4550/50000; acc: 60.61; ppl: 6.45; xent: 1.86; lr: 0.00056; 2139/1695 tok/s; 6590 sec
[2021-05-14 13:38:04,982 INFO] Weighted corpora loaded so far:
* corpus_1: 24
[2021-05-14 13:38:59,630 INFO] Step 4600/50000; acc: 66.75; ppl: 4.82; xent: 1.57; lr: 0.00057; 1761/1593 tok/s; 6661 sec
[2021-05-14 13:40:10,772 INFO] Step 4650/50000; acc: 60.52; ppl: 6.37; xent: 1.85; lr: 0.00057; 1861/1735 tok/s; 6732 sec
[2021-05-14 13:41:21,067 INFO] Step 4700/50000; acc: 54.97; ppl: 7.86; xent: 2.06; lr: 0.00058; 1934/1804 tok/s; 6803 sec
[2021-05-14 13:42:32,665 INFO] Step 4750/50000; acc: 65.72; ppl: 5.03; xent: 1.61; lr: 0.00059; 2161/1696 tok/s; 6874 sec
[2021-05-14 13:42:32,680 INFO] Weighted corpora loaded so far:
* corpus_1: 25